Compact Llama 3.1 for efficient text generation.
PassingRight routes requests to the best providers that are able to handle your prompt size and parameters.
Compact Llama 3.1 for efficient text generation. You can access it through PassingRight's OpenAI-compatible API with automatic provider routing, fallback, and cost analytics.
Pricing for Llama 3.1 8B Instruct on PassingRight starts at $0.02 per million input tokens and $0.05 per million output tokens, depending on the provider. The pricing table above always reflects the current per-provider rates.
Llama 3.1 8B Instruct supports a context window of up to 128,000 tokens on its largest provider deployment.
Llama 3.1 8B Instruct is served by Inference.net, Cerebras, NovitaAI, AWS Bedrock, Nebius AI, Together AI through PassingRight. Requests are automatically routed to the best available provider, with fallback when a provider has issues.
Llama 3.1 8B Instruct supports tool (function) calling and soft JSON output, but NOT strict JSON output schema (its upstream provider does not enforce it).
Llama 3.1 8B Instruct was released on July 23, 2024.
Muse Spark 1.3 Contributor
1,048,576 context$0.10 in / $0.20 out per 1M
Muse Spark 1.3
1,048,576 context$1.25 in / $4.25 out per 1M
Muse Glimmer 30B
131,072 context$0.30 in / $1.20 out per 1M
Muse Spark 1.2 Contributor
1,048,576 context$0.10 in / $0.20 out per 1M
Muse Spark 1.2
1,048,576 context$1.25 in / $4.25 out per 1M
Muse Spark 1.1
1,048,576 context$1.25 in / $4.25 out per 1M