Activefastllm Proprietary

Jamba 1.6 Mini

by AI21 Labs· Released August 2024· Cutoff March 2024

Jamba 1.6 Mini is a lightweight, efficient large language model from AI21 Labs, optimized for speed and cost-effectiveness. It is part of the Jamba family, which uses a hybrid SSM-Transformer architecture for long context handling. This model is designed for high-throughput, low-latency applications where budget is a concern.

Official Site API Docs

Input cost

$0.20 per 1M tokens

Output cost

$0.80 per 1M tokens

Context window

256K tokens

Max output

4096 tokens

Modalities

text

License

proprietary

Capabilities

Function CallingCode GenerationStreamingJSON ModeLong ContextMultilingual

Best For

Cost-sensitive, high-volume applications requiring fast responses and long context windows.

Strengths

Extremely low cost per token
Fast inference speed
256K token context window
Efficient hybrid architecture

Limitations

Smaller model size may limit complex reasoning
Not suitable for tasks requiring deep domain expertise
Limited to text-only input and output

Use Cases

Customer support chatbots

Document summarization

Content generation at scale

Data extraction from long documents

Real-time translation

Code completion and generation

Sentiment analysis

Improvements Over Previous Model

Introduced as a smaller, more affordable variant in the Jamba family
Lower pricing compared to Jamba 1.5 Large
Maintains 256K context window of predecessor
Optimized for faster inference and lower latency
Improved efficiency for high-throughput applications

Back to all models