by Microsoft· Released August 2024· Cutoff August 2024
Phi-3.5 MoE is a lightweight, state-of-the-art Mixture-of-Experts model with 6.6B total parameters and 3.8B active parameters. It excels in multilingual tasks, code generation, and long-context reasoning, outperforming larger models in its class.
Input cost
Free (open source)
Output cost
Free (open source)
Context window
128K tokens
Max output
—
Modalities
Parameters
6.6B total (3.8B active)
License
MIT
Efficient, high-performance multilingual and code generation tasks with long context requirements.
