Phi Tiny MoE Instruct
Phi Tiny MoE Instruct is the smaller SlimMoE release, with 3.8B total parameters and 1.1B active parameters. It offers a 4K context for short English instruction tasks.
What distinguishes this release
The card identifies the same Phi-3.5-MoE and GRIN-MoE ancestry as Phi Mini MoE. It is a compressed and distilled model with instruction and preference post-training.Phi Tiny MoE Instruct official model card
Build the task around its input and output
Practical guidance. Use a small, explicit output contract such as selecting a category or rewriting a short passage. Provide the labels or terminology the task needs in the prompt. A narrow contract makes failures easier to detect than an unrestricted assistant conversation.
Review the result in its intended setting
Practical guidance. Compare memory use, complete response time and task errors against Phi Mini MoE. The smaller active count is useful only if the result still meets the application's requirements. Keep a clear path for a human to review cases that do not fit the task.
Specifications & access
| Detail | Value and conditions |
|---|---|
| Access | Downloadable |
| Model identifiers | microsoft/Phi-tiny-MoE-instruct |
| Context window | 4,096 tokens Published checkpoint context; serving engines may impose lower limits Phi Tiny MoE Instruct official model card |
| Model size | 3.8B total; 1.1B activePhi Tiny MoE Instruct official model card |
| Input and output | Text input and text outputPhi Tiny MoE Instruct official model card |
| Weight license | MITPhi Tiny MoE Instruct official model card |