Nvidia
Efficient

Phi-3-Mini-4K (NIM)

Nano

Microsoft Phi-3 Mini hosted as an NVIDIA NIM. Same Phi-3 weights, packaged for NVIDIA AI Foundry deployment.

Phi-3-Mini-4K (NIM) is a efficient AI model from Nvidia. It costs $0.0400 per million input tokens and $0.0400 per million output tokens (blended $0.0400/M), with a 4,000-token context window.

RatesUSD per million tokens. Blend is 70% input, 30% output, our calculation.

INPUT
$0.0400/M
per million input tokens
OUTPUT
$0.0400/M
per million output tokens
BLENDED 70/30
$0.0400/M
unchanged since 3 May
CONTEXT
4,000
tokens

Hand-maintained from Nvidia's published pricing; no check date on record.

What it is good at
  • Phi-3 mini quality
  • NIM packaging
  • On-device or NVIDIA-stack deployment
Typical use cases
  • NVIDIA-stack edge inference
  • NIM-based small-model deployments

Benchmarks

vs. best public score
Scores inherited from Phi-3 Mini — this is a hosted variant of the same open-weights model, so the underlying benchmark scores are identical.
MMLU68.8%
Multitask academic knowledge across 57 subjects. Source: Microsoft (self-reported), MMLU, read 2026-11-10.
MATH41.3%
High-school competition math problems. Source: Microsoft (self-reported), MATH (0-Shot; CoT), read 2026-11-10.
HumanEval58.5%
Python function synthesis from docstrings. Source: Microsoft (self-reported), HumanEval (0-shot, phi-3-mini-instruct), read 2026-11-10.
Hand-curated from each provider's published reports and public leaderboards. Methodology varies across sources, treat as directional rather than authoritative.

More from Nvidia

See all 6 →

Frequently asked questions

How much does Phi-3-Mini-4K (NIM) cost?

Phi-3-Mini-4K (NIM) costs $0.0400 per million input tokens and $0.0400 per million output tokens, for a blended reference rate of $0.0400 per million tokens.

What is Phi-3-Mini-4K (NIM)'s context window?

Phi-3-Mini-4K (NIM) supports up to 4,000 tokens of context in a single request.

What is Phi-3-Mini-4K (NIM) best for?

Phi-3-Mini-4K (NIM) is well suited to Phi-3 mini quality, NIM packaging and On-device or NVIDIA-stack deployment.

Who makes Phi-3-Mini-4K (NIM)?

Phi-3-Mini-4K (NIM) is developed and served by Nvidia.

Terms used on this page