LLM Resource Sizer

Preset You can edit any value after prefilling.

Hugging Face

Model params (B) Active params for MoE (B, optional) If MoE, set the activated parameters per token. Weight precision BF16 FP16 FP8 INT8 INT4 KV precision BF16 FP16 FP8 Hidden size (override, optional) Layers (override, optional)