Importing a HuggingFace config.json
Load any open-weights model from the file that defines its shape.
Every model on the HuggingFace Hub ships a config.json beside its weights, and that file fully determines the architecture. NEURAX reads it directly, so working on a model that already exists does not mean rebuilding it block by block.
- 1Press Import, right of the workspace tabs.
- 2Press Open File and pick a
config.json, or paste its contents into the box. - 3The badge above the box names the format it recognised.
- 4Press Read File. A summary appears: depth, width, heads, vocabulary, and the structural choices it read.
- 5Read the amber box, if there is one — it lists anything the file did not state.
- 6Press Import. The architecture appears on the canvas and the analysis runs.
What it reads#
- Dense decoders — LLaMA, Mistral, Qwen, Gemma, Phi, OLMo, StableLM, Falcon, GPT-2, GPT-NeoX, OPT, Bloom.
- Encoders — BERT, RoBERTa, DistilBERT, ELECTRA and relatives, which get a classification head instead of an LM head.
- Mixture of experts — Mixtral, Qwen-MoE and DeepSeek-style configs, including shared experts.
- Multimodal — the language tower, from
text_config. Vision and audio towers are not imported.
How accurate is an import?#
| Model | Published | NEURAX | Error |
|---|---|---|---|
| LLaMA-2 7B | 6.74 B | 6.63 B | −1.7 % |
| Mistral 7B | 7.24 B | 7.13 B | −1.5 % |
| Qwen2 7B | 7.62 B | 7.62 B | −0.04 % |
| GPT-2 | 124 M | 124 M | < 1 % |
Page 19 of 33. This guide is in English for now. It is the same guide that is built into the NEURAX desktop app (the ? button, or F1). Found a mistake? Tell us.
