1 Run Ollama to create the variant
link:
https://docs.ollama.com/quickstart
ollama serve
This shows that ollama is running on local: http://127.0.0.1.11434
** Leave this terminal open proceed to next step
2 Model
Model to choose,
link:
https://ollama.com/library/qwen3.5:4b
ollama pull qwen3.5:4b
qwen3.5:4b
link to modelfile docuentation:
https://docs.ollama.com/modelfile
3 Modelfile TO CREATE Variant
Hermes needs 64000 context length,
change with this modelfile ,
link to doc:
https://docs.ollama.com/modelfile
cat > ~/qwen3.5-4b-64k.Modelfile <<EOF'
FROM qwen3.5:4b
PARAMETER num_ctx 64000
EOF
4 CREATE Variant
In Ollama Create the
ollama create qwen3.5-4b-64k -f ~/qwen3.5-4b-64k.Modelfile
link to Hermes configureation:
https://docs.ollama.com/modelfile
Check if installed with
ollama list
and
ollama show qwen3.5-4b-64k --modelfile
