NexVeridian/nexveridian-web
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity Actions

add hf org to just file

Browse source
This commit is contained in:
Elijah McMorris 2025-06-09 15:46:53 -07:00
parent c8209ce370
commit caa78124a3
Signed by: NexVeridian
SSH key fingerprint: SHA256:bsA1SKZxuEcEVHAy3gY1HUeM5ykRJl0U0kQHQn0hMg8
2 changed files with 12 additions and 11 deletions
Download patch file Download diff file Expand all files Collapse all files

3
content/blog/llm-inference-benchmarks.md
View file

@ -54,12 +54,13 @@ https://huggingface.co/docs/hub/en/mlx
https://huggingface.co/mlx-community
git clone git@github.com:NexVeridian/NexVeridian-web.git
```bash
uv venv
uv pip install huggingface_hub hf_transfer mlx_lm
uv run huggingface-cli login
just mlx_create "Qwen/QwQ-32B" "4 6 8" "/Users/elijahmcmorris/.cache/lm-studio/models" "false"
just mlx_create "Qwen/QwQ-32B" "4 6 8" "/Users/elijahmcmorris/.cache/lm-studio/models" "mlx-community" "false"
# or
uv run mlx_lm.convert --hf-path Qwen/QwQ-32B -q --q-bits 4 --upload-repo mlx-community/QwQ-32B-4bit --mlx-path /Users/elijahmcmorris/.cache/lm-studio/models/mlx-community/QwQ-32B-4bit
```