You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Everything so far is Qwen2.5 / Qwen3. Convert Llama 3.1 8B and Mistral 7B, run scripts/bench_model.py with perplexity on WikiText-2 against native, report size, tokens/s and that the perplexity is identical.
Everything so far is Qwen2.5 / Qwen3. Convert Llama 3.1 8B and Mistral 7B, run scripts/bench_model.py with perplexity on WikiText-2 against native, report size, tokens/s and that the perplexity is identical.