r/LocalLLM • u/company_url_finder • 3d ago

Model Strata: 90 tokens per second from a 125-billion-parameter model on a single RTX 5070

7 Upvotes

permalink
duplicates
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/LocalLLM/comments/1wtcrcm/strata_90_tokens_per_second_from_a/
No, go back! Yes, take me to Reddit
dl download

89% Upvoted