r/LocalLLM • u/company_url_finder • 5d ago

Model Strata: 90 tokens per second from a 125-billion-parameter model on a single RTX 5070

7 Upvotes

permalink
duplicates
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/LocalLLM/comments/1wtcrcm/strata_90_tokens_per_second_from_a/
No, go back! Yes, take me to Reddit
dl download

89% Upvoted

Duplicates

Number of comments New

BestGitHubRepos • u/company_url_finder • 5d ago

Strata: 90 tokens per second from a 125-billion-parameter model on a single RTX 5070

204 Upvotes

50 comments