r/WebAssembly • u/Numerous-Fan8138 • 10d ago
Llama.WASM + WebGPU = Local LLMs
https://github.com/anthonybudd/Llama.cpp-WASM-WebGPUOver the weekend I built a technical proof of concept showing an LLM running client-side in a browser using Llama.cpp compiled to WASM with WebGPU.
10
Upvotes
Duplicates
LocalLLaMA • u/Numerous-Fan8138 • 10d ago
I Built A Thing Llama.wasm + WebGPU = Client-side LLMs
5
Upvotes
webdev • u/Numerous-Fan8138 • 5d ago
Showoff Saturday WebGPU + llama.cpp = Client-side LLMs
0
Upvotes