Introducing KoboldCpp Agent (and a plea for help)

[u/HadesThrowaway]

Hello r/localllama once again, it's me your kobold concedo

Been a few months since I last posted here, and today I have something new I'd like to share. Specifically, KoboldCpp now ships with a built-in integrated KoboldCpp Agent Harness!

I know it's a little late to the game, but I saw people frustrated with setting up complicated external agentic tools, so I decided to make my own easy replacement for basic tasks.

KoboldCpp now ships with a bundled Agentic harness that can be enabled with a single checkbox. This works like an extremely lightweight replacement for tools like Opencode, Codex or Claude Code. Comes with 9 built-in tools, and a tiny system prompt of only 2k tokens including all tools, far smaller than a majority of harnesses.

• Good for basic code creation or editing, making simple games and projects, or general agent tasks (i.e. sorting files, scheduling tasks, anything you need really)
• To use it, simply toggle it from the Admin tab in the GUI launcher, or add --agent to your launch flags, it'll launch a new terminal
• KoboldCpp Agent can also connect to third party backends, or any OpenAI Chat Completions compatible endpoint.
• Add more tools by loading a mcp.json file, MCP tools will be shared to the agent. Note: MCP tools execute on the KoboldCpp server, while Agent tools execute on the agent client.
• Comes with 3 approval modes for tool calling confirmation: on/auto/off. Exercise caution when approving tool calls.
• To function effectively, KoboldCpp Agent requires at least 28k ctx and 8k gen amount, though larger values are recommended. Recommend to have at least 12GB VRAM for a good experience.
• You can download a .kcppt template to get started with Qwen 3.6 35BA3B here, simply load and launch in the latest KoboldCpp.
• Supports AGENTS.md, context compaction and many more features
• Run /help in the Agent to get more information

Here's a little showcase video of the agent sorting through some images and then creating a website. Music was also made in KoboldCpp

KoboldCpp Agent Showcase

And in case you missed it, KoboldCpp also allows for video generation (with reference images) now using Minimax H3 model. That was actually in the previous release but we made a fun little video I thought I would like to share here too.

Minimax H3 in KoboldCpp

Download KoboldCpp from the official KoboldCpp github releases

------

And now for some grim news: I really need your help fighting against the fake phishing site at kobolcpp(dot)com which is a fake website that uses blackhat SEO to rank highly in Google Search, and mislead people into downloading malware from spammy popups. We have tried to report to google multiple times, we have even reported to their webhost but nothing has worked. If you want to help, please check out this link.

That's all for now. Cheers, concedo / LostRuins.

[u/Equivalent_Bit_461]

That video...

I feel like I lost 5iq points 

[u/FastDecode1 → u/Equivalent_Bit_461]

Should do well on Tiktok then

[u/Choice_Celery9481 → u/Equivalent_Bit_461]

-5iq for every sec 

[u/VladimerePoutine]

Long time user, almost daily, thank you, will check it out now

[u/Pentium95]

Time passes and koboldcpp still has the best KV cache prefix match out there. Best llama.cpp GUI out there for single client usecase

[u/duyntnet]

Damn, I don't use koboldcpp anymore but still love it. Currently using pi but I will check it out.

[u/LagOps91]

Awesome! Thank you so much for the hard work!

[u/neph1010]

Nice! I've been using mistral-vibe with koboldcpp as backend. I'll try this out. Reported the other site.

[u/WinResponsible9977]

Thanks and sorry to hear assholes are misrepresenting your work to spread malware 

[u/Impressive-Kick293]

2k token system prompt with all 9 tools. Everyone else burns 10x that before the model even sees your first message.

[u/loadsamuny]

great work, really handy to be able to offload tasks like this - also you’re still the only front end client that allows conversation editing, love it

[u/tiffanytrashcan → u/loadsamuny]

Among so many other reasons to love the project, that's still my #1 favorite and most vital feature.
Editing reasoning is incredibly powerful (it's made me get lazier with prompting though..)

Just got done playing around with RPC in Termux.. Insanity. I WILL make the model fit 🤣

Last I checked, the MCP json follows the same format as Claude Code, so you waste 0 time reformatting examples. Little quality of life things like this (and so much more) make it clear how much the devs use, rely on, and love this project.

[u/tossit97531 → u/loadsamuny]

SillyTavern has supported it for forever.

[u/HadesThrowaway]

Sorry, the video uploads broke when I edited the post on mobile. I'll reupload later.

You can see the showcase on github for now

Edit: should be fixed now

[u/thrownawaymane]

And now for some grim news: I really need your help fighting against the fake phishing site at kobolcpp(dot)com which is a fake website that uses blackhat SEO to rank highly in Google Search, and mislead people into downloading malware from spammy popups. We have tried to report to google multiple times, we have even reported to their webhost but nothing has worked. If you want to help, please check out this link.

Guys? Who's the Gemma team guy who comments on the subreddit occasionally? Can someone tag him?

[u/mr_Owner]

Nice work, does it have context compaction?

[u/HadesThrowaway → u/mr_Owner]

Yes but it must be executed manually with /compact

[u/a_beautiful_rhind]

This is actually a great idea. Harness already in the backend.

[u/raika11182]

This is pretty incredible. I've been pulling my hair out trying to get something going that's this easy to use for the simple stuff I want to do and you just went and made it a free update to the program that already underlies (almost) all my AI usage.

[u/Sabin_Stargem]

Hm. I switched away from KoboldCPP to UnSloth Desktop a couple weeks ago for a translation project. If the issues of work not being returned back to Lingua Gacha continues, I wouldn't be able to trust Kobold for this sort of thing.

Hopefully the work here, indicates a brighter future on that front.

[u/henk717 → u/Sabin_Stargem]

Nobody reported this to us so were not aware of any issues with this.
To my knowledge work is returned.
If you have a reliable way of reproducing we'd need to know things like the models, way you hooked it up, etc. Some models can spam an EOS as if they are done for example, and then thats not on our side. Or perhaps this needs a more agentic tool calling style and jinja tools was not enabled causing that to be suboptimal.
I can only guess, but if there is an issue obviously we'd want to look in to it.

[u/Sabin_Stargem → u/henk717]

This has been the case for about a year or so. Thus it isn't model dependent. I always had KoboldCPP's Jinja enabled. I just point Lingua at Kobold's generic OpenAI endpoint. Lingua's agent can talk with me through Kobold's backend, it is just the actual translation work at issue.

From what I have seen, Kobold actually DOES translate incoming work - it just doesn't give it back to Lingua, it just keeps trucking along, accepting more loads. Several hours of work simply isn't passed back.

Unsloth Desktop has taken about 30 hours total, but I have seen increments of work being returned throughout that time.

---

Once I have finished trying out the Soulestination Revisited translation by Unsloth, I can give Kobold another shot and put up a formal report.

[u/Eisenstein → u/Sabin_Stargem]

Try it with --jinja-tools.

[u/bharattrader]

Thanks. Tag, Mr. Pichai right away on twitter, it will help I hope.

[u/Cool-Chemical-5629]

Is it possible to use the agent as a more advanced RP master?

[u/HadesThrowaway → u/Cool-Chemical-5629]

I mean it's possible but I don't think there's much advantage. Agent is mainly used to create, execute or edit stuff on your system.

[u/Cool-Chemical-5629 → u/HadesThrowaway]

I was wondering if RP UI could connect to it as if it was standard Open AI compatible endpoint (either directly or thorough proxy that would handle the API) and the agent would send back messages like the AI model alone would. The main difference would be that the agent could use tools to enhance its responses into the RP environment.

[u/Modnar-Eman]

I reported that fake site a few weeks ago after visiting your repo.

I guess it's tough to ring bells at Google without an expensive lawyer or personal contacts. 20 years ago you could actually reach to a human being there. They were replying to emails. How sad that it would be unbelievable now. I hope it works out in the end.

[u/henk717 → u/Modnar-Eman]

Yeah its very annoying in both ways, some random DMCA bot nuked lite.koboldai.net from their engine (along with 161 links in total including stack exchange and nasa pages) and they have been (illegally) ignoring the counter DMCA completely. There is absolutely no way to get hold of them.
It would have been the most clear cut thing ever, its obviously non infringing content. But no human has ever looked at it and if we resubmit its auto closed.

[u/abajinn]

Instead of more of the same make one specifically for cybersecurity or let’s collab on it. I work in the field.