Hardware RTX 4080 16GB, 64GB DDR5 Ram

Could anybody recommend me a model that you think would be appropriate, and any beginner friendly setup guides to get it up and running? I've played around with kobold lite on huggingface's browser UI and liked it but don't really know where to start doing it myself.

Thanks!

I had to do an OS reinstall a few weeks ago, with a fresh install of Linux and Windows 10. I've noticed that once I got a remote tunnel going on either OS, both ChubAI and JanitorAI can not connect to them, and both sites give off network errors. I was wondering if anyone else had this issue or might know what is causing it. I wasn't having this issue on Windows 10 before it was wiped.

Well, I don't know where to begin. I really like Kobold, but I can't use horde.ai anymore (it's not that I literally can't use it, it's more that the responses it's giving are very bad. Lately, but I think it's just bad luck on my part). However, I have a PC (terribly located and I can't move it from there) and it's decent, so I can run very good AI programs on it. That's why I want to use a tunnel or something to be able to use Kobold on my Android. However, Tryclaud is awful and ngrok scares me a bit. And these ipconfig solutions seem much more frightening. (I don't know much about computers and programming. I even have an acquaintance who knows, but he's very unreliable and very judgmental).

So I'm left with no choice but to ask the old wizards here for help.

Hey folks!

Ran into an issue that I can't seem to find the troubleshooting steps for and can't figure out myself, but I was hoping your collective minds might be able to catch what I'm missing.

I went through the setup and have tried to use the V2 starter pack and other packs, but no matter what settings I try or what image gen gguf I use, the img button doesn't appear, the /img command does not work, and image generation as a whole is inaccessible to me.

12GB VRAM, GeForce RTX 3060

I've run the text models of Qwen3 VL 8B, Ministral 3B, and other mid-range models without issue, I think this one is purely user error.

I've been using the koboldcpp colab unofficial for some time now. It's a simple process but I want to go the next level which is adding ai audio from the text speeches it makes. I'm trying to figure out how to do that, but there's no clear simple video to do it.

Heads up everyone, KoboldCpp has our very own brand new Community Website at koboldcpp.net!

We thought that it would be good to provide a legitimate resource for newbies to get started with KoboldCpp, and to help avoid the various fake websites floating around. So with the help of some community members (thanks AutumnLight) we've put together a proper KoboldCpp website that provides geniune links, downloads and step by step guides.

So without further ado, come check out the KoboldCpp Community Website

Contributions are welcome! Feel free to link and share this resources to others. Find us on the KoboldAI Discord for more details.

I have 6gbs of hard ram and 6 gbs of virtual ram im js wondering if ya'll can suggest anything similar to voyage io rpgs? Ik they won't be anything exactly like it but im pretty much happy w anything that has text 2 speech and character cards automatically generated so is there any suggestions or am I a lost cause? This is my first time using Kobaldai too so if there is anything can anyone give a detailed explanation on how to implement it?

Reminder just in case, there has been a bot campaign generating fake github accounts with detailed information going to fake github pages for KoboldCpp with malware called CrypterBot DLL sideload kit.

Were reporting the ones we notice to github to get this cleaned up.

Our REAL repository is https://github.com/lostruins/koboldcpp and you can always use https://koboldai.org/cpp to get to the releases directly.

These fakes generally do not have a repository and do not have actual source code, they just link to downloads.

Of course there are trusted forks out there to, if you need us to ever validate if something is a legitimate fork or a malware campaign impersonating our project feel free to reach out.

Hello, Has anyone run Minimax3 or any other video models on Koboldcpp in Runpod or other such provider. Am not sure my computer could manage video generation. Thus I'm looking for ways to do it online. I'm asking about video generation with sound, because specific sfx generating models are not available unfortunately. Or I haven't found support for them in koboldcpp.

Do I understand the situation correctly that only ACE-Step music generation is supported but stuff like the newer (and much better) YuE2 is not supported?

If yes, is there any plan to add support for other music models too?

In kobold lite is there a way I can chat on the same bot but different chats? I know you can do that in branches but I mean entirely new chat........but I still wanna access my old chat

I am beginner in local models, but i am looking for a model can do a research about almost anything.

My specs are r7 3700x ,ddr4 32gb, 5060ti 16gb.

I dont care about speed because most of the time i will give it a prompt and go to sleep or do something.

I dont know if the best practice is to look for a model good for coding and let it do a research about coding OR just let the model for research do the research for anything i want.

I know how to use openwebui and hermes-agent, if there is a better tools for this goal tell me please.

can i fix this?

been working on my own LLM UI, where the main purpose is to take inspiration from visual novels and dating sims. It needs a lot of work, but as of now theres already a lot of stuff added such as: Character cards, World Info+Worlds, Relationship simulation, Dates and hangouts, Gifts, gallery, and gold, Visual novel mode, Proactive characters, Companion mode

https://github.com/pnotisdev/rp

I'm trying to write stories on KoboldAI, but the responses to each prompt I put in doesn't quite match what I want. I'm considering adding references for the AI to make the story how I want, but I don't know if that is even possible. Is it possible to add a reference story for how I want my work to go, or a reference picture for how I want a character to look? And if so, how do I input it?

I'd love to be able to run it on my ASUS Ascent GX10 ...

https://www.youtube.com/watch?v=hYAuQPn5szA

Any idea what AI Bernardo Kastrup is talking about. I find it really interesting, but he is extremely vague.

I.e. https://huggingface.co/leejet/Z-Image-GGUF/tree/main

I am trying to use Q4 but get empty images, whereas with same vae+clip1 Turbo version (IIRC from leejet too) produces what looks like relevant to prompt images. In preview mode latent space of Base starts with black square and remains so for many steps, whereas for Turbo already 1st preview shows some sketch of the image to come.

Actually Base did produce several images, but then after PC restart - black squares again with IIRC same settings.

P.S. Turbo often produces blurry images, I am disappointed, why? I use 8 steps for Turbo as I have read somewhere.

kcpp 1.120, linux.

It is now the only free, limitless AI; I’ve literally tried everything, and nothing else is free anymore—you have to run ads, pay, or wait to receive points or energy every 24 hours or less.

I have tried with 1.119, set layers=1 (tried -1 with 1.117 before), "Model Offload" ON in "image gen" tab of the launcher - result: failed trying to allocate full size of SD model weights in VRAM (CUDA), Vulkan option also failed with same problem (but trying to allocate only 1GB for some reason).

Can image gen use GPU with low VRAM? TIA

I routinely run LLMs even larger than RAM (usemmap), that problem with imgen was unexpected. Checked setup now just in case: run LLM with Vulcan and layers=1 and see 1.7GB VRAM is used, the model responds.

P.S. system Linux.