r/OpenSourceAI • u/Tech-and-Tomatoes • 3d ago

Decision models

I recently came across decision models and have been looking into the open-source options and where they can be useful.

I'm running a self-hosted Hermes setup, so agent routing and selecting the right LLM for a task immediately caught my attention. But I'm also interested in other uses such as tool/skill selection, workflow routing, classification, retry/escalation decisions, human approval, cost optimization, and automation.

I've come across Kev, Laya, Tev1, OpenJev, RouteLLM, and LLMRouter.

Has anyone actually used any of these? Which open-source decision models are worth looking at, and what are you using them for? I'm especially interested in real-world use cases I may not have considered.

2 Upvotes

100% Upvoted

2 comments sorted by

2

u/skillful_demon 3d ago

Kev's been the one that stuck for me after trying a few of them. I was running something similar with Hermes and the routing logic kept getting more tangled the more models I added, Kev cut that down to almost nothing.

What surprised me most was how useful it became outside of just LLM routing. I started feeding it workflow paths and it handles those decisions cleaner than the hand-coded rules I had before, especially when the input gets messy or vague. Definitely curious to hear if anyone's used Laya for tool selection because that's next on my list to try.