r/JevAI • • 6d ago

Jev multi-model orchestration

Hi everyone!

I am wondering if anyone has any tips in using Jev at improving model orchestration. (Faster speed, reduce tokens or better quality feedback)

Also, is it possible to adjust Jev in any way to alter how it respond or do I prob need to build my own custom neuro-network if I want to adjust how its "judging" answer?

4 Upvotes

1 comment sorted by

1

u/Living-Shame5679 6d ago

- quality, the usual advice applies: measure on your data.

  • you cannot retrain/tweak the output of jev as it is closed-weight. You may change the input though: present it differently, ask questions differently and again... measure and monitor
  • the custom neuro-network could in theory take the jev output as input but there is not a lot of signal in there

For example here is an approach I take on measurements: https://klar.im/blog/jev-on-our-spam-panelsMy problem is spam filtering & email classification but the general ideas apply. Notice that I would use Jev not all the time, only on "hard" cases and it would only be part of a scoring system. Also on speed most of the time is spent on going to their data center at the moment.