pancomplex confirms limitation and suggests hybrid approach
4Yesterday 4:44 PM · 20h ago · 3 comments · 1 source · development 4 of 6
The author acknowledged the model's reasoning shortcomings, noting that combining Jev with a smarter reasoning model for strategic thinking would be better than using Jev alone, which 'sometimes can be kinda dumb.'
“a mix of models like Jev for simple stuff + a smarter reasoning model for more strategic thinking is the optimal solution. This experiment however is purely Jev. Which sometimes can be kinda dumb.”
pancomplex
pancomplexDeveloper, project authorJevSmall language model
The whole story articlespostscommentsthe bright band is this development · numbered dots are the others · click one to jump
The exact message I sent my friend this morning:> the most interesting thing about this jev stuff> is that people are seemingly like> completely disinterested in how smart it actually is> I haven't even heard it mentioned a single time how it actually compares to other LLMs coming up with their own classifications. Just: it's fast and cheapAfter…
This entire conversation around Jev seems weird to me. Like... we started from neural nets that could do basic decision making and classifications pretty well, then trained larger and larger language models to get to where we are now. Now suddenly everyone is going crazy because someone trained a smaller model that is adequate at making decisions?…
Like others have mentioned in this post, I think a mix of models like Jev for simple stuff + a smarter reasoning model for more strategic thinking is the optimal solution. This experiment however is purely Jev. Which sometimes can be kinda dumb.