Observers pinpoint training pipeline, not architecture, as real moat
7Sep 25 7:44 PM · 1d ago · 6 comments · 1 source · development 7 of 9
Commenters argue that the RL synthetic data pipeline and training methodology—not the model architecture—represents the defensible innovation, and that open-sourcing those would be the true competitive threat.
github.com
“The moat is the RL synthetic data pipeline they set up to train jev. Open sourcing that would be the coup, not the model architecture and training scripts, which are trivial.”
I think the idea of a "feature startup" is dead. What used to be a niche subscription business is now an individual Epic level of work. The smallest viable business becomes what two or three years ago was a mid tier enterprise. It is no longer "look at this tool I maintain", but "we take this specific approach using these hundreds of tools merged…
Today we might need to evaluate “innovation” in a new standard, and have a different expectation for what innovator would be awarded. Getting public attention in such an era where innovation happens every a few days could’ve already been something precious. And that attention would allow TypeSafe to be heard easily next time. Like OpenAI…
For everyone dismissing Jev's innovation as being trivial, no it's not.It is definitely not the MNIST classifier you had trained in 2019.The difference is that you only train it once and the modern LLM machinery sort of takes care of that with large contexts.It's great that Jev proved this is a viable product. I'd expect a great many research…
It's hard to keep up with the pace of everything but looking at this site it seems like the Ollama people launched it? Or are they just purposely imitating everything about Ollama. Seems pretty infringey.
The moat is the RL synthetic data pipeline they set up to train jev. Open sourcing that would be the coup, not the model architecture and training scripts, which are trivial.