> It's that we can never allow this technology to advance outside of trusted labs.
Impossible. In 10 years you'll be able to train today's models for ~$10M from Moore's law and training innovation. In 20 years it'll be ~$200k. The genie won't go back in the bottle.
100%. American capitalism is broken. So far that illness has given us Trump. So bad, but apparently not a catastrophe (yet). I wonder what comes next (assuming we don't fix it)..
As compute prices fall it gets easier and easier to make "frontier" models. So it's inevitable that commodity, open source models of equivalent capacity to today's "frontier" models will be available to the public. Remember this is just weights, anyone can download them and run it whenever they like. The only constraint is compute.
Plenty of contracts end up being unenforceable.If people think they have a strong case for breaking a contract, they are welcome to do so and see if a judge or jury agrees.
I think it’s laughable to think OpenAI has some special sauce that can’t be replicated easily. They simply have asymmetric access to compute and the dollars to power it. Thats the only moat here.
OpenAI doesn’t even know how their model works. Nobody knows how LLMs work. So it’s not like it’s technically difficult to replicate, just costly.
Obviously lab just means company. They use it because it confuses the public into thinking they are doing research primarily. Which of course is nonsense.
Impossible. In 10 years you'll be able to train today's models for ~$10M from Moore's law and training innovation. In 20 years it'll be ~$200k. The genie won't go back in the bottle.
reply