Memes

Even if Deepseek didn't explicitly train on ChatGPT output, there's so much of it pasted across the internet that just by scraping the web, Deepseek would've already faced that issue.

This distilling capability is super powerful. If any cutting-edge model can simply be distilled, there is literally no moat around AI. If OpenAI comes out with GPT-infinity, in a few months everyone else will just distill out an equivalent model. That means AI costs (and profits!) should drop to zero over time due to competition.

This matches both Jeremy Rifkin's concept of zero marginal cost, and Marx's predictions of the falling rate of profit.