- Leo's Lightbulbs
- Posts
- ChatGPT is going to allow "adult conversations", what could possibly go wrong?
ChatGPT is going to allow "adult conversations", what could possibly go wrong?
ChatGPT is going to allow “Adult conversations” for 18+
This isn’t just a feature
It’s a risk multiplier
Age gates are porous
VPNs and borrowed IDs exist
Consent becomes theater
A model can simulate desire - it cannot consent
Records last forever
Chats leak
Accounts get hacked
Subpoenas happen
Sextortion surface area explodes
Scammers already use AI to groom and coerce
Escalation loops are real
Systems that adapt to kinks can nudge people into riskier behavior over time
Parasocial dependency deepens
Paywalled “intimacy” preys on loneliness
Creator exploitation accelerates
Deepfakes plus chat personalization equals weaponized impersonation
Compliance landmines everywhere
What’s permitted in one jurisdiction is a felony in another
“Safety by prompt” is brittle
Jailbreaks and prompt injection still bypass filters
And enterprise spillover is inevitable
NSFW chats on work accounts become a brand liability overnight
Before anyone ships this at scale - here are the bare minimums
Verified age - not a checkbox
Hard opt-in with clear, reversible controls
Strict data minimization - zero or very short retention
Guaranteed “do not train” for NSFW chats
End-to-end protection in transit and at rest
Independent audits and red-team reports published
Real abuse reporting with fast off-ramps and a kill switch
Minors-appearing content detection with human escalation
Enterprise-wide disable toggles and logs for admins
Clear economics that do not monetize intensity or frequency of sexual engagement
I’m pro innovation
I’m anti negligence
If we normalize AI sexting without guardrails
The bill will come due
What would you add - or draw the line on - before “adult conversations” go live?











Reply