Does the 50-cent jailbreak settle it?

Question

Researchers stripped the safety guardrails off a downloadable model in about five minutes, for fifty cents of computer time. Once the weights are public, every safeguard is a suggestion. The counterpoint: a RAND red-team found chatbots gave would-be bioweapon builders nothing they couldn't already find on the open internet.

Accepted Answer

This is the strongest card the vault side holds: open weights are forever, and un-releasing is impossible. 47% of voters oppose open-sourcing powerful models; 23% support it. The rest are where you might be right now — split between the locksmith and the burglar. (47% of Americans answer "Lock it down" — AIPI/YouGov, 2023)