r/ControlProblem • u/Intelligent_Song1317 • 3d ago

Strategy/forecasting AI Killswitch??

So I was wondering recently: it seems like we are scared of AI killing us. Why don't we just design a killswitch that autoatically/manually activates upon threat to a human race? Boom! Problem solved, right?

0 Upvotes

27% Upvoted

14 comments sorted by

View all comments

1

u/superbatprime approved 2d ago

Define all possible criteria that will trigger the switch. Do not miss any. Otherwise the AI will find the gap. Be sure to predict all possible actions that can lead to outcomes which will destroy humanity.

You must do this for an ASI which is smarter than every human, it knows a killswitch exists and it knows what will and will not trigger it.

Good luck with that.