nothing is mere

Monthly Archives: September, 2013

The seed is not the superintelligence

This is the conclusion of a LessWrong post, following The AI Knows, But Doesn’t Care. If an artificial intelligence is smart enough to be dangerous to people, we’d intuitively expect it to be smart enough to know how to make itself safe for people. But that doesn’t mean all smart AIs are safe. To turn that capacity into …

Continue reading

The AI knows, but doesn’t care

This is the first half of a LessWrong post. For background material, see A Non-Technical Introduction to AI Risk and Truly Part of You. I summon a superintelligence, calling out: ‘I wish for my values to be fulfilled!’ The results fall short of pleasant. Gnashing my teeth in a heap of ashes, I wail: Is …

Continue reading