alignment problem

The problem of how to create a superintelligent artificial intelligence whose values would align with the interests of humankind.

Proper noun

  1. The problem of how to create a superintelligent artificial intelligence whose values would align with the interests of humankind.
    • As [Brian] Christian notes, the alignment problem bears a real resemblance to parenting: “The story of human civilization has always been about how to instill values in strange, alien, human-level intelligences who will...
    • Properly defining and solving the alignment problem won’t be easy; it will require us to develop a broad, scientifically based theory of intelligence. - 2022 December 13, Melanie Mitchell, “What Does It Mean to Align AI...
    • For years, AI ethicists have worried about this so-called alignment problem. In short: How do we ensure that the AI we build, which might very well be significantly smarter than any person who has ever lived, is aligned...

Origin

Popularized by the 2020 book The Alignment Problem by Brian Christian.