Alignment
Thesis: Digital abstraction simplifies coordination by dramatically reducing the complexity of verifiability and enforcement. It is primarily the progress of computation, not game theory, that fuels modern progress in coordination. Since AI happens to be digitally abstracted, it will enable a further revolution in coordination technology.
Suppose we want to cooperate in order to avoid some kind of prisoner’s-dilemma-esque tragedy of the commons. A normal pattern here is to agree to cooperate optimistically, and also punish anyone who doesn’t cooperate.
How intelligence helps (and hurts) alignment
Mar 5, 2023
An initial reaction to AI alignment concerns.