Can someone explain why RSI is that critical? At best it is replacing a few 1000 engineers. So what? More than RSI I’m interested in whether there exists a ceiling in intelligence. My intuition says that because we live in a human world with human data, there’s a tendency for AI to be at human scale of intelligence. For example I see context window of 1 million which is suspiciously similar OOM to our own. Why not 1000 million??

the crucial point therefore should be whether our techniques can scale intelligence beyond the scale of humans while being constrained to human level data and techniques.