Yann LeCun on AGI and AI Safety
By Chris Leong @ 2023-08-08T23:43 (+23)
This is a linkpost to https://drive.google.com/file/d/1wzHohvoSgKGZvzOWqZybjm4M4veKR6t3/view
This is a crosspost, probably from LessWrong. Try viewing it there.
nullAbby Hoskin @ 2023-08-09T13:26 (+3)
Thanks for sharing this! Good points here too:
I find it interesting how he says that there is no such thing as AGI, but acknowledges that machines will "eventually surpass human intelligence in all domains where humans are intelligent" as that would meet most people's definition of AGI.
I also observe that he has framed his responses to safety on "How to solve the alignment problem?". I think this is important. It suggests that even people who think aligning AGI will be easy have started to think a bit more about this problem and I see this as a victory in and of itself.
I've been pretty confused by LeCun. I think he has seen AI do useful things to manage misinformation at Facebook so he's annoyed when people claim the risk model from AI is misinformation generation, which is fair. But then he suffers from a massive failure in imagination when it comes to every other risk model.
He seems to think: "We don't have to worry about alignment, because we align humans to be nice moral people and governments to be good via laws!" But this is just obviously silly: look at how many people hurt other people and how many governments have awful laws (that people break all the time anyway)! Not sure what's not clicking with him when his own analogies fall apart with 1 second of reflection.
Geoffrey Miller @ 2023-08-09T21:47 (+2)
I'm truly, deeply baffled by Yann LeCun's bizarre pronouncements about AI safety.
He talks about AI safety and alignment issues as if he's simply too stupid to understand the 'AI Doomer' concerns (including those shared by most EAs.) But he's clearly not stupid in terms of general intelligence -- his machine learning work has been cited over 300,000 times, with an h-index of 143 (which is very, very high).
So, is this just motivated reasoning by someone with very deep professional and financial incentives to promote AI capabilities research? His position as a Vice President, and Chief AI Scientist at Meta, suggests that he might have too much 'skin in the AI game' to be very critical. And yet, many other leading AI researchers and AI company CEOs have expressed serious concerns about AI extinction risk -- despite their skin in the game.
Anybody have any insights into why LeCun is so dismissive about AI X risk?
Yanni Kyriacos @ 2023-08-10T00:47 (+2)
Isn't it the case that lots (in raw numbers, not %) of smart people believe irrational things (e.g. religion, health, climate, politics) all the time? When you consider the size of the AI field, there was going to be at least one LeCun right?
Geoffrey Miller @ 2023-08-10T15:31 (+5)
Yeah, fair point. But most such irrational beliefs tend to be somewhat outside smart people's fields of personal expertise. And smart people tend to update if they're exposed to a lot of skeptical feedback -- which LeCun has been, on Twitter. Yet he's dug in his heels, and become even more anti-safety in recent months.
Maybe in the grand scheme his personal views don't matter much. But to a psychologist like me, his behavior is both baffling and chilling.