(1) First Up, Some Media I’ve Done Recently Be sure to check these out for more of my thoughts on AI consciousness, intelligence, and more! (2) A Podcast On AGI I really loved listening to this podcast episode. It’s one where three different thinkers on the effects of AGI are interviewed, all with very different opinions on it. I wanted to link the podcast episode, but it wasn’t working (YouTube below) If you google ‘The AI Skeptics episode on the Longview podcast’ it should pop up pretty easily. For what its worth, I lean towards Arvind Narayanan’s views, though also appreciate Marcus’ point that if we stop spending so much time on LLMs and invent other kinds of technologies, things in the AI space could change and we need to be honest about that. Ed Zitron’s opinions on Hinton are off base imo. I think Hinton does genuinely believe in AI taking over and I suspect it’s rooted in his beliefs about brains. See here for my thinking on this. (3) Situational Awareness by Leopold Aschenbrenner I’ve been reading the AI manifesto situational awareness by Leopold Aschenbrenner. This was written in June 2024 and we know a lot has happened since then. Nevertheless, this text is foundational to AGI discourse, and reads as a fascinating sociological analysis to me, more than anything else. The Manifesto is a lengthy discussion of Aschenbrenner’s predictions about the coming of AGI in 2027 (or thereabouts). The argument is that algorithmic progress (i.e., less data and less compute solving the same amount of problems), unhobbling (i.e., removing certain practical constraints from AI to allow their full scope of intelligence) and AIs reaching something like human level intelligence, will bring about an explosion in super-intelligence. It backs up the economic and logistical costs required for such an explosion using historical examples (e.g., that during WW2 countries borrowed more GDP-equivalent than would be necessary for AI investment for the coming of AGI) and addresses a...