“A Research Agenda for Psychology and AI” by carter allen
EA Forum Podcast (All audio) - A podcast by EA Forum Team
Categories:
I think very few people have thought rigorously about how psychology research could inform the trajectory of AI or humanity's response to it. Despite this, there seem to be many important contributions psychology could make to AI safety. For instance, a few broad paths-to-impact that psychology research might have are: Helping people anticipate the societal response to possible developments in AI. In which areas is public opinion likely to be the bottleneck to greater AI safety? Improving forecasting/prediction techniques more broadly and applying this to forecasts of AI trajectories (the Forecasting Research Institute's Existential Persuasion Tournament is a good example). Describing human values and traits more rigorously to inform AI alignment, or to inform decisions about who to put behind the wheel in an AI takeoff scenario. Doing cognitive/behavioral science on AI models. For instance, developing diagnostic tools that can be used to assess how susceptible an AI decision-maker [...] ---Outline:(02:42) Topic Areas and Project Ideas(02:47) 1. Human-AI Interaction(02:51) 1.1 AI Persuasiveness(05:01) 1.2 Human-AI Capability Differences(05:33) 1.3 Trust in AI(06:20) 2. Forecasting AI Development(06:24) 2.1 Foundational Work on Forecasting(08:42) 2.2 Applying Forecasting Research to AI Safety(10:30) 3. Understanding Human Values(11:14) 3.1 Foundational Work on Human Values(13:24) 3.2 Applying Human Values Research to AI Safety(14:26) 4. Institutional Stability(14:50) 4.1 Arms Race Dynamics(15:46) 4.2 Malevolence and AI(17:26) 4.3 Identifying Ethical Decision-Makers(19:29) 4.4 Miscellaneous(20:33) 5. Anticipating the Societal Response to AI Developments(20:39) 5.1 AI Sentience(21:49) 5.2 Modeling AI takeoff scenarios(22:30) 5.3 Risk Aversion and AI(23:37) 5.4 Post-TAI Wellbeing(24:03) 6. Cognitive Science of AI(24:33) 6.1 Miscellaneous(25:50) 7. Other Topics(25:54) 7.1 Meta-Psychology and AI(26:42) 7.2 Politics(27:41) 7.3 Donation behavior(28:14) 7.4 Miscellaneous(29:01) Additional Resources for People Interested in Psychology and AI:(29:09) Forum Posts(29:33) Fellowships/Programs/Labs(30:27) Acknowledgments--- First published: June 28th, 2024 Source: https://forum.effectivealtruism.org/posts/hLdYZvQxJPSPF9hui/a-research-agenda-for-psychology-and-ai --- Narrated by TYPE III AUDIO.