Bill Thompson, UC Berkeley: How cultural evolution shapes knowledge acquisition

Imbue
Mar 29, 2023

Bill Thompson is a cognitive scientist and assistant professor at UC Berkeley. He runs an experimental cognition laboratory where he and his students conduct research on human language and cognition using large-scale behavioral experiments, computational modeling, and machine learning. In this episode, we explore the impact of cultural evolution on human knowledge acquisition, how pure biological evolution can lead to slow adaptation and overfitting, and much more.

Below are some highlights from our conversation as well as links to the papers, people, and groups referenced in the episode.

Highlights

“In order to understand the computational processes that give rise to things like complex learned algorithmic behaviors like driving or playing chess or solving a Rubik’s cube or even language and speaking to each other, we need to have some way of reasoning about how knowledge accumulates across people.”
“This mechanism that we call selective social learning provides a solution to those two problems. The problem is that complex stuff is difficult to discover and difficult to pass on, so it increases the fraction of people who are exposed to the rarer discoveries.”
“One of the things we’ve been working on is trying to integrate those two things and develop a way of thinking about cultural evolution as distributed algorithmic processes or distributed computation. Thinking about population-level processes as distributed computational processes gives you a way of viewing groups and multi-generational societies — in a sense, simple societies — in the same terms that you can think about learning by individuals.”
“If I want to look at how large language models learn to reason, something I would love to do is start to knock out parts of the training data set and say, ‘okay, when you knock this part of training data set out, suddenly the reasoning capabilities go away,’ or 'suddenly this aspect of your knowledge or this capacity to acquire structured algorithmic thinking disappears.’ Even just simple stuff like that is not tractable at the moment.”

References

How Learning Can Guide Evolution by Geoffrey E. Hinton & Steven J. Nowlan
Computational Cognitive Science Laboratory
The pupillary light response as a physiological index of aphantasia, sensory and phenomenological imagery strength by Lachlan Kay, Rebecca Keog, Thomas Andrillon, Joel Pearson

Thanks to Tessa Hall for editing the podcast.

About Imbue
Imbue is an independent research company developing a better way to build personal software. Our mission is to empower humans in the age of AI by creating computing tools controlled by individuals.

Website: https://imbue.com/
LinkedIn: https://www.linkedin.com/company/imbue_ai/
Twitter/X: @imbue_ai
Bluesky: https://bsky.app/profile/imbue-ai.bsky.social
YouTube: https://www.youtube.com/@imbue_ai/