Marvin Minsky On LLMs
[reading
llm
ai
philosophy
]
2007 Discover Magazine interview with Marvin Minsky “[Reasoning by analogy] is important because the way people solve problems is first by having an enormous amount of commonsense knowledge, like maybe 50 million little anecdotes or entries, and then having some unknown system for finding among those 50 million old stories the 5 or 10 that seem most relevant to the situation. This is reasoning by analogy.”
Schrier notes: This sounds a lot like retrieval augmented generation, avant la lettre