Discussion
Strange Loop Canon
ogogmad: The recent news of multiple solutions to Erdos problem 1196 produced by LLMs without any human help, makes any suggestion that LLMs have hit a wall in reasoning seem less credible. To give you an idea, problem 1196 had been worked on by different experts for years. Perhaps LLMs will eventually stall, but this paradigm still has some juice left to squeeze.
throwaway210426: Needs a “[November 2025]” title. It is already outdated
suddenlybananas: Why?
throwaway210426: It was silly at the time but even sillier now (eg see other comment on Erdos 1196)
DarkNova6: But are we talking pure LLMs, or existing AI solvers augmented with LLMs? Because while the latter is impressive, it doesn't state much outside of this specific domain.If anything, I see greater verticality of specialized software that is using LLMs at their core, but with much aid and technology around it to really make the most out of it.
FrustratedMonky: "are we talking pure LLMs, or existing AI solvers augmented with LLM"Why do these distinctions matter?is it an LLM, or symbolic, or a combo, or a dozen technologies stitched together. Who cares. It is all automation. It is all artificial.
OutOfHere: The force equation example is disturbing, but it's easy to prevent by disallowing the inclusion of random decimal numbers in the formula, also signaling over-fitting to the data. It is immediately obvious that such numbers make the equation inelegant and therefore likely to be wrong. If you're going to use symbolic construction, be careful in what formulations you allow, also having an appropriate penalty for complexity.