We are finally beginning to understand how LLMs work: No, they don't simply predict word after word

[Aki992]

The constant improvements AI companies have been making to their models might lead you to think we've finally figured out how large language models (LLMs) work. But nope – LLMs continue to be one of the least understood mass-market technologies ever. But Anthropic is attempting to change that with a new technique called circuit tracing, which has helped the company map out some of the inner workings of its Claude 3.5 Haiku model

https://www.techspot.com/news/10734...and-how-llms-work-no-they.html#commentsOffset