AGI predictions for 2024. The major LLM players, as well as | by Paul Pallaghy, PhD | Dec, 2023 – Medium

2 min read

The major LLM players, as well as third-party developers using LLM APIs, will get us to genuinely AGI-ish levels during 2024.

Depending on your definition of AGI, artificial general intelligence.

Multimodal (visual etc) AI will be part of it, but the NLU (natural language understanding) provided by LLMs will be and always was the key to AGI.

NLU is not just about content creation. NLU is actually bottled intelligence. When you solve NLU, you get intelligence as part of that. How else can the LLM write sensibly if its not intelligent? Even during 2023 the most interesting use of LLMs was in intelligent decision making, not content generation.

To be useful, AGI need not be sentient, super intelligent or even necessarily multi-modal.

Thats why its close.

Early AGI will be quite simple.

The key step required by a minimal AGI is simply resilient independence in not entirely controlled environments, whether cyber or real world.

It neednt pass every test either. Engineering is iterative. Even though the aim of AGI is in principle complete independence, well initially be happy to see AGIs that can solve some of the problems of unconstrained environments.

AGI does indeed need long and short term memory and goal creation and task facilitation skills.

None of these capabilities are anything as difficult to add to an LLM as the 70 year grand challenge that LLMs already solved, namely shockingly good NLU.

The addition of short and long term memory is being attacked from multiple angles: increased prompt sizes and RAG (retrieval augmented generation) for example.

And LLMs, with the right app flow, are ready for decision making roles important for resilience or for goal creation and task facilitation.

What well see during 2024 is a plethora of AGI-ish apps operating in the cyber world in text and multimodal form factors.

And then in bots and androids including Teslas Optimus project from mid-2024.

Most of these early attempts will be prescriptively designed, iterative ad hoc solutions to mimic human-like behaviour.

Continued here:

AGI predictions for 2024. The major LLM players, as well as | by Paul Pallaghy, PhD | Dec, 2023 - Medium