LLM Cognition Loop

Inside view, sequential

LLM Cognition Loop Inside view, sequential LLM · Architecture component LLM Cognition · Architecture component Cognition Architecture · Architecture component Architecture Limitations · Architecture component Limitations Sequential · Architecture component Sequential loop deliver Legend Backend Security

The loop

  • • One token at a time, no parallelism
  • • Limits shape the architecture