Layer 1 · Chapter 3

How AI Applications Are Built

AI ApplicationsBook sectionVersion 0.3

A production AI application is a system, not a single prompt. Its architecture usually contains several layers.

Core components

  1. User experience: the screen, conversation, voice interface, or embedded workflow.
  2. Application logic: rules governing what happens, in what order, and under what conditions.
  3. AI model: a general model, specialized model, ensemble, or locally deployed model.
  4. Context and data: documents, databases, user history, sensor data, and retrieved knowledge.
  5. Tools and integrations: email, calendars, enterprise software, search, payments, code execution, and devices.
  6. Evaluation and safeguards: tests, permissions, monitoring, validation, and escalation.

Common technical patterns

Retrieval-augmented generation supplies relevant documents. Tool use allows the system to act. Structured outputs make results machine-readable. Human review handles exceptions. Smaller models may perform routine classification while larger models handle difficult reasoning.

Why integration matters

Customers rarely want a separate AI destination for every task. Strong applications often enter an existing workflow and reduce steps rather than creating a new place to work.