Dialogue Systems

A dialogue system —also called a conversational agent— is a program that can converse with people in natural language, whether in writing or by voice. Its aim is not merely to answer an isolated question but to sustain an exchange: to interpret what the user says, remember what came before, and produce a fitting reply at every turn.

These systems are one of the most visible applications of natural language processing (NLP) and a common form of interaction-focused AI agents. They are best understood through their purpose, their internal architecture, and their history.

Task-oriented or open-domain

The literature —such as the standard textbook Speech and Language Processing, by Daniel Jurafsky and James H. Martin— draws two broad families. Task-oriented systems pursue a specific, bounded goal: booking a flight, checking an order, resolving a customer-service request. They operate over a limited domain and are judged by whether the task gets done. Open-domain or chit-chat systems chase no closed goal: they talk about almost anything and are judged by the fluency and coherence of the exchange. Many real assistants blend both registers.

The classic pipeline: NLU, manager, NLG

For decades the dominant design was a pipeline of chained modules. First, natural language understanding (NLU) parses the user's turn to extract intent and the relevant entities (dates, cities, figures). Next, the dialogue manager tracks the state of the conversation —what is known and what is still missing— and applies a policy that decides the next move. Finally, natural language generation (NLG) turns that decision into a natural sentence. In voice systems this core is wrapped between speech recognition at the input and speech synthesis at the output. Rule-based approaches gave way to statistical ones, which learned those decisions from data.

From ELIZA to voice assistants and the LLM turn

The story begins in 1966 with ELIZA, built by Joseph Weizenbaum at MIT: a rule-based, pattern-matching program whose DOCTOR script imitated a psychotherapist and led many users to believe they were talking to a real person. From there the field moved to commercial voice assistants such as Apple's Siri and Amazon's Alexa, and to statistical dialogue systems. The most recent turn came with large language models: since ChatGPT (OpenAI, 2022), the field has converged on end-to-end neural systems —highly fluent and open-domain— that learn to converse directly from vast text corpora.

That leap is far from solving everything. Well-documented limits remain: hallucinations (false claims stated with confidence), the difficulty of holding coherence and memory across long conversations, and reliability when carrying a concrete task through from start to finish. This is why many real deployments pair model fluency with external controls.