Skip to content

NPC Dialogue Generation

Text, Narrative & Design

Open Source

  • AE

    Agent Ecologies Discovered by AI

    2026

    A multi-agent operating system designed for LLM-powered non-player characters that exist autonomously in a persistent 2D environment. Built on the Model Context Protocol (MCP), it orchestrates interactions between multiple LLMs to create characters with memory, purpose, and dynamic dialogue.

    mcp multi-agent npc simulation

    GitHub

  • DR

    DropSmith Discovered by AI

    2026

    An open-source Model Context Protocol (MCP) server designed for structured NPC dialogue generation. It allows game developers and modders to generate game-ready dialogue with emotion tags, archetypes, and personality traits using local LLMs.

    dialogue mcp npc ollama

    GitHub

  • EA

    Environment-Aware NPC Dialogue Discovered by AI

    2026

    A system that enhances NPC dialogue by combining LLMs with computer vision, using panoramic images and semantic segmentation to give characters spatial and environmental awareness of their surroundings.

    context-aware dialogue npc vision-llm

    GitHub · arXiv · Paper

  • EV

    EvolvingWorld Discovered by AI

    2026

    An open-schema framework and benchmark for character and world co-evolution in interactive literary simulations, allowing characters and world states to evolve together over time.

    agent framework simulation world-model

    GitHub · arXiv

  • LL

    Long-Lived Characters, Local Inference: Incremental Memory Maintenance for Game NPCs Discovered by AI

    2026

    Addresses the challenge of memory maintenance for locally deployed LLM-based game NPCs by proposing an incremental memory maintenance system that avoids rereading the entire history before every conversation.

    dialogue llm memory npc

    arXiv · Paper

  • PP

    Persona-Pruner Discovered by AI

    2026

    A framework for sculpting lightweight, persona-specific language models from larger generalist models. It reduces computational costs and latency, making it highly suitable for deploying multiple distinct NPC personalities simultaneously on consumer hardware.

    dialogue npc persona pruning

    GitHub · arXiv

  • DF

    Deflanderization for Game Dialogue: Balancing Character Authenticity with Task Execution in LLM-based NPCs Discovered by AI

    2025

    This paper addresses the "flanderization" problem in LLM-based NPCs, where characters over-exaggerate their traits and become caricatures. It proposes a method to balance character authenticity and persona consistency with functional task execution in game dialogue.

    dialogue flanderization npc persona

    arXiv · Paper

  • ET

    Efficient Tool-Calling Multi-Expert NPC Agent for Commonsense Persona-Grounded Dialogue Discovered by AI

    2025

    Presents a multi-expert NPC dialogue system using Qwen3 and LoRA adapters to instantiate three specialized agents: tool calling, tool-response interpretation, and direct dialogue. Designed for the Commonsense Persona-Grounded Dialogue Challenge (CPDC) 2025, it balances character consistency with functional task execution under strict latency constraints.

    dialogue llm multi-agent tool-calling

    arXiv · Paper

  • FP

    Fixed-Persona SLMs with Modular Memory Discovered by AI

    2025

    A modular NPC dialogue system that leverages Small Language Models (SLMs) fine-tuned to encode specific NPC personas and integrated with runtime-swappable memory modules for scalable, low-latency interactions.

    dialogue memory npc slm

    arXiv

  • GE

    Gemma3NPC Discovered by AI

    2025

    An open-source project featuring fine-tuned Gemma models (such as Gemma 3 and Gemma 4) optimized specifically for live NPC interactions, quest generation, and roleplaying in video games.

    dialogue gemma npc roleplay

    GitHub · Hugging Face

  • IA

    Interactive AI NPCs Powered by LLMs: Technical Report for the CPDC Challenge 2025 Discovered by AI

    2025

    A technical report presenting a framework for game NPCs that balances task-oriented tool calling with context-aware, persona-consistent dialogue. It introduces context engineering techniques like dynamic tool pruning and persona clipping to optimize LLM inputs for real-time game environments.

    dialogue npc persona tool-calling

    arXiv · Paper

  • LD

    LLM-Driven NPCs: Cross-Platform Dialogue System for Games and Social Platforms Discovered by AI

    2025

    A prototype system that enables LLM-powered NPCs to communicate with players across both game environments (Unity) and social platforms (Discord). It stores dialogue logs in a cloud database to maintain character consistency and state across different platforms.

    cross-platform dialogue npc unity

    arXiv · Paper

  • OP

    OpenCharacter Discovered by AI

    2025

    A framework and large-scale synthetic dataset designed to train customizable role-playing LLMs, enabling character generalization and cost-efficient deployment of dialogue agents.

    dataset llm persona roleplay

    arXiv · Hugging Face

  • RA

    RenPy-AutoScriptPlugin Discovered by AI

    2025

    An open-source plugin for the Ren'Py visual novel engine that automates game dialogue and narrative generation using ChatGPT. It integrates story instructions, character attributes, and end conditions to create dynamic, interactive text-based games.

    chatgpt dialogue renpy visual-novel

    GitHub

  • SI

    State-Inference-Based Prompting for Natural Language Trading with Game NPCs Discovered by AI

    2025

    Proposes State-Inference-Based Prompting (SIBP) to enable game NPCs to engage in natural language trading of items and currency with players. The framework prevents common LLM issues like item hallucination and calculation errors by strictly adhering to game state rules.

    dialogue llm prompting trading

    arXiv · Paper

  • SS

    Symbolically Scaffolded Play: Designing Role-Sensitive Prompts for Generative NPC Dialogue Discovered by AI

    2025

    Investigates the impact of prompt constraints on generative NPC dialogue using a voice-based detective game, proposing "Symbolically Scaffolded Play" to balance narrative stability and improvisational believability.

    dialogue llm npc prompt-engineering

    arXiv

  • AS

    A Survey on Large Language Model-Based Game Agents Discovered by AI

    2024

    A comprehensive survey reviewing the state-of-the-art in large language model-based game agents (LLMGAs). It covers key aspects such as agent architecture, cognitive capabilities, memory systems, and their application to dynamic NPC dialogue and behavior generation.

    dialogue llm-agent npc survey

    arXiv · Paper

  • GI

    Gigax Discovered by AI

    2024

    An open-source runtime and set of open-weights models fine-tuned from Llama-3, Phi-3, and Mistral, designed for local, low-latency LLM-powered NPCs that can speak and execute in-game actions.

    dialogue local-llm npc runtime

    GitHub

  • LL

    LLMUnity Discovered by AI

    2024

    An open-source Unity package that enables developers to integrate Large Language Models (LLMs) locally or via APIs to power interactive, dynamic NPC dialogue and behaviors.

    dialogue llm npc unity

    GitHub

  • MA

    MCPDial: A Minecraft Persona-driven Dialogue Dataset Discovered by AI

    2024

    A framework and dataset utilizing LLMs to generate persona-driven, contextually consistent dialogue between players and non-player characters in Minecraft.

    dialogue llm minecraft npc

    arXiv · Paper

  • SO

    Soul of Waifu Discovered by AI

    2024

    An offline, uncensored desktop engine for AI roleplay and character companionship. It supports local LLMs, Live2D/VRM avatar integration, voice chat, and long-term memory to bring stylized anime characters to life with emotional depth.

    dialogue live2d npc roleplay

    GitHub

  • SO

    SoulX Discovered by AI

    2024

    An open-source, role-conditioned, and memory-aware language model and protocol designed to generate in-character NPC dialogues and actions in dynamic game worlds, operating as a decentralized Bittensor subnet.

    bittensor dialogue llm npc

    GitHub

  • UN

    UnrealGenAISupport Discovered by AI

    2024

    An Unreal Engine plugin that integrates various LLMs, generative AI models, and Model Context Protocol (MCP) servers to enable agentic NPC dialogue, text-to-speech, and multimodal interactions.

    dialogue llm npc unreal-engine

    GitHub

  • AT

    AI Town Discovered by AI

    2023

    An open-source, deployable starter kit for building and customizing virtual towns where AI characters live, chat, and socialize. It provides a framework for managing persistent state, multi-agent interactions, and LLM-driven NPC dialogue.

    dialogue multi-agent npc starter-kit

    GitHub

  • GA

    Generative Agents Discovered by AI

    2023

    A seminal paper and framework introducing computational software agents that simulate believable human behavior, memory, and dynamic social interactions in a sandbox environment.

    agents dialogue npc simulation

    GitHub · arXiv

  • LL

    LLaMA

    2023

    A family of open foundation language models commonly fine-tuned for NPC dialogue, narrative drafting, and in-game text systems.

    llm open-weights

    GitHub · arXiv

  • MA

    Mantella Discovered by AI

    2023

    An open-source framework and mod for Skyrim and Fallout 4 that enables players to naturally converse with NPCs using a pipeline of Speech-to-Text, LLMs, and Text-to-Speech.

    dialogue mod npc skyrim

    GitHub

  • RI

    RisuAI Discovered by AI

    2023

    A feature-rich, cross-platform open-source frontend for LLM-based roleplaying and character interaction. It supports multiple API backends, custom regex functions, and interactive assets to create immersive, highly customizable dialogue experiences.

    dialogue frontend npc roleplay

    GitHub

  • SI

    SillyTavern Discovered by AI

    2023

    A highly customizable, open-source frontend for power users to interact with LLM-based characters and NPCs. It supports advanced features such as character cards, world info (lorebooks), expression images, and group chats, making it a popular tool for prototyping game dialogue.

    dialogue frontend llm roleplay

    GitHub

  • KN

    KNUDGE Discovered by AI

    2022

    A benchmark dataset and task (Knowledge Constrained User-NPC Dialogue Generation) constructed from side quest dialogues in Obsidian Entertainment's The Outer Worlds. It evaluates the ability of language models to generate branching dialogue trees that are ontologically faithful to quest specifications and game lore.

    benchmark dataset dialogue-tree lore-faithful

    arXiv · Paper

Proprietary / Industry Tools

  • LO

    Loreguard Discovered by AI

    2025

    An AI NPC engine that runs inference on the player's GPU to eliminate server costs. It features a multi-pass verification pipeline that checks every generated response against the game's lore documents using Natural Language Inference (NLI) to prevent hallucinations and maintain world consistency.

    dialogue local-inference nli npc

    Website

  • GL

    GladeCore Discovered by AI

    2024

    An on-device AI NPC solution for Unity and Unreal Engine that provides local, zero-cloud-cost NPC dialogue, speech-to-text, text-to-speech, and emotional tuning.

    dialogue local-llm npc on-device

    Website

  • NA

    NVIDIA ACE (Avatar Cloud Engine) Discovered by AI

    2024

    A suite of real-time generative AI technologies for digital humans and NPCs, providing cloud and on-device AI models for speech, intelligence (using LLMs like Nemotron), and facial animation.

    avatar dialogue digital-human npc

    Website

  • CO

    Convai Discovered by AI

    2023

    A conversational AI platform for virtual worlds and games that enables developers to create intelligent, embodied AI NPCs with real-time perception, dialogue generation, voice, and action execution capabilities.

    agent dialogue npc voice

    Website

  • NA

    NVIDIA ACE Discovered by AI

    2023

    A suite of technologies (Avatar Cloud Engine) that enables developers to bring digital humans and NPCs to life with generative AI. It includes microservices for speech recognition, text-to-speech, facial animation, and LLM-driven dialogue.

    avatar dialogue npc speech

    Website

  • RS

    Replica Studios Smart NPCs Discovered by AI

    2023

    A commercial platform and Unreal Engine plugin that integrates live voice recognition, voice synthesis, and large language models to enable real-time, unscripted conversations with smart NPCs.

    dialogue npc unreal-engine voice-synthesis

    Website

  • CA

    Character.ai Discovered by AI

    2022

    A leading proprietary platform for creating and interacting with personalized AI characters and chatbots. It allows developers and writers to define detailed character personas, backgrounds, and speaking styles, serving as a major reference for dynamic character dialogue.

    chatbot dialogue persona roleplay

    Website

  • IA

    Inworld AI

    A commercial platform for building AI NPCs with persistent memory and unscripted dialogue, integrating with major game engines.

    api commercial memory npc

    Website