Estuary Logo

    Build characters, not backends

    Real-time AI infrastructure for characters that See, Speak, & Remember

    npm install @estuary-ai/sdk
    import { EstuaryClient } from "@estuary-ai/sdk";
    
    const client = new EstuaryClient({
      serverUrl: "https://api.estuary-ai.com",
      apiKey: "est_your_api_key",
      characterId: "your-character-id",
      playerId: "player-1",
    });
    
    client.on("botResponse", (r) => console.log(r.text));
    await client.connect();
    client.sendText("Hello!");
    Start Building

    Building real-time AI characters is hard

    Memory that resets every sessionStitching together STT, LLM, and TTSRebuilding for each platform2 seconds of silence before every responseFaulty interruption handlingCharacters that can't see

    The full stack for characters that feel alive

    Persistent Memory

    Every conversation makes the next one better

    Memory that compounds. Estuary builds a knowledge graph from every interaction. Characters recall what matters across sessions, platforms, and users.

    Sam × Luna

    Character memory graph

    Fact
    Preference
    Relationship
    Event
    Emotion
    Correction
    Character
    Topic
    Entity
    Multi-Character

    Characters that talk to each other

    Deploy multiple characters that share context, riff off each other, and coordinate autonomously.

    Voice Engine

    Voice for characters, not call centers

    Give every character a distinct voice, personality, and provider stack. Ship real-time voice without building the pipeline.

    Per-character voices

    Clone from a sample, pick from a library, or bring your own. Every character deserves a voice that fits.

    Natural interruption

    Turn-taking logic that handles interruption out of the box.

    Swappable provider stack

    Mix STT, LLM, and TTS providers per character. Optimize for cost, latency, or quality.

    Character Creation

    From concept to character in minutes

    Define personality, craft a voice, pick your model stack. One dashboard for everything that makes a character feel real.

    Persona & BackgroundVoice SelectionModel Configuration
    Cross-Platform

    Deploy Everywhere

    Characters follow your users across devices and remember every conversation.

    Estuary
    Mobile
    Web
    Unity
    Smartglasses
    Desktop

    Ready to build something amazing?

    Start Building

    Built with Estuary

    Validated by academia and the builder community.

    Awards & Recognition

    Forget Me Not — XR memory assistant on RayNeo X3 Pro glasses

    MIT Reality Hack 2026 - Best AR Utility (Qualcomm) + 2nd Place XR Health & Wellness Research & Design Track

    Forget Me Not

    Built in 48 hours. A smartglass AI character that remembers a user's life context: names, tasks, routes home and retrieves it through natural conversation. Powered by Estuary's persistent memory and real-time voice pipeline running on RayNeo X3 Pro glasses.

    Learn More
    Paw Pals Connect — co-located AR virtual pets on Apple Vision Pro

    MIT Reality Hack 2025 - Best Use of Apple Vision Pro

    Paw Pals Connect

    Built in 60 hours. Multiple users share a space with AI pets that learn about their owners through conversation, then autonomously connect compatible owners by initiating play sessions with each other. Powered by Estuary's multiuser support and multiagent coordination on Apple Vision Pro.

    Learn More

    Published Research

    User-centered design study from CHI 2025 paper

    ACM Human Factors in Computing Systems (CHI) Case Study 2025

    Optimizing SIA Development: A Case Study in User-Centered Design for Estuary

    Interviews with leading AI agent researchers validated the problem Estuary addresses: teams building AI characters face a choice between patching together generic APIs or building custom infrastructure from scratch. Researchers voiced that platform & deployment agnosticity, persistent memory, and multimodal perception - Estuary's core capabilities - are the most critical unmet needs.

    Read Paper
    Estuary framework architecture diagram from IVA 2024 paper

    ACM Intelligent Virtual Agents (IVA) 2024

    Estuary: A Framework For Building Multimodal Low-Latency Real-Time Socially Interactive Agents

    Introduces Estuary's core architecture: a modular, off-cloud framework for building multimodal AI characters with low-latency real-time interaction. Demonstrates how Estuary's design enables characters to run entirely off-cloud for full data privacy while maintaining real-time response across text, audio, and vision modalities.

    Read Paper