XiaoZhi AI (xiaozhi-esp32) · ESP32 LLM voice-chat firmware that can drive desktop robot bodies
ESP32 LLM voice-chat firmware that can drive desktop robot bodies · Xiage (78/xiaozhi-esp32) open-source project · Depends on the board: a microphone is requir…
- Maker
- Xiage (78/xiaozhi-esp32) open-source project
- Form
- ESP32 LLM voice-chat firmware that can drive desktop robot bodies
- For
- Makers, AI-hardware beginners and educators
- Sensors
- Depends on the board: a microphone is required, OLED/LCD shows expressions, some boards add camera input (README)
- Connectivity and app
- Connects to the official xiaozhi.me server by default (WebSocket or MQTT+UDP) or a self-hosted third-party server; offline wake word via ESP‑SR; Wi‑Fi, Ethernet, USB RNDIS or Cat.1 4G (README)
- Subscription
- The README says registered personal users can use the Qwen realtime model free; paid tiers are not described
- Openness
- MIT licence allowing free use, modification and commercial use (README); on-device MCP controls volume, lights, motors and GPIO
- Privacy
- Speech goes to the xiaozhi.me cloud by default; a self-hosted server keeps processing on your own network.
- Not stated
- Who operates xiaozhi.me, paid plans, data retention
Vendor claims
- Multi-device control over MCP
- Offline wake word, voiceprint recognition and full-duplex chat on hardware with AEC
- The README lists 138 board directories and 171 firmware variants, including StackChan, Otto and ElectronBot robot boards
Parts
- ESP32-C3 · Main SoC running voice interaction firmware
- ESP32-C5 · Main SoC running voice interaction firmware
- ESP32-C6 · Main SoC running voice interaction firmware
- ESP32-P4 · Main SoC running voice interaction firmware
- ESP32-S3 · Main SoC running voice interaction firmware
- ESP32-S3-PICO-1-N8R8 · Main module integrating flash, PSRAM, and wireless
- HX6538 · AI chip for image and vector data processing
- EC801E · Provides Cat.1 4G cellular connectivity
- ML307 · Provides Cat.1 4G cellular connectivity
- NT26 · Provides Cat.1 4G cellular connectivity
- ES8311 · 24-bit audio codec processing I2S audio
- MSM381A3729H9BPC · Digital MEMS microphone for voice capture
- NS4150B · Class-D amplifier for the 1 W, 8 ohm speaker
- GC9107 · Drives the 128 x 128 color IPS display
- BMI270 · Six-axis accelerometer and gyroscope
- BMM150 · Three-axis magnetometer measuring magnetic-field orientation
- CoreS3 · Core control board running XiaoZhi voice firmware
- ESP32-S3 Development Board · Development board for XiaoZhi voice assistant
- ESP32-S3-BOX-3 · XiaoZhi voice interaction development board
- ESP32-S3-Touch-AMOLED-1.8 · Touch AMOLED XiaoZhi voice development board
Sources
- github.com/78/xiaozhi-esp32
- github.com/78/xiaozhi-esp32/blob/main/README_zh.md
- github.com/78/xiaozhi-esp32/releases
- github.com/78/xiaozhi-esp32/blob/main/main/boards/otto-robot/README.md
- github.com/78/xiaozhi-esp32/blob/main/main/boards/electron-bot/README.md
- shop.m5stack.com/products/atoms3r-ai-chatbot-kit-8mb-psram
- seeedstudio.com/SenseCAP-Watcher-XIAOZHI-EN-p-6532.html
- docs.espressif.com/projects/esp-dev-kits/en/latest/esp32s3/esp-vocat/index.html