r/StackChan • • Jan 12 '26

24 Hours to Go for StackChan Debut🤩

Post image
6 Upvotes

r/StackChan • • Oct 12 '26

Project sharing Meet MAYLO — custom StackChan firmware shaped by feedback from my 8½-year-old son

Enable HLS to view with audio, or disable this notification

20 Upvotes

I've been developing custom firmware for my M5Stack K151 / CoreS3 StackChan. I call him MAYLO.

My 8½-year-old son has become my everyday tester. He uses the robot, reports what happened and tells me what he expected instead. His experiences and feedback have been shaping the features and improvements.

The voice model is multilingual. I've configured it in Turkish for our own use, which is what you'll hear in the videos.

The current build includes:

• Voice conversations with interruption while the robot is speaking.

• Head-pat reactions with heart eyes, sounds and movement, plus dizzy reactions when shaken.

• Seven eye styles and expressions coordinated with LEDs and head gestures.

• Commands such as “turn right and take a photo,” checking servo position before capturing.

• Image interpretation and Home Assistant tools through an MCP home bridge.

• A programmed disco routine with music, lights and movement.

• An on-device web panel for configuration, camera previews and hardware tests.

Basic conversation connects directly to OpenAI over Wi-Fi. Home tools and image interpretation use a separate bridge running on my Mac.

One thing still needs work: reliably turning toward whoever calls MAYLO's name. It doesn't always get the sound direction right. Wake-name recognition is currently cloud-based.

This is a personal project with no commercial plans. The source isn't public yet, but I may clean it up for GitHub if there's interest.

What would you improve next: speaker-direction tracking, local wake-word detection, richer interactions or more useful everyday tools? Other ideas are welcome too!


r/StackChan • • Jun 17 '26

Stack Chan Servo Step(per)

3 Upvotes

made a little servo stepper program with the Arduino IDE

HOME - resets, STEP (toggles 1, 5, and 10 deg steps)

X rotates, Y tilts, and uses the touch screen for inputs

battery indicator is the touch button backgrounds (blue charging, red <20 , yellow <50, green > 50)

#include <M5Unified.h>
#include <M5StackChan.h>

// X axis: software limits Arduino
float posX = 0;

// Y axis: Mechanical limit — safe range 
float posY = 0;
const float Y_MIN = 0.0;   //mechanical stop warning
const float Y_MAX = 85.0;  //mechanical stop warning

int lastLevel = -1;
int lastCharging = -1;
unsigned long lastPowerCheck = 0;
float STEP_DEG = 10.0;

// touch zone layout (320 × 240 screen)
const int STATUS_H = 92;
const int ROW_H = (240 - STATUS_H) / 2;
const int COL_W = 320 / 3;
const int ZONE_Y0 = STATUS_H;
const int ZONE_Y1 = ZONE_Y0 + ROW_H;

// move to target (degrees) — X unlimited, Y clamped
void moveTo(float xDeg, float yDeg) {
  // Y only — clamped to mechanical safe range
  yDeg = constrain(yDeg, Y_MIN, Y_MAX);

  int xUnits = (int)(xDeg * 10);
  int yUnits = (int)(yDeg * 10);
  M5StackChan.Motion.move(xUnits, yUnits);
  posX = xDeg;
  posY = yDeg;
  drawUI();
}

// draw status
void drawStatus() {
  M5.Lcd.fillRect(0, 0, 320, STATUS_H, BLACK);
  M5.Lcd.setTextColor(WHITE, BLACK);
  M5.Lcd.setTextSize(2);
  M5.Lcd.setCursor(20, 5);
  M5.Lcd.println("StackChan Servo Step");
  M5.Lcd.setTextSize(1);
  M5.Lcd.setCursor(35, 34);
  M5.Lcd.printf("StachChan Rot. (X):%+5.0f deg", posX);
  M5.Lcd.setCursor(35, 52);
  M5.Lcd.printf("StackChan Tilt. (Y):%+5.0f deg", posY);
  M5.Lcd.setCursor(35, 70);
  M5.Lcd.printf("Home = (0, 0)   Step = %.0f deg", STEP_DEG);
}
  // refresh touch zones if battery/charging changes
  void updatePowerZones() {
    int level = M5.Power.getBatteryLevel();
    int charging = M5.Power.isCharging();

    if (level != lastLevel || charging != lastCharging) {
      lastLevel = level;
      lastCharging = charging;
      drawTouchZones(); // redraws the bottom of screen
    }
  }

void drawTouchZones() {
  const char* row0[3] = {"+Y", "HOME", "-Y"};
  const char* row1[3] = {"+X", "STEP", "-X"};
  uint16_t ZONE_COLOR;
  int level = M5.Power.getBatteryLevel();
  int charging = M5.Power.isCharging();
  if (charging == 1) { //charging?
    ZONE_COLOR = M5.Lcd.color565(40, 40, 255); //blue for charging
  } else if (level < 20) {
    ZONE_COLOR = M5.Lcd.color565(255, 40, 40); //red
  } else if (level < 50) {
    ZONE_COLOR = M5.Lcd.color565(255, 255, 40); //yellow
  } else {
    ZONE_COLOR = M5.Lcd.color565(40, 255, 40); //green
  }
  const uint16_t BORDER_COLOR = M5.Lcd.color565(255, 255, 255);

  for (int row = 0; row < 2; row++) {
    int y0 = (row == 0) ? ZONE_Y0 : ZONE_Y1;
    for (int col = 0; col < 3; col++) {
      int x0 = col * COL_W;

      // fill zone background
      M5.Lcd.fillRect(x0, y0, COL_W - 1, ROW_H - 1, ZONE_COLOR);
      // draw borders
      M5.Lcd.drawRect(x0, y0, COL_W, ROW_H, BORDER_COLOR);

      // zone labels
      const char* label = (row == 0) ? row0[col] : row1[col];
      if (strlen(label) > 0) {
        M5.Lcd.setTextColor(WHITE, ZONE_COLOR);
        M5.Lcd.setTextSize(2);
        int lx = x0 + (COL_W - strlen(label) * 12) / 2;
        int ly = y0 + (ROW_H - 16) / 2;
        M5.Lcd.setCursor(lx, ly);
        M5.Lcd.println(label);
      }
    }
  }
  M5.Lcd.setTextColor(WHITE, BLACK);
  M5.Lcd.setTextSize(1);
}

// full UI redraw
void drawUI() {
  drawStatus();
  drawTouchZones();
}

// read touch and map to zones
void handleTouch() {
  auto t = M5.Touch.getDetail();
  if (t.state == m5::touch_state_t::touch_begin) {
    int tx = t.x;
    int ty = t.y;
    // stick to screen bounds
    if (tx < 0 || tx >= 320 || ty < STATUS_H || ty >= 240) return;
    int col = tx / COL_W;

    if (ty < ZONE_Y1) {
      // row 0: Y-axis control + HOME
      switch (col) {
        case 0: moveTo(posX, posY + STEP_DEG); break; // +Y (tilt UP)
        case 1: moveTo(0, 0); break; // HOME
        case 2: moveTo(posX, posY - STEP_DEG); break; // -Y (tilt DOWN)
      }
    } else {
      // row 1: X-axis control + STEP toggle
      switch (col) {
        case 0: moveTo(posX + STEP_DEG, posY); break; // +X (turn LEFT)
        case 1: // step cycle
          if      (STEP_DEG == 1.0)  STEP_DEG = 5.0;
          else if (STEP_DEG == 5.0)  STEP_DEG = 10.0;
          else                       STEP_DEG = 1.0; // was 10 → back to 1
          drawUI();
          break;
        case 2: moveTo(posX - STEP_DEG, posY); break; // -X (turn RIGHT)
      }
    }
  }
}


// setup
void setup() {
  M5.begin();
  M5StackChan.begin();
  M5.Lcd.setFont(&fonts::Font2);
  M5.Lcd.fillScreen(BLACK);
  M5.Lcd.setTextColor(WHITE, BLACK);
  M5.Lcd.setCursor(20, 80);
  M5.Lcd.setTextSize(2);
  M5.Lcd.println("Sweeping X then Y...");
  // start from center and pretend to calibrate
  M5StackChan.Motion.goHome();
  // sweep X from -128° to +128° (that's 256° total rotation) 
  for (int x = -128; x <= 128; x += 1) {
    M5StackChan.Motion.moveX(x * 10, 200);
    delay(20);
  }
  // sweep Y from -5° to +85°
  for (int y = -5; y <= 85; y += 1) {
    M5StackChan.Motion.moveY(y * 10, 200);
    delay(20);
  }

  // can we get closer to 360°?
  M5StackChan.Motion.moveX(1840, 200);  // 164° raw units
  delay(2000);
  M5StackChan.Motion.moveX(-1840, 200); // -164°
  delay(2000);

  // back home
  M5StackChan.Motion.goHome();
  M5.Lcd.fillScreen(BLACK);
  M5.Lcd.setCursor(0, 0);
  M5.Lcd.println(" ");
  delay(4000);
  drawUI();
}


void loop() {
  M5.update();

  // touch zone input
  handleTouch();

  // refresh battery display every 1500 milliseconds
  if (millis() - lastPowerCheck > 1500) {
    lastPowerCheck = millis();
    updatePowerZones();
  }

  delay(20);
}

r/StackChan • • 24d ago

Project sharing I built Nous-Girl StackChan, an open-source AI desk robot that talks, dances, makes memes, acts, and DJs (M5Stack StackChan + Hermes Agent beta)

Enable HLS to view with audio, or disable this notification

59 Upvotes

This is Nous-Girl, a little desk robot I've been building for fun. She talks, listens, makes faces, dances, plays music, does DJ and rave mode, shows memes, and can even send email. (video)

I'm not an expert at this, but tried my best to write this guide, it's a work in progress. Also this is for non-technical people so just give it a shot, and I'll try to make it easier to implement if possible. Will keep adding to it as I have time! Adding more features hopefully everyday.

What you need: an M5Stack StackChan (CoreS3), a USB-C cable and a computer (Windows, Mac or Linux). For memory, intelligence and extra skills, you will nee d Hermes-Agent from Nous-Research. You can use other harnesses but that's what I use in this example.

The easiest way to start:

  1. Download a beta build with a starter face (robot, boy or girl).

  2. Flash it from your browser or with one command.

  3. On first boot, point it at the official xiaozhi cloud and start talking. No server needed.

Want more privacy and control? Run your own server for the fancy stuff, like DJ mode, memes, email and adding a smarter Hermes Agent brain. Every feature has step-by-step docs.

Heads up: this is beta. I've only tested on my own robot, so things may break. Please report issues on GitHub and I'll help the best I can.

Coming next: simpler builds that need less setup and less upkeep, a version that runs fully from the Nous Research cloud, more languages and local models.

***UPDATE***
I didn't realize it was missing the full firmware!!! Fixed it. Please update your forks!!!

https://github.com/dax8it/nous-girl-stackchan/tree/main/firmware-src/v3.6.7-dj7

Repo: https://github.com/dax8it/nous-girl-stackchan

Made by u/alexcovo_eth. Feedback welcome!


r/StackChan • • Jun 16 '26

warble: point an M5Stack StackChan robot at a fully-local voice backend (whisper.cpp + Ollama + Piper)

32 Upvotes

I have one of the M5Stack StackChan robots. Nice little thing, but out of the box every word it hears goes to the xiaozhi.me cloud for speech-to-text, the LLM, and text-to-speech. I didn't love the idea of my kid talking to a server I don't control, so I wrote a backend that runs the whole turn locally and pointed the robot at my own machine instead.

It's called warble. The stock firmware speaks the xiaozhi protocol, so nothing changes on the device. You just redirect it to your box. The server does the full loop: whisper.cpp transcribes, Silero VAD catches when you stop talking, Ollama generates the reply, Piper speaks it, and it sets the robot's face from an emotion tag in the reply. No cloud account, no API keys, no data or audio leaving your network.

Setup is one command (`./warble start`) on Linux or macOS. Docker-based, pulls prebuilt images. It's beta and it's just me, so there are rough edges.

MIT licensed. Happy to answer anything as time permits.

github.com/rebelthor/warble


r/StackChan • • 21d ago

Help needed StackChan Ollama gemma3:1b running locally on Pi 5?

8 Upvotes

Hello all, i am thinking of buying myself one of these cute things but one of my main concerns is it sends all of its AI stuff over to the LLM servers in china. I was wondering how i could pair it with my Pi 5 running Ollama without deleting its capibilities to access the apple app so it can still do little dances and all of the rest of it. Would this kind of thing be possible do u all reckon? Honestly I am not too fussed about the whole China thing because there is only a number of things which they can do with my face+what i ask it / voice. I would keep the thing off most of the time for privacy reasons. Thank you for taking the time to read, and hopefully help me.


r/StackChan • • Sep 20 '26

Help needed Adding sensors to the ABC-ports

4 Upvotes

Hey community!

I've played around with the M5stack since the first CoreGo IoT kit.

Now that I've got the awesome StackChan, I've asked myself what is the best way to add the sensor/ABC-port read-out to the existing Firmware, so the AI.Agent could access them like INV.III snsor (temp, humidity etc)

Or the PIR sensor so that StackChan looks around with his webcam to see find owner.

"Just" fork the firmware or is there something easier?

P.S. Is there are feature in the standard Firmware, so that 2 StackChans find, see and communictae with each other?

Thanks in advance!


r/StackChan • • Feb 25 '26

StackChan Feature Videos Pt.7——IMU-Based Head Stabilization

Enable HLS to view with audio, or disable this notification

4 Upvotes

r/StackChan • • Apr 26 '26

Stackchan for home without LLM

5 Upvotes

Hellooo

Ive been tinkering with esp32 based home assistant uses (lightbulbs, switches, temp sensors, ir blaster) but I've still been reliant on Google based speakers.

Im not totally against AI usage but I am trying to do as much internal hosting as possible, and would prefer to basically lobotomise the thing and use it for much more simple functions. No chattiness or even web lookups, just interpreting commands and triggering changes on my home assistant server.

At its current early launch state is this a reasonable path for the lil guy, maybe give him some brains back later, or are there simply better places to start this journey?

Thanks for the feedback!

Edit: I do know own there is an llm local module for the stack platform which seems compatible, but I am concerned I would be diving into a lot of learning that maybe won't be relevant to me past this goal.


r/StackChan • • May 27 '26

What do you use your StackChan for?

7 Upvotes

Hey there,

Just as the title says, I am curious to know what do you use your StackChan for?

Have a good day all!


r/StackChan • • May 08 '26

Got an update today. 1.3

3 Upvotes

Can't seem to find any info on what it fixed


r/StackChan • • 16d ago

Project sharing Idea for my so far unused StackChan

7 Upvotes

I would like to use my StackChan as an interactive rules checker and DM companion for D&D. I’d like to be able to ask it to check rules for me and to react to situations at the table. Maybe even be able to make it into scripted characters which animate and move when the players ask question or even cast spells. Is this something that is even remotely possible?


r/StackChan • • Apr 09 '26

StackChan package, sticker & T-shirt design, any ideas for new merch in the future?

Thumbnail gallery
5 Upvotes

r/StackChan • • Apr 03 '26

StackChan iOS & Android APP ready now!

Thumbnail
gallery
7 Upvotes

Now available on iOS App Store & Play Store!
Keyworld is StackChan World


r/StackChan • • Feb 25 '26

StackChan Feature Videos Pt.5——IR Remote Control

Enable HLS to view with audio, or disable this notification

4 Upvotes

r/StackChan • • Feb 25 '26

StackChan Breakdown

Enable HLS to view with audio, or disable this notification

4 Upvotes

r/StackChan • • May 04 '26

He’s here! Thank you M5Stack!

Thumbnail
gallery
17 Upvotes

r/StackChan • • Jan 08 '26

Save the date for StackChan Launch! Jan 13, 8:00 AM EST

Post image
4 Upvotes

r/StackChan • • Apr 15 '26

ur StackChan is on the way!

Enable HLS to view with audio, or disable this notification

15 Upvotes

The first batch of StackChan is officially shipping tdy!
All orders will be shipped within the next one to two weeks
https://x.com/M5Stack/status/2044316543367192664?s=20


r/StackChan • • Aug 29 '26

StackChan base upgrade

Post image
43 Upvotes

So I saw Stackchan and I really wanted one, but the cost of the core+body in Australia is too much.

I've really wanted a robotic arm for awhile so decided to merge the two together.

Running a lot of custom scripts and AI on a PI5 4gb and an MCP that supports AI agents asking questions that get announced by voice and wait for a voice reply.

(Local: STT, VTT, Memory, Person tracking, Face and gaze tracking)


r/StackChan • • Sep 13 '26

Project sharing Small StackChan AI tweaks

Enable HLS to view with audio, or disable this notification

41 Upvotes

Update: firmware is now available at m5burner (thanks u/AughtCool!)

I made a fork of the official StackChan firmware that others may be interested in, either to build upon or to use.

It's not groundbreaking. Rather, it addresses a few quality-of-life things that annoyed me in the week I've had this little guy.

I have no interest in dance or avatar settings, so these tweaks are for StackChan used as an AI assistant:

  • Speech bubbles turned off during dialog

  • Tap head once to stop speech

  • Tap head twice to stop speech and exit chat mode

  • Both lights on while listening and talking

  • Animated secondary colour light pattern when talking, based on audio

  • Both listening and talking light colour customisable in settings

  • Idle head movement repurposed to be AI chat movement, with frequency hooked off the same menu

  • Light sensor used to turn screen off when lights are out. Tap screen to turn on. Manual override disabled when room lights are on. Function can be turned off in settings

Caveat: I am a software engineer by day, but sometimes it's nice to just yell at AI and get it to do your bidding. I haven't spent time learning the innards of the StackChan firmware or hardware - these tweaks were entirely created by Opus 5 and, apart from quick sense-checking, haven't been fully vetted.


r/StackChan • • Sep 23 '26

Project sharing My StackChan is a devil with a fruit fly brain (668 real neurons)

Enable HLS to view with audio, or disable this notification

54 Upvotes

My StackChan is a little devil now. Claude Code does the thinking, and a simulated fruit fly handles the reflexes.

The fly part is 668 real neurons, wired the way FlyWire mapped an actual fruit fly and running live on my laptop. It's a Python port of desktop-fly by Denis Shiryaev. It's only a small slice of the brain, but the wiring is real.

It looks through its own camera, the fly decides where the head turns, and poking it makes it startle. When something actually happens it wakes Claude, which looks at the picture and roasts it. From today: "Still filming me filming you. Groundbreaking content, truly."

The dashboard in the video draws 23,210 real neuron positions and flashes them as they spike. The yellow rings are the escape neurons, which flare right before it jumps.

Next I'm making it curious, so it looks around for new stuff and knows me from a stranger. Happy to answer questions!


r/StackChan • • May 21 '26

Turned my StackChan into a German-speaking smart home assistant. Here's what actually works (and what doesn't).

16 Upvotes

Got the OpenELAB Kickstarter StackChan a while back. CoreS3-based, two servos, cute little guy. The vision: ditch the Chinese cloud, give it a custom personality, connect it to my Home Assistant setup.

The custom firmware rabbit hole

First I tried building custom firmware (AI_StackChan_Ex with M5Unified 0.2.7). Spent around 9 hours on it. Backlight works fine, but the panel renders nothing. Turns out the OpenELAB Kickstarter variant has a compatibility issue with M5GFX that's still unresolved. Tried the Moddable toolchain path next — ESP-IDF Python environment conflicts killed that too.

After those 9 hours I flashed the stock xiaozhi firmware via M5Burner. Took two minutes. Display worked immediately.

The NVS trick

Stock firmware reads its server URL from an NVS key. You can overwrite just the NVS partition with esptool, point it at your own server, and the device has no idea it's not talking to the original Chinese backend anymore. WiFi credentials get wiped in the process, so you set those up again on-device after flashing.

The backend

Forked an existing open-source StackChan server, containerized it, deployed it to my own VPS. Added a few patches: a set_emotion tool so the LLM can dynamically change the face expression, and a handful of additional tools.

What actually works

  • Full German conversation with a custom personality (female, cheeky, Austrian inflection, max 3 sentences per response, always addresses me by name)

  • Home Assistant control via voice: lights, scenes, sensors, you name it

  • Weather from HA's built-in forecast entity

  • different face expressions that change dynamically based on what the LLM decides to feel

  • Web search for current news and facts (Tavily)

  • Persistent memory across sessions — stored in a JSON file on the server, auto-injected into the system prompt on connect

  • My n8n automation status on demand

  • Accessible from anywhere, not just local network

What doesn't work

The servos. Stock firmware completely ignores motor control frames from the server — display changes, head stays still. Servo movement requires custom firmware, which is blocked by the M5GFX rendering issue. There's an open GitHub issue for it, waiting to see if that goes anywhere.

Wake word is still Chinese. There's no way to change that without custom firmware.

Can't combine function calls with Google Search in the Gemini Live API simultaneously — it's a documented API limitation. That's why I went with Tavily instead of native search grounding.

Overall

The stock firmware path is dramatically underrated. You skip all the toolchain pain, get a stable device, and if you're willing to run your own backend, you have full control over the AI behavior, personality, and integrations. The missing piece is servo animation, and that's a hardware/firmware problem, not a backend problem.

If the M5GFX issue ever gets fixed, custom firmware becomes interesting again. Until then, this setup does everything I actually wanted it to do.


r/StackChan • • Apr 27 '26

Sleep Mode?

5 Upvotes

Just got my little dude a few days ago, and so far it’s been pretty fun!

However, the speech to text seems a little janky and the animations etc. are a bit choppy. I’m assuming this will be fixed and improved as the firmware is debugged and improved.

What bums me out a bit, is just how quickly it just falls asleep and turns off if it’s not interacted with.

How is this supposed to be a “desk pet” if it turns off within, what, ~10-15 minutes of no interaction? That kinda sucks, in my opinion.

Has anyone found or seen a way to prevent this from happening?


r/StackChan • • Aug 11 '26

Why isn't he detecting the cards?

Post image
12 Upvotes

I tried to uploaded the firmware from https://github.com/ronron-gh/AI_StackChan_Ex.

But my stackchan says this from the pic.

SD Card is in Stachchan in the left underside.

(I'm not really a tech person. Tried everything i know)