Reachy Mini App

Reachy's Brain

Turn your iPhone into the brain for Reachy Mini

Control your Reachy Mini from your iPhone. Voice conversations, animations, weather, web search, vision, and more — all processed on the robot.

Features

Everything you need for natural robot conversations

🗣️

Natural Speech

OpenAI TTS with 8 expressive voices. Multilingual support for conversations in any language.

💬

Real-time Voice

OpenAI Realtime API for fluid, interruption-aware conversations with sub-second latency.

🎭

Expressive Animations

Head movements, gestures, and emotional expressions that bring Reachy to life.

🎬

Animation Recording

Record custom animations by moving Reachy's head. Save and replay your creations.

🛠️

Built-in Tools

Weather forecasts, news updates, web search, current time, and camera vision for smart interactions.

📷

Vision & Camera

Reachy can see and describe what's in front of it using the built-in camera.

iOS Reminders

Create and manage reminders on your iPhone through voice commands. Never forget important tasks.

📝

Notes

Capture thoughts and ideas instantly. Dictate notes to Reachy and save them to your device.

🎙️

Meeting Notes

Automatic meeting note taker. Reachy listens, summarizes, and captures key points from your conversations.

💬

Scheduled Messages

Schedule WhatsApp and iMessage messages to be sent later. Perfect for birthday wishes and reminders.

👥

iOS Contacts

Access your iPhone contacts through voice. Find phone numbers, emails, and contact details instantly.

♟️

Play Chess

Challenge Reachy to a game of chess. Play using voice commands and watch Reachy react to your moves.

🃏

Memory Game

Test your memory with interactive card matching games. Reachy keeps track and celebrates your wins.

📍

Location

Get your current location and find places nearby. Ask about distances and directions.

🥚

Tamareachy

Virtual pet mode! Take care of Reachy by feeding, playing, and keeping it happy. Watch its mood change.

🎯

Create Apps

Build custom apps for Reachy using natural language. Describe what you want and watch it come to life.

🎭

Custom Personalities

Create unique AI personalities with different voices, behaviors, and conversation styles.

🌐

Vibe Coding

Generate websites and web apps through conversation. Describe your vision and Reachy builds it.

Ultra Low Latency

Local WiFi communication with ~1-5ms response times. No cloud dependency for control.

🔒

Privacy First

Your API keys stay on Reachy. All processing happens on the robot itself.

Feature Examples

See what you can do with Reachy's Brain

🗣️

Voice Conversations

Have natural, flowing conversations with Reachy using OpenAI's Realtime API.

"Hey Reachy, tell me a joke"
"What's the meaning of life?"
"Can you explain quantum computing simply?"
🌤️

Weather

Get current weather conditions and forecasts for any location.

"What's the weather like today?"
"Will it rain in Amsterdam tomorrow?"
"What's the temperature in Tokyo?"
📰

News

Stay informed with the latest news headlines and stories.

"What's in the news today?"
"Tell me about the latest tech news"
"Any sports news?"
🔍

Web Search

Search the web for information, facts, and answers.

"Search for the best Italian restaurants nearby"
"Who won the World Cup in 2022?"
"How tall is the Eiffel Tower?"
📷

Vision & Camera

Reachy can see and describe what's in front of it.

"What do you see?"
"Describe what's on my desk"
"Can you read what's on this paper?"

iOS Reminders

Create and manage reminders directly on your iPhone.

"Remind me to call mom at 5pm"
"Add a reminder to buy groceries tomorrow"
"Set a reminder for my dentist appointment on Friday"
📝

Notes

Quickly capture thoughts and ideas through voice.

"Take a note: remember to update the project timeline"
"Save this idea: new feature for the app"
"Note to self: research machine learning frameworks"
🎙️

Meeting Notes

Automatic meeting transcription and summarization.

"Start taking meeting notes"
"Summarize our discussion"
"What were the action items from this meeting?"
💬

Scheduled Messages

Schedule WhatsApp and iMessage messages to be sent at a specific time.

"Send a WhatsApp to Mom tomorrow at 9am saying happy birthday"
"Schedule a message to John on Friday: Don't forget our meeting"
"Text Sarah at 6pm: I'm on my way home"
👥

iOS Contacts

Access your iPhone contacts and find contact information.

"What's John's phone number?"
"Find Sarah's email address"
"Show me the contact details for my dentist"
♟️

Play Chess

Challenge Reachy to a game of chess using voice commands.

"Let's play chess"
"Move pawn to e4"
"What's your next move?"
🃏

Memory Game

Play memory card matching games with Reachy.

"Let's play a memory game"
"Flip card number 3"
"How many matches do I have?"
📍

Location

Get your current location and find nearby places.

"Where am I right now?"
"Find coffee shops nearby"
"How far is the nearest train station?"
🥚

Tamareachy

Take care of Reachy like a virtual pet - feed it, play with it, and keep it happy!

"Feed Reachy"
"How is Reachy feeling?"
"Play with Reachy"
"Give Reachy some water"
🎭

Animations

Trigger expressive head movements and gestures.

"Nod your head"
"Do a happy dance"
"Look surprised"
🎯

Create Apps

Build custom apps for Reachy using natural language.

"Create an app that tells dad jokes"
"Make a meditation timer app"
"Build a trivia game"
🌐

Vibe Coding

Generate websites and web apps through conversation.

"Create a portfolio website for me"
"Build a simple todo list app"
"Make a landing page for my startup"
🕐

Date & Time

Get current time, dates, and time zone information.

"What time is it?"
"What's the date today?"
"What time is it in New York?"

Architecture

A three-layer system designed for responsiveness

📱

iOS App

Native SwiftUI app for controlling Reachy, viewing conversations, and managing settings.

Remote Control Conversation View Animation Recording
Port 8080
🌉

iOS Bridge

Python FastAPI server handling speech, TTS, voice conversations, and tools on Reachy.

OpenAI Realtime TTS Tools Vision
Port 8000
🤖

Reachy Daemon

Built-in system daemon for motor control, animations, volume, and hardware management.

Motors Animations Audio

Getting Started

Up and running in minutes

1

Install on Reachy Mini

From the Reachy Mini dashboard, install this app from Hugging Face:

robertkeus/reachys-brain

Or install manually with pip:

pip install git+https://huggingface.co/spaces/robertkeus/reachys-brain
2

Start the Bridge

From the Reachy Mini dashboard (e.g. http://reachy.local:8000), select "Reachy's Brain" from installed applications.

The HTTP server will start on port 8080.

3

Get the iOS App

Coming Soon

The companion iOS app will be available on the App Store.

Requires iOS 17 or newer.

4

Configure & Connect

In the iOS app Settings:

  • Enter Reachy's IP address (find with hostname -I)
  • Add your OpenAI API key
  • Choose your preferred voice

Bridge API Reference

HTTP endpoints on port 8080 for custom integrations

GET /status

Get current robot status including connection, speaking, and animation states.

{
  "connected": true,
  "speaking": false,
  "animation_playing": false
}
POST /speak

Send text for text-to-speech with optional emotion.

{
  "text": "Hello!",
  "emotion": "happy"
}
Emotions: neutral, happy, sad, surprised, thinking
POST /motion

Trigger a head animation by name.

{
  "animation": "nod",
  "duration": 1.5
}
Animations: nod, shake, happy, thinking, and more
GET /voices

List available OpenAI TTS voices.

Voices: alloy, ash, coral, echo, sage, shimmer, verse, ballad
POST /voice

Set the active TTS voice.

{ "voice_id": "coral" }
POST /stop

Stop current speech and animation immediately.

See the full API documentation for all endpoints.

Voice Library

8 expressive voices powered by OpenAI

A

Alloy

Neutral, balanced

C

Coral

Clear, friendly

S

Sage

Calm, wise

A

Ash

Soft, warm

E

Echo

Deep, resonant

B

Ballad

Expressive, storytelling

S

Shimmer

Bright, energetic

V

Verse

Dynamic, engaging

Troubleshooting

Common issues and solutions

🔇 No Sound from Reachy?

  1. Check volume: GET /volume should return a value > 0
  2. Test audio: speaker-test -D plug:reachymini_audio_sink -c 1 -t sine -f 440 -l 1
  3. Verify the daemon is running: GET http://reachy.local:8000/api/daemon/status

🔑 TTS Not Working?

  1. Check if API key is set: GET /openai/api-key should return {"configured": true}
  2. Set the key in iOS app Settings or via API
  3. Check server logs for OpenAI errors

📡 Can't Connect to Reachy?

  1. Ensure iPhone and Reachy are on the same WiFi network
  2. Find Reachy's IP: hostname -I
  3. Try http://reachy.local:8080 if mDNS is available
  4. Check that the bridge app is running on port 8080

🤖 Animations Not Playing?

  1. Verify Reachy is connected: GET /status should show "connected": true
  2. Wake the robot: POST /robot/wake
  3. Check that motors are enabled in the daemon dashboard

Requirements

What you need to get started

📱

iOS Device

  • iPhone running iOS 17+
  • Same WiFi network as Reachy
  • OpenAI API key
🤖

Reachy Mini

  • Reachy Mini Wireless
  • Python 3.10+
  • Same WiFi as iPhone