Reachy Mini App

Reachy's Brain

Turn your iPhone into the brain for Reachy Mini

Control your Reachy Mini from your iPhone. Voice conversations, animations, weather, web search, vision, and more — all processed on the robot.

Features

Everything you need for natural robot conversations

🗣️

Natural Speech

OpenAI TTS with 8 expressive voices. Multilingual support for conversations in any language.

💬

Real-time Voice

OpenAI Realtime API for fluid, interruption-aware conversations with sub-second latency.

🎭

Expressive Animations

Head movements, gestures, and emotional expressions that bring Reachy to life.

🎬

Animation Recording

Record custom animations by moving Reachy's head. Save and replay your creations.

🛠️

Built-in Tools

Weather forecasts, news updates, web search, current time, and camera vision for smart interactions.

📷

Vision & Camera

Reachy can see and describe what's in front of it using the built-in camera.

⏰

iOS Reminders

Create and manage reminders on your iPhone through voice commands. Never forget important tasks.

📝

Notes

Capture thoughts and ideas instantly. Dictate notes to Reachy and save them to your device.

🎙️

Meeting Notes

Automatic meeting note taker. Reachy listens, summarizes, and captures key points from your conversations.

💬

Scheduled Messages

Schedule WhatsApp and iMessage messages to be sent later. Perfect for birthday wishes and reminders.

👥

iOS Contacts

Access your iPhone contacts through voice. Find phone numbers, emails, and contact details instantly.

♟️

Play Chess

Challenge Reachy to a game of chess. Play using voice commands and watch Reachy react to your moves.

🃏

Memory Game

Test your memory with interactive card matching games. Reachy keeps track and celebrates your wins.

📍

Location

Get your current location and find places nearby. Ask about distances and directions.

🥚

Tamareachy

Virtual pet mode! Take care of Reachy by feeding, playing, and keeping it happy. Watch its mood change.

🎯

Create Apps

Build custom apps for Reachy using natural language. Describe what you want and watch it come to life.

🎭

Custom Personalities

Create unique AI personalities with different voices, behaviors, and conversation styles.

🌐

Vibe Coding

Generate websites and web apps through conversation. Describe your vision and Reachy builds it.

⚡

Ultra Low Latency

Local WiFi communication with ~1-5ms response times. No cloud dependency for control.

🔒

Privacy First

Your API keys stay on Reachy. All processing happens on the robot itself.

Feature Examples

See what you can do with Reachy's Brain

🗣️

Voice Conversations

Have natural, flowing conversations with Reachy using OpenAI's Realtime API.

"Hey Reachy, tell me a joke"
"What's the meaning of life?"
"Can you explain quantum computing simply?"
🌤️

Weather

Get current weather conditions and forecasts for any location.

"What's the weather like today?"
"Will it rain in Amsterdam tomorrow?"
"What's the temperature in Tokyo?"
📰

News

Stay informed with the latest news headlines and stories.

"What's in the news today?"
"Tell me about the latest tech news"
"Any sports news?"
🔍

Web Search

Search the web for information, facts, and answers.

"Search for the best Italian restaurants nearby"
"Who won the World Cup in 2022?"
"How tall is the Eiffel Tower?"
📷

Vision & Camera

Reachy can see and describe what's in front of it.

"What do you see?"
"Describe what's on my desk"
"Can you read what's on this paper?"
⏰

iOS Reminders

Create and manage reminders directly on your iPhone.

"Remind me to call mom at 5pm"
"Add a reminder to buy groceries tomorrow"
"Set a reminder for my dentist appointment on Friday"
📝

Notes

Quickly capture thoughts and ideas through voice.

"Take a note: remember to update the project timeline"
"Save this idea: new feature for the app"
"Note to self: research machine learning frameworks"
🎙️

Meeting Notes

Automatic meeting transcription and summarization.

"Start taking meeting notes"
"Summarize our discussion"
"What were the action items from this meeting?"
💬

Scheduled Messages

Schedule WhatsApp and iMessage messages to be sent at a specific time.

"Send a WhatsApp to Mom tomorrow at 9am saying happy birthday"
"Schedule a message to John on Friday: Don't forget our meeting"
"Text Sarah at 6pm: I'm on my way home"
👥

iOS Contacts

Access your iPhone contacts and find contact information.

"What's John's phone number?"
"Find Sarah's email address"
"Show me the contact details for my dentist"
♟️

Play Chess

Challenge Reachy to a game of chess using voice commands.

"Let's play chess"
"Move pawn to e4"
"What's your next move?"
🃏

Memory Game

Play memory card matching games with Reachy.

"Let's play a memory game"
"Flip card number 3"
"How many matches do I have?"
📍

Location

Get your current location and find nearby places.

"Where am I right now?"
"Find coffee shops nearby"
"How far is the nearest train station?"
🥚

Tamareachy

Take care of Reachy like a virtual pet - feed it, play with it, and keep it happy!

"Feed Reachy"
"How is Reachy feeling?"
"Play with Reachy"
"Give Reachy some water"
🎭

Animations

Trigger expressive head movements and gestures.

"Nod your head"
"Do a happy dance"
"Look surprised"
🎯

Create Apps

Build custom apps for Reachy using natural language.

"Create an app that tells dad jokes"
"Make a meditation timer app"
"Build a trivia game"
🌐

Vibe Coding

Generate websites and web apps through conversation.

"Create a portfolio website for me"
"Build a simple todo list app"
"Make a landing page for my startup"
🕐

Date & Time

Get current time, dates, and time zone information.

"What time is it?"
"What's the date today?"
"What time is it in New York?"

Architecture

A three-layer system designed for responsiveness

📱

iOS App

Native SwiftUI app for controlling Reachy, viewing conversations, and managing settings.

Remote Control Conversation View Animation Recording
Port 8080
🌉

iOS Bridge

Python FastAPI server handling speech, TTS, voice conversations, and tools on Reachy.

OpenAI Realtime TTS Tools Vision
Port 8000
🤖

Reachy Daemon

Built-in system daemon for motor control, animations, volume, and hardware management.

Motors Animations Audio

Getting Started

Up and running in minutes

1

Install on Reachy Mini

From the Reachy Mini dashboard, install this app from Hugging Face:

robertkeus/reachys-brain

Or install manually with pip:

pip install git+https://huggingface.co/spaces/robertkeus/reachys-brain
2

Start the Bridge

From the Reachy Mini dashboard (e.g. http://reachy.local:8000), select "Reachy's Brain" from installed applications.

The HTTP server will start on port 8080.

3

Get the iOS App

Coming Soon

The companion iOS app will be available on the App Store.

Requires iOS 17 or newer.

4

Configure & Connect

In the iOS app Settings:

  • Enter Reachy's IP address (find with hostname -I)
  • Add your OpenAI API key
  • Choose your preferred voice

Bridge API Reference

HTTP endpoints on port 8080 for custom integrations

GET /status

Get current robot status including connection, speaking, and animation states.

{
  "connected": true,
  "speaking": false,
  "animation_playing": false
}
POST /speak

Send text for text-to-speech with optional emotion.

{
  "text": "Hello!",
  "emotion": "happy"
}
Emotions: neutral, happy, sad, surprised, thinking
POST /motion

Trigger a head animation by name.

{
  "animation": "nod",
  "duration": 1.5
}
Animations: nod, shake, happy, thinking, and more
GET /voices

List available OpenAI TTS voices.

Voices: alloy, ash, coral, echo, sage, shimmer, verse, ballad
POST /voice

Set the active TTS voice.

{ "voice_id": "coral" }
POST /stop

Stop current speech and animation immediately.

See the full API documentation for all endpoints.

Voice Library

8 expressive voices powered by OpenAI

A

Alloy

Neutral, balanced

C

Coral

Clear, friendly

S

Sage

Calm, wise

A

Ash

Soft, warm

E

Echo

Deep, resonant

B

Ballad

Expressive, storytelling

S

Shimmer

Bright, energetic

V

Verse

Dynamic, engaging

Troubleshooting

Common issues and solutions

🔇 No Sound from Reachy?

  1. Check volume: GET /volume should return a value > 0
  2. Test audio: speaker-test -D plug:reachymini_audio_sink -c 1 -t sine -f 440 -l 1
  3. Verify the daemon is running: GET http://reachy.local:8000/api/daemon/status

🔑 TTS Not Working?

  1. Check if API key is set: GET /openai/api-key should return {"configured": true}
  2. Set the key in iOS app Settings or via API
  3. Check server logs for OpenAI errors

📡 Can't Connect to Reachy?

  1. Ensure iPhone and Reachy are on the same WiFi network
  2. Find Reachy's IP: hostname -I
  3. Try http://reachy.local:8080 if mDNS is available
  4. Check that the bridge app is running on port 8080

🤖 Animations Not Playing?

  1. Verify Reachy is connected: GET /status should show "connected": true
  2. Wake the robot: POST /robot/wake
  3. Check that motors are enabled in the daemon dashboard

Requirements

What you need to get started

📱

iOS Device

  • iPhone running iOS 17+
  • Same WiFi network as Reachy
  • OpenAI API key
🤖

Reachy Mini

  • Reachy Mini Wireless
  • Python 3.10+
  • Same WiFi as iPhone