Mike Bot

Mike Bot

An experimental AI chatbot that turns conversation into an interactive experience.

Mike Bot is a side project we built to explore how modern AI chatbots can go beyond the traditional text-based interface. Instead of a chat window, the user talks to a 3D animated character that acts as a digital director for Oz, introducing the company, its services and its portfolio of works, in either English or Japanese.

Built with the OpenAI Realtime API over WebRTC, Mike Bot supports both text and real-time voice conversations. Speech goes directly between the microphone and the speech-to-speech model with no separate transcription step, so users can speak naturally, receive near-instant responses, and interact with relevant content directly within the experience. The character is rendered with Three.js, with lip sync driven by live audio analysis and facial expressions the AI sets itself to match the tone of its reply.

Using tool calling, Mike Bot can understand the context of a conversation and trigger interactive UI elements. When a user asks about a

project, the character raises a phone and opens the mareen, scrolls to the section it is discussing, and can switch the interface language or theme on request. Each session is recorded and processed into topics, so returning users can pick up

where they left off and ask the chatbot to bring an ea.

The project demonstrates how AI, voice interaction, 3Derfaces can work together to create a chatbot thatfeels less like a chat window and more like an interactive digital assistant.

Key Features

• Real-time voice conversations using the OpenAI Realtime API over WebRTC
• Text and voice input in the same experience
• Bilingual English and Japanese, switchable mid-conversation by voice
• 3D animated character with audio-driven lip sync and
• Context-aware tool calling
• Dynamic work cards and content dialogs triggered by
• Conversation memory grouped into topics for returning users
• Interactive UI that responds to user intent, on desk

Mike Bot serves as a playground for experimenting with new ways to connect AI conversation with real user interfaces, showing how chatbots can become a more engaging and integrated part of a website or digital product.