Voice

2026

In-App Live Assistant

13 February 2026·3 mins

Open-Source Ai-Agents Multimodal Streaming Voice Screen-Sharing Xapi Learning-Measurement

This is a project I am actively pursuing: an open-source “in-app live assistant” pattern that other product teams can embed.

The core idea is simple: if the assistant can listen and see the current UI, it can give concrete next-step guidance instead of generic chatbot answers.

Experiment: A Live In-App Assistant (Voice + Screen)

13 February 2026·4 mins

AI Experiments Ai-Agents Multimodal Streaming Voice Prototyping Customer-Support

I tried to recreate a Google AI Studio proof-of-concept in code. The first path failed on authentication; the second produced a working bidirectional streaming prototype; the third pushed it toward a realistic scenario.