In-app Live Assistant : Part 2 --- Building the Screen-Sharing Version
A custom web client that swaps the ADK camera feed for screen capture, so the agent watches the application instead of the user.
#multimodal
Everything tagged multimodal, newest first.
Posts
In-app Live Assistant : Part 1 --- Walking Through Google's ADK Bidirectional Streaming Demo
Getting Google's ADK bidirectional streaming demo running locally with mic, camera, and voice, as the foundation for a live in-app assistant.
In-App Live Assistant
An open-source kit for a real-time in-app assistant that listens to voice, sees the screen, and guides users step by step.
Experiment: A Live In-App Assistant (Voice + Screen)
Working notes from recreating a voice-and-screen assistant: one path failed on authentication, the next produced a working streaming prototype.