Woofun AI reports that OpenAI has open-sourced Plant Talk, an educational initiative combining the Realtime API, multimodal vision models, and Arduino microcontrollers to grant indoor plants environmental awareness and voice interaction capabilities. The system facilitates low-latency, full-duplex communication via computer cameras and microphones, while interfacing with Arduino to capture capacitive soil moisture and LM393 light sensor readings.

The AI character, such as the default "George", utilizes function calling to retrieve hardware data when users inquire about water or light conditions. By analyzing captured images—with a 25-cent coin serving as a size reference—the model estimates plant moisture levels, branch counts, and maximum span, responding in a human-like plant voice. Security is maintained through an Express backend that issues ephemeral client keys for WebRTC connections, preventing API master key exposure.

Additionally, the codebase features an AGENTS.md guide to assist users with software configuration and hardware assembly.