Gossiping Birds: Interactive AI-Powered Nature Experience

 

Collaborative Project with Wenzheng Du, Stuti Pande and Andrea Brecha

Project Overview

Gossiping Birds is an innovative interactive installation that bridges the gap between artificial intelligence and natural experiences. The project transforms everyday birdsong into humorous, AI-generated conversations, encouraging deeper human engagement with nature through technology.

Key Innovation

Using proximity sensing and LLM-powered conversational agents, two mechanical bird models "translate" their chirping into real-time gossip displayed on screen. As users approach, the birds react naturally - commenting on visitors' appearance, discussing their surroundings, or asking for personal space when users get too close.

Technical Highlights

🤖 AI & Computer Vision

  • GPT-4o powers dynamic conversation generation

  • Real-time computer vision analyzes user appearance

  • Context-aware dialogue that responds to environmental cues

⚙️ Digital Fabrication & Hardware

  • 3D printed bird bodies with independent head/body movement

  • Laser-cut servo motor mounts and structural components

  • Custom two-axis movement system enabling realistic bird behavior

  • ESP32 microcontroller with ultrasonic distance sensors

🎯 Proxemic Interaction Design

  • Three interaction modes based on user distance:

    • Idle (>120cm): Quiet ambient birdsong, birds face each other

    • Approach (40-120cm): Birds turn toward user, comment on appearance

    • Danger (<40cm): Erratic movement, asking for space

🔊 Audio-Visual Experience

  • Spatially-aware audio with speaker positioning

  • Typewriter animation synchronizes text with bird movements

  • Dynamic sound levels and conversation frequency

Impact & Results

  • 15 user evaluation study with 100% engagement rate

  • 80% of users asked follow-up questions, showing high curiosity

  • Successfully demonstrated increased connection to nature

  • Positive feedback on the fusion of artificial and natural elements

Technical Skills Demonstrated

  • AI/ML: Prompt engineering, conversational agent design, computer vision

  • Hardware: Microcontroller programming, sensor integration, servo motor control

  • Digital Fabrication: 3D modeling/printing, laser cutting, electronics housing

  • HCI Design: Proxemic interaction principles, user experience design

  • Software Development: Python, real-time system integration

Recognition

🏆 Best Prototype Award Winner in INFO90003 Designing Novel Interactions 2024
Praised by faculty as "the most complete project" for effectively combining digital fabrication, AI, computer vision, sensors, and actuators into a cohesive, engaging experience.