Funded by: AT Lab at KArts
Targeted Submission: Venice Immersive Film Festival 2025
At 8PM, when time stops after the loss of a loved one, a quiet room, a sleeping cat, and lingering memories unfold like panels in a dreamlike comic.
8PM and the Cat is a 13-minute, AI-driven VR narrative that offers a personalized, emotionally adaptive experience. Through the intertwined perspectives of Haru and Mina, users explore the fragile space between longing and healing—where time stands still, but memories continue to breathe.
Engine: Unity (C#)
Platform: Meta Quest
Collaboration: Plastic SCM
Gen AI: GPT-4o (OpenAI API), ElevenLabs (custom voice cloning)
Plugins: Meta SDK
Languages Supported: English & Korean
Each viewer’s story is different—images and monologues shift dynamically based on user input, making the experience deeply personal and reflective.
🧑💻 User Input ➝ 🎨 GPT-4o Image Generation
Via a virtual keyboard, users are prompted with reflective questions such as:
“What do you usually see outside your window at 8PM?”
The response is used to generate real-time imagery that reflects the user’s emotional world.
🗂️ Predefined Prompts ➝ 🎨 GPT-4o Image Generation
In the experience, both the 2D visuals and the room’s textures change in real time based on predefined emotional prompts. Since Haru is a comic artist, the images are styled like illustrated panels. At the same time, the entire room environment transforms to match the mood expressed in the prompt. For example, if the prompt describes a tense or uneasy emotional state, both the visual content and the space around the user shift to reflect that atmosphere—creating a fully immersive emotional experience.
🗂️ Predefined Prompts ➝ 🧠 GPT Narration ➝ 🔊 ElevenLabs Voice ➝ 🎧 Immersive Playback
Emotional voice-over monologues are dynamically generated by GPT and instantly synthesized into natural speech using ElevenLabs—based on a custom-trained voice model of the main characters.