VR Ladybug

VR Ladybug is an interactive application designed to train vision for children and adults using Meta Quest Pro augmented reality glasses. The project combines virtual reality, eye tracking technology, and a personalized vision training algorithm.

---

Overview

The core concept of VR Ladybug is simple yet effective: a user tracks a moving ball in virtual space using their eyes. The eye-tracking algorithm measures how accurately and for how long the user focuses on the ball:

• If the user keeps their gaze on the ball long enough, the ball gradually accelerates.
• If the user looks away or does not focus on the ball long enough, the ball slows down.

This dynamic adjustment provides a personalized vision training experience that adapts to each user's abilities.

Currently, the system works in a basic mode:

• The AR glasses send gaze data to the server.
• The server outputs 1 if the gaze is long enough on the object, and 0 if not.
• Unity adjusts the ball's speed according to the server response.

In the future, the algorithm will be enhanced so that the longer and uninterrupted the gaze on the moving ball, the faster it moves, creating a more engaging and challenging training experience.

---

Features

• Personalized vision training based on real-time eye tracking.
• Dynamic object behavior — ball speed adapts to user’s gaze.
• AR/VR integration with Meta Quest Pro and Unity.
• Server-client architecture to process gaze data and control training logic.

---

Technology Stack

• Unity — main engine for VR/AR application development.
• Meta Quest Pro — AR glasses with eye-tracking support.
• Eye-tracking algorithms — analyze gaze duration and accuracy.
• Server-side processing — receives gaze data and sends responses to Unity.

---

Installation & Setup

Note: Project is in active development. Instructions may be updated.

1. Clone the repository:

git clone https://github.com/yourusername/Innowacja2026.git

2. Open the project in Unity.

3. Configure Meta Quest Pro integration for XR:

4. Install Oculus XR Plugin via Unity Package Manager

5. Enable eye tracking in the device settings

6. Open and run the scene MainScene to test ball movement and gaze tracking.

---

How It Works

1. User follows the moving ball with their eyes.

2. AR glasses send gaze data to the server.

3. Server checks if the gaze is long enough and uninterrupted:

   1 → ball can accelerate

   0 → ball slows down

4. Unity adjusts the ball's speed based on the server response in real time.

5. User continuously trains their eyes while interacting with the VR environment.

---

Future Improvements

• Gradual acceleration proportional to uninterrupted gaze duration.
• Visual and audio feedback for motivation and engagement.
• Progress tracking and statistics for each user.
• Additional exercises and difficulty levels for more comprehensive training.

---

Contributing

Contributions are welcome! You can help improve the eye-tracking algorithm, enhance the Unity scenes, or add new exercises. Please submit pull requests and suggestions.