| Branche | Thema | Tools | Projektdauer |
| AR/VR | Computer Vision | PyTorch, NeRF, GAN | 12 Monate |
The Challenge
We had the privilege of working with Gixel, a pioneering company focused on enhancing virtual meetings through augmented reality (AR). Gixel’s mission is to create immersive meeting experiences that capture essential cues, such as eye contact and head movements, which are crucial for effective communication.
Approach & Solution
Our team developed a life-like 3D avatar that can be controlled in real time with only minimal input from the user. Using advanced machine learning and computer graphics technologies like neural rendering, NeRFs and GANs, we created a photo-realistic replica of the user.
The user sits in front of a webcam, which records a frontal video stream. This video stream is fed into our avatar model, which creates a photo-realistic 3d reconstruction of the user. The whole process is fast enough to run in real-time. The avatar can be rotated independently of the rotation of the users head.