Augmented reality – A magical insight into our area of expertise

Augmented Reality (AR) refers to technology that blends the real world with virtual content, creating new forms of interactive experiences that make the physical environment come to life in unique ways. This technology has rapidly evolved in recent years and is widely used in many fields, particularly in medicine, education, and entertainment.

At onexip, we have been deeply involved in the practical application of various Augmented Reality (AR) technologies for years. Now that we’ve mastered them almost in our sleep, we recently asked ourselves: ‘What could be possible if we used hands as the medium for interaction?’

To test the accuracy and stability of hand tracking using Mediapipe, we quickly put together a small showcase! The result? – A fun and practical example of what’s possible in the world of tracking!

The best part: It not only works, it’s simply magical!

The Technology Behind the Magic

Our showcase is based on the use of Mediapipe Web for precise hand tracking. This allows us to capture and respond to hand movements in real-time. Combined with Three.js, we’ve also integrated a particle system that enables us to effortlessly display sparkling effects—like glitter or other elements—on the user’s hands. Additionally, by implementing it as an Angular web component, our project can easily be integrated into any HTML environment (such as WIX, WordPress, or other Angular applications).

To ensure that video, hand tracking, and particle effects are properly aligned and coordinated, we layer multiple views and precisely align the different coordinate systems. This allows us to seamlessly integrate the various elements and create a harmonious user experience where the visual and interactive components are perfectly synchronized.

Hands-On Experience

Our showcase is not just a demonstration of our technical skills but also an interactive experience that highlights the potential of AR. What today are just small sparkling particles could tomorrow hold unexpected possibilities and new applications.

Curious? Try out our hand tracker yourself: Here’s the link to our HandTrackAR.

We look forward to continuing to showcase what’s possible in the realm of AR—and to making your AR project a reality too!

Frequently Asked Questions: