Real-time video analysis for game testing
software development
As part of this project, a system-level extension for Windows was developed that allows both system audio and webcam video data to be recorded during gameplay and saved synchronized in an MP4 file. Of particular note is the integrated option for live video chats with screencasting, which allows player reactions to be tracked in real time and direct feedback to be obtained during gameplay. This enables gaming behavior and user experience to be analyzed even more precisely and under realistic conditions.
The Problem
The following points illustrate the initial situation and the challenges that we gradually addressed or solved during the project.
-
The existing solution did not provide the ability to capture system audio and webcam video, nor live screencasting (of Direct3D content)
-
Technically complex requirements for parallel processing of multiple real-time data streams
-
High demands on stability, synchronization, and data quality with low latency
-
Platform Channels available on iOS / Android had to be newly implemented for Windows
Which Core Features have been Implemented?
Feature Development
High Runtime Performance
Real-Time Data Processing
Monitoring
Data Analysis and Evaluation
Our Expertise
In this project, we were able to demonstrate our strength in combining system-oriented Windows development with modern Flutter architecture—with a focus on real-time capability, stability, and seamless integration.
Low-level Development for Windows with a Focus on Performance
We combine Flutter with native Windows integration via C++, Direct3D, and the Windows API. This creates high-performance solutions that deeply interact with the system while remaining user-friendly—ideal for data-intensive real-time applications.
Real-time Processing of Audio and Video Data
We develop stable pipelines for parallel processing of camera and system audio streams. This involves clean thread management, efficient synchronization, and low-loss storage—ensuring precise analysis afterwards.
Platform Channels between Flutter and C++
Through the targeted use of Method and Event Channels, we connect modern Flutter interfaces with native system-level performance—clean, robust, and maintainable.
Collaboration with Clear Communication
Especially in short, intensive projects, we rely on close coordination with the client team. Issues are addressed openly and solved pragmatically—with direct contact to the PO and developers on the client side.
Architecture & Debugging under Real-time Conditions
We develop robust structures for parallel processes—with clean logic, testable components, and clearly defined data interfaces. This allows even complex bugs to be efficiently reproduced and fixed.
Continuous Delivery & QA in Low-level Apps
Automated tests, UI tests, and browser simulations without the need for a physical measurement setup.
What Makes Real-Time Video Analysis Special from a Technical Perspective
The extension for PlaytestCloud combines a modern Flutter front end with deeply integrated Windows system development—specifically for real-time audio and video data capture. The solution runs natively on Windows and combines UI convenience with high runtime performance and stable data processing in the background.
Frontend
-
Flutter + Dart: Cross-platform UI development with high-performance native rendering on Windows
-
Platform Channels (MethodChannels & EventChannels): Bridge between the Flutter interface and low-level backend for seamless communication without media interruptions
Backend & Cloud
-
Windows API + Direct3D + C++: Low-level development for high-performance media processing
-
Agora Video/Signaling SDKs: Advanced video and communication features for live streaming and recording
-
Multithreading with Mutex Architecture: Parallel processing of audio and video data streams
Key Features
-
Integration of multiple data sources into a synchronized MP4 output
-
Stable performance despite real-time processing of multiple parallel streams
-
Error analysis through targeted remote debugging and platform-specific logging
-
Architecture designed for extensibility, testability, and real-time capability
TECH BLOG
Everything you want to know
Angular: What you should know about the framework
Whether it's a patient portal, device dashboard or admin tool - Angular delivers when web applications need to be able to do more. Read here why large companies rely on it and how you can use its potential for your project.
Augmented Reality – A Magical Insight into Our Specialty
Augmented reality - A magical insight into our area of expertiseAugmented Reality (AR) refers to technology that blends the real world with virtual content, creating new forms of interactive experiences that make the physical environment come to life in unique...
Software Timing Troubles? Log Your Way to Success!
The Shock of the Year 2022: ChatGPT takes the stage and raises the question of whether AI will dominate software development. Our journey through the emotional rollercoaster of psychological phases, from denial to acceptance, is illuminated in this post by CEO Matthias. Learn how we dealt with the challenge and discover the answer we found to the crucial question. A glimpse into our journey, where we got our hands dirty and developed our own AI model.
The German Angst from a CEO perspective: What AI is not!
The Shock of the Year 2022: ChatGPT takes the stage and raises the question of whether AI will dominate software development. Our journey through the emotional rollercoaster of psychological phases, from denial to acceptance, is illuminated in this post by CEO Matthias. Learn how we dealt with the challenge and discover the answer we found to the crucial question. A glimpse into our journey, where we got our hands dirty and developed our own AI model.
How to start with AI locally on a Computer?
Discover how easy it is to start Artificial Intelligence locally on your computer! Our short guide will walk you through the steps, demonstrating how you can generate images directly on your computer without additional costs.
IONIC 101: Code your own grocery list app with ease.
Learn about developing an app with Ionic and Angular, seamlessly extending to iOS and Android. Explore benefits like Dependency Injection, service management, and Capacitor API integration for native features. Transition effortlessly from web to mobile development with our guidance, creating a versatile app across platforms.
Together, we'll create a product users genuinely love.
Our References
From Vision to Implementation
So, when can we write your success story?
