Immersive Healthcare
This project demonstrates a pioneering application of Immersive Analytics in healthcare, utilizing the Microsoft HoloLens and Qlik Sense to provide medical professionals with heads-up, hands-free data visualization in the field. Designed for emergency response and triage, the system transforms flat patient data into a persistent 3D interface. By leveraging gesture-based interactions and voice commands, doctors and nurses can dynamically filter patient populations based on complex comorbidities—such as diabetes and age—allowing for rapid, data-informed triage without losing focus on the physical environment.
A core innovation of the system is its ability to ground virtual data in the physical world through Augmented Reality (AR) object tracking. In a mass-casualty or triage scenario, the system recognizes physical triage tags as markers; as a clinician brings a tag into view, relevant patient data objects are instantly anchored to it. These visualizations follow the patient as they move through the treatment pipeline, ensuring that critical medical history and risk scores remain spatially attached to the individual. To further reduce cognitive load during high-stress situations, the platform integrates Natural Language Generation (NLG) and text-to-speech to provide immediate, verbal summaries of diagnostic insights.
About Todd
My research represents a formal inquiry into the friction between users and data. By architecting novel hardware and algorithms, these projects establish new benchmarks for how we visualize and interact with massive, multi-dimensional datasets.
Learn More