What we are building

Four apps, one shared methods stack.

Two apps are live: Grovalin for concept-generalization learning, and Volitiq for research-grade motor phenotyping. Two more (WAVE and PULSE) are in active development under the HEARTH program, extending the lab's work from the clinic into the home. Each app draws from a shared methods stack (computer vision, deep learning, LLMs and NLP, and rigorous statistical modelling), chosen per problem rather than picked from a single playbook.

Active

Grovalin

grovalin.com · concept-generalization learning

The challenge. Children with autism often struggle to understand that the same word (e.g. "chair") applies to objects that look different — the concept-generalization gap.[Tager-Flusberg & Kasari, 2013] Traditional learning materials use generic stock images that don't match a child's actual home environment.

The approach. Grovalin turns familiar objects from a child's home into personalised learning material. Caregivers upload home videos; an open-vocabulary computer-vision pipeline extracts and segments objects and generates caregiver-approved variations, surfaced through four modules — ObjectWorld, ConnectWorld, StoryWorld and LifeSkills.

Open-vocabulary CV Home-video object extraction Caregiver two-gate verification Privacy-first

PECS-phase-gated[Bondy & Frost, 1994] and VB-MAPP-aligned[Sundberg, 2008] — a learning tool, not a diagnostic instrument.

Active

Volitiq

volitiq.com · motor phenotyping

The challenge. Motor coordination differences are well documented in autism,[Fournier et al., 2010] and fine-grained "micro-movements" carry real signal,[Torres et al., 2013] but measuring them objectively has meant expensive equipment and trained specialists — gating research to a small set of clinics.

The approach. Volitiq turns any device with a camera into a research-grade motor assessment tool. On-device pose estimation[Lugaresi et al., 2019] analyses standard webcam video and computes 40+ interpretable kinematic features across seven motor-control domains, with transparent statistics — no specialist hardware required.

MediaPipe pose 40+ features · 7 domains Browser-native No specialised hardware

A research platform, not a diagnostic medical device. Descended from the autism-focused E-MotionSpec project.

The HEARTH program

Passive sensing for the home

HEARTH (Home Environment Ambient sensing for Real-Time Health) is a research program for passive, contact-free monitoring of older adults and people with disabilities. It rejects the trade-off that current home monitoring asks of vulnerable people: wear a device, accept a camera, step on a mat in order to be cared for.

HEARTH operates two complementary modalities. WAVE reads the body from radio. PULSE reads it from light. Their physical principles set their blind spots against each other in useful ways.

Proposed · part of HEARTH

WAVE

WiFi Ambient Vitality and Event-detection

Every modern WiFi link carries a continuous estimate of the wireless channel, called Channel State Information (CSI), that is sensitive to every scattering object in the link's environment, the human body included. WAVE reads CSI to recover motion, posture, gait, falls, occupancy, and coarse respiratory rate, with no camera, no wearable, and no microphone.

Built on the cross-modal supervision paradigm behind Person-in-WiFi and DensePose-from-WiFi. Forward-compatible with IEEE 802.11bf (ratified October 2024), so the same algorithms run on commodity 802.11bf silicon as it ships.

Falls · 94–99% in controlled trials Gait speed & variability Occupancy Resp. rate ±2 bpm
Full science & roadmap →
Proposed · part of HEARTH

PULSE

Passive Unobtrusive Light-based Signal Extraction

Each heartbeat sends a bolus of hemoglobin into cutaneous microcirculation, producing a small but predictable modulation of skin colour (0.5 to 2% of mean reflectance) that is below the threshold of human perception but recoverable from ordinary RGB video. PULSE extracts a continuous pulse waveform from face or hand and derives heart rate, heart rate variability, and respiratory rate.

Where WAVE penetrates walls but cannot resolve a heartbeat, PULSE resolves the heartbeat exquisitely but needs the person in the camera's field of view. Operated together, they cover each other's blind spots. Built on state-of-the-art rPPG methods (PhysFormer, CodePhys, Spiking-PhysFormer).

HR ±1–3 bpm HRV (RMSSD, pNN50) Resp. rate ±2 bpm Sleep & stress proxies
Full science & roadmap →

Roadmap

What's next

Beyond the four apps above, the lab is exploring further AI tools in adjacent areas.

Planned

Speech Pattern Analysis

AI-powered analysis of speech patterns, prosody, and communication style to support research and therapy.

Exploring

Emotion Recognition Support

Tools to help children learn to recognise and understand emotions through interactive AI-guided practice.

Help us build the future

Whether you are a developer, researcher, clinician, or family member, your contribution matters.