Detect and classify human behaviour using gaze and context.

Real-Time Eyelid Dynamics with PERCLOS and Neon
Calculate PERCLOS (percentage of eye closure) in real time using Neon and its Real-Time API.

Audio-Based Event Detection With Pupil Cloud and OpenAI's Whisper
Automatically annotate important events in your Pupil Cloud recordings using Neon's audio capture and OpenAI's Whisper.

Automate Event Annotations With Pupil Cloud and GPT
Automatically annotate important activities and events in your Pupil Cloud recordings with GPT-4o.

Build an AI Vision Assistant
Experiment with assistive scene understanding applications using GPT-4V (an extension of GPT4 that can interpret images) and Pupil Labs eye tracking.

Detect Eye Blinks With Neon
Apply Pupil Labs blink detection algorithm to Neon recordings programmatically, offline or in real-time using Pupil Labs real-time Python API.