Alpha Lab

Audio-Based Event Detection With Pupil Cloud and OpenAI's Whisper

Automatically annotate important events in your Pupil Cloud recordings using Neon's audio capture and OpenAI's Whisper.

Map Gaze Onto an Alternative Egocentric Video

Automatically map gaze from Neon scene camera to an alternative concurrent egocentric video.

Automate Event Annotations With Pupil Cloud and GPT

Automatically annotate important activities and events in your Pupil Cloud recordings with GPT-4o.

IMU Transformations

Transform IMU data into different representations and coordinate systems with these code snippets.

Map Gaze Into a User-Supplied 3D Model

Map gaze, head pose, and observer position into a 3D coordinate system of your choice using our Tag Aligner tool.

Map Gaze Onto Website AOIs

Define areas of interest on a website and map gaze onto them using our Web-AOI tool.

Map Gaze Onto Facial Landmarks

Map gaze onto facial landmarks using Pupil Cloud’s Face Mapper exported data.

Automate AOI Masking in Pupil Cloud

Extend the capabilities of Pupil Cloud’s AOI tool by automatically segmenting and drawing masks using natural language.

Build an AI Vision Assistant

Experiment with assistive scene understanding applications using GPT-4V (an extension of GPT4 that can interpret images) and Pupil Labs eye tracking.

Detect Eye Blinks With Neon

Apply Pupil Labs blink detection algorithm to Neon recordings programmatically, offline or in real-time using Pupil Labs real-time Python API.

Build Gaze-Contingent Assistive Applications

Build your very own gaze-contingent assistive applications (such as a gaze-controlled input device) using Neon eye tracking and our real-time screen gaze package.

Map Gaze Onto a 3D Model of an Environment

Map gaze onto a 3D model of an environment and visualise gaze patterns as 3D heatmaps using Pupil Cloud's Reference Image Mapper and Nerfstudio.

Uncover Gaze Behaviour on Phones

Capture and analyze users' viewing behaviour when focusing on small icons and features of mobile applications using Neon eye tracking alongside existing Cloud and Alpha Lab tools.

Generate Scanpath Visualisations

Generate both static and dynamic scanpath visualisations using exported data from Pupil Cloud's Reference Image Mapper or Manual Mapper.

Map Gaze Throughout an Entire Room

Use Pupil Cloud's Reference Image Mapper to Map gaze onto multiple areas of an entire room as participants freely navigate around it.

Map Gaze Onto Body Parts

Map gaze behaviour on body parts that appear in the scene video of Neon or Pupil Invisible eye tracking footage.

Map Gaze Onto Dynamic Screen Content

Map and visualise gaze onto a screen with dynamic content, e.g. a video, web browsing, or other, using Pupil Cloud's Reference Image Mapper and screen recording software.

Use Neon with Pupil Capture

Use your Neon module as if you were using Pupil Core. Connect it to a laptop, and record using Pupil Capture.

Undistort Video and Gaze Data

Learn how to undistort the scene camera distortions and apply it to gaze positions.