# Map and visualize gaze onto multiple reference images taken from the same environment
In the Reference Image Mapper guide, we learnt how to properly set up a Reference Image Mapper enrichment, with a single reference image. However, there are some cases in which it would be useful to map gaze onto multiple reference images taken from the same environment - for example, moving in a room while interacting with certain parts of it.
Before continuing, ensure you are familiar with the Reference Image Mapper enrichment. Check out this explainer video for reference.
# Reference Images
First, we will take pictures of the areas and/or furniture of the room we are interested in.
![]() | ![]() |
---|---|
![]() | ![]() |
![]() |
# Scanning recordings
In this guide, we want to map gaze onto different parts of a living room, for this reason, we recorded two scanning videos. We chose to use more than one scanning recording because the environment is a bit too big to be effectively scanned just by a single one.
Based on the environment dimension/complexity, you might need to do the same and record separate scanning videos.
Please follow our best practices for optimal scanning.
To ensure good scanning of big plain surfaces - like tables and kitchen countertops - enrich them with features. Use a printed tablecloth and/or place items to produce a successful mapping!
Scanning Recording Duration
Please record a scanning video that is less than 3 minutes long!
The Reference Image Mapper enrichment does not accept longer recordings.
# Run the enrichments
Here we recorded just one video where the wearer was asked to walk and freely explore the living room. Now it is time to map the subject's gaze from this video into the five pictures above.
During the recording, the user looked at the same furniture and parts of the room multiple times. We suggest you focus on specific sections of the recording based on which part of the room the user is exploring.
For this recording, we used the following event annotations to run five Reference Image Mapper enrichments:
- Cupboard:
cupboard.begin
andcupboard.end
- Desk:
desk.begin
anddesk.end
- Kitchen:
kitchen.begin
andkitchen.end
- TV:
tv.begin
andtv.end
- Table:
table.begin
andtable.end
# Final results
It may take several minutes to run these enrichments depending on how long your recordings are. Once everything is finished, you can visualize how gaze is simultaneously mapped both on the recording and the reference images from the Project Editor view (as shown in the video at the very beginning of this guide).
From the Enrichment view, you can visualize heatmaps of each reference image:
![]() | ![]() |
---|---|
![]() | ![]() |
![]() | ![]() |
![]() | ![]() |
![]() | ![]() |
That's it. We look forward to seeing your own mapped environments!