# Map and visualize gaze onto multiple reference images taken from the same environment

In the Reference Image Mapper guide, we learnt how to properly set up a Reference Image Mapper enrichment, with a single reference image. However, there are some cases in which it would be useful to map gaze onto multiple reference images taken from the same environment - for example, moving in a room while interacting with certain parts of it.

Before continuing, ensure you are familiar with the Reference Image Mapper enrichment. Check out this explainer video for reference.

# Reference Images

First, we will take pictures of the areas and/or furniture of the room we are interested in.

# Scanning recordings

In this guide, we want to map gaze onto different parts of a living room, for this reason, we recorded two scanning videos. We chose to use more than one scanning recording because the environment is a bit too big to be effectively scanned just by a single one.

Based on the environment dimension/complexity, you might need to do the same and record separate scanning videos.

Please follow our best practices for optimal scanning.

To ensure good scanning of big plain surfaces - like tables and kitchen countertops - enrich them with features. Use a printed tablecloth and/or place items to produce a successful mapping!

Scanning Recording Duration

Please record a scanning video that is less than 3 minutes long!

The Reference Image Mapper enrichment does not accept longer recordings.

# Run the enrichments

Here we recorded just one video where the wearer was asked to walk and freely explore the living room. Now it is time to map the subject's gaze from this video into the five pictures above.

During the recording, the user looked at the same furniture and parts of the room multiple times. We suggest you focus on specific sections of the recording based on which part of the room the user is exploring.

For this recording, we used the following event annotations to run five Reference Image Mapper enrichments:

Cupboard: cupboard.begin and cupboard.end
Desk: desk.begin and desk.end
Kitchen: kitchen.begin and kitchen.end
TV: tv.begin and tv.end
Table: table.begin and table.end

# Final results

It may take several minutes to run these enrichments depending on how long your recordings are. Once everything is finished, you can visualize how gaze is simultaneously mapped both on the recording and the reference images from the Project Editor view (as shown in the video at the very beginning of this guide).

From the Enrichment view, you can visualize heatmaps of each reference image:

That's it. We look forward to seeing your own mapped environments!

Back