OpenGaze: Open Source Toolkit for Camera-Based Gaze Estimation and Interaction
You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
Xucong Zhang 0b9be8c13c update copyright 4 years ago
caffe-layers initial commit 4 years ago
content initial commit 4 years ago
exe initial commit 4 years ago
imgs initial commit 4 years ago
include initial commit 4 years ago
pre-complile update ignore file 4 years ago
src initial commit 4 years ago
.gitignore update ignore file 4 years ago
CMakeLists.txt.example update Cmake list 4 years ago
Copyright.txt update copyright 4 years ago
README.md add code layout to ReadMe 4 years ago
RELEASE.md initial commit 4 years ago
default.cfg add code layout to ReadMe 4 years ago
download_models.sh initial commit 4 years ago
install.sh initial commit 4 years ago

README.md

OpenGaze: Open Source Toolkit for Camera-Based Gaze Estimation and Interaction

Appearance-based gaze estimation methods that only require an off-the-shelf camera have significantly improved and promise a wide range of new applications in gaze-based interaction and attentive user interfaces. However, these methods are not yet widely used in the human-computer interaction (HCI) community.

To democratize their use in HCI, we present OpenGaze, the first software toolkit that is specifically developed for gaze interface designers. OpenGaze is open source and aims to implement state-of-the-art methods for camera-based gaze estimation and interaction.

Functionality

The toolkit is capable of performing the following gaze-related tasks:

  • Gaze Estimation Estimate and show a user's gaze on a screen in real time.

Demo

 

  • Gaze Visualization Plot gaze direction in images.

Demo

 

  • Personal Calibration Perform personal calibration and remap the gaze target on a screen.

Demo

 

Installation

Unix Installation

Use

Command line arguments

Citation

If you use any of the resources provided on this page in any of your publications, please cite the following paper:

Evaluation of Appearance-Based Methods and Implications for Gaze-Based Applications
Xucong Zhang, Yusuke Sugano, Andreas Bulling
Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), 2019

@inproceedings{zhang19_chi,
title = {Evaluation of Appearance-Based Methods for Gaze-Based Applications},
author = {Xucong Zhang and Yusuke Sugano and Andreas Bulling},
doi = {10.1145/3290605.3300646},
year = {2019},
booktitle = {Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI)},
abstract = {Appearance-based gaze estimation methods that only require an off-the-shelf camera have significantly improved but they are still not yet widely used in the human-computer interaction (HCI) community. This is partly because it remains unclear how they perform compared to model-based approaches as well as dominant, special-purpose eye tracking equipment. To address this limitation, we evaluate the performance of state-of-the-art appearance-based gaze estimation for interaction scenarios with and without personal calibration, indoors and outdoors, for different sensing distances, as well as for users with and without glasses. We discuss the obtained findings and their implications for the most important gaze-based applications, namely explicit eye input, attentive user interfaces, gaze-based user modelling, and passive eye monitoring. To democratise the use of appearance-based gaze estimation and interaction in HCI, we finally present OpenGaze (www.opengaze.org), the first software toolkit for appearance-based gaze estimation and interaction.}
}

License

The license agreement can be found in Copyright.txt

You have to respect boost, OpenFace and OpenCV licenses.

Furthermore, you have to respect the licenses of the datasets used for model training.

Code layout

  • caffe-layers: Our customized layers for the Caffe library.
  • content: Directory for storing calibration configurations, Caffe model and face model
  • exe: Example code to call the opengaze library
  • include:
    • opengaze: Directory of head files
  • pre-compiled:
    • opengaze_1.0.deb: The pre-compiled installation file
  • src: Directory of source files
  • CMakeLists.txt: CMake file to compile OpenGaze
  • default.cfg: The configuration file for setting input parameters
  • download_models.sh: Script to download the pre-trained Caffe model
  • install.sh: Script to install dependencies except for Caffe and OpenFace.
  • README.md
  • RELEASE.md: Release notes