Eye Blinking Prototype Matching

Yuxuan Xie 23690bb0f1 update readme, add description 1 an în urmă
sample_experiments 9bb42808b2 fix noise scaling and remove prints 1 an în urmă
src f86fa5fcc4 remove old comments 1 an în urmă
.gitignore f5111f4990 Update .gitignore file to include packaging files 1 an în urmă
License.txt fd747e126c Update 'License.txt' 1 an în urmă
README.md 23690bb0f1 update readme, add description 1 an în urmă
setup.cfg 79611ceebd Update unsupervised experiments 1 an în urmă
setup.py 476b9a8be3 WIP prepare packing 1 an în urmă

README.md

EBPM - Eye Blink Prototype Matching

This work presents a novel method for detecting eye blinking by establishing eye state prototypes to match blink patterns within eye aspect ratio (EAR) time series. In contrast to traditional methods, which mainly focus on the binary ON/OFF of blinkings, our method takes care of important diagnostic details such as blink speed, duration as well as inter-eye synchronicity. In an unsupervised manner, we learned prototypes from the existing blink patterns and established manually defined prototypes. Our research shows that both unsupervised learned and manually defined prototypes can reliably detect blink intervals and have comparable results, which offers potential diagnostic tools for identifying muscular or neural disorders.

Under the principle of the "minimal working prototype", our aim is to establish the eye blink prototype with a minimum amount of work, enabling medical professionals without computer expertise to easily create their own prototypes to match specific patterns. This repository presents the source code of our approach and provides a demonstration in sample experiments.

Get Started

Setup

  1. clone the repository

    git clone 
    
  2. cd to EBPM

  3. setup

    conda create -n ebpm python=3.10 -y
    conda activate ebpm
    # conda install cudatoolkit -y
    pip install jupyter
    pip install -e .
    

    Usage

    Data

    Prototypes

    Experiments

Citation

TODO

License

Licensed uner MIT.

Aknowledgements

TODO: stumpy, mediapipe, jefapato, curly brace...more?

Contact

For any queries, please reach out to [Yuxuan Xie] at [yuxuan.xie@uni-jena.de] or [Tim Büchner] at [tim.buechner@uni-jena.de].