eye_mouse

an application for windows that allows for your eyes to act as your computers mouse.

MVP

1. Machine Vision - eye detection and monitoring
2. Application for windows that has permissions of a mouse.
3. eye to screen translation. need to calculate distance between person and screen. and camera to screen corner

Current TODO

• Creating a script that retrieves eyes, face, and mouse click locations

• making model that predicts locations for click

• make topics for communicating

• need to incorporate former position of mouse to make mouse movement fluid

• need better open and close eye identifier (current not performing well)

machine vision

• detect eyes using openCV.

• single eye closed detection based on previous eye locations.

• returns state of eyes with 1 (open) or 0 (closed)

• potentially learn where a person is looking based on real-time training

  • random dot generator and look at the dot and hit a button
  • train the model with location of dot and eye imageS

Windows/Mac Applications

Eye2Screen

• calibration angle of eyes with respect to corner in x and y axis?

Finished

MV

• eye and face images class
• getting mouse click location

ML model for determining mouse location based off of eyes and face

Models to implemement

Testing data