hyunuk / blinkr

Blinkr is the Chrome Extension that detects eye blink and notify users to prevent their eye dry out.

Hi there, I'm Hyunuk /hjʌn.ʊk/ 👋

Hyunuk is a developer advocate working in Google.

• 🌱 I’m currently learning everything regarding GCP.
• 💬 Ask me about anything if you want to know about me!
• 📫 How to reach me: Request a meeting via Calendly
• 😄 Pronouns: He/Him
• ⚡ Fun fact: I love traveling and have traveled around a world!

blinkr's Issues

Improve process by skipping <video> element.

Currently, the current process is like this:

• Capturing video from the webcam
• Sending video stream to html
• Displaying on the html
• detecting face using face-api.js

For the third process, we need to output the video on the html, this app requires opening at least one tap.

I would like to improve the process using createCanvasFromMedia method in the face-api.js, which can make using face-api without the

Improvement: run without app.js

Currently, the app requires at least one tab.
We will investigate running the app in the background.

Prototyping the counter

• Create a button using JS
• when a user clicks a button, increment the counter
• shows the number of clicks within 60 seconds.

offscreen doesn't work

The main task after we completed the hackathon was hiding the video and make it work in the background.
I found the chrome.offscreen api so that it worked in the local, but it doesn't work when I published it.
This is due to the bug reported in here and it haven't been resolved yet.

So I will work on opening a new tab, which was our initial design, but without video explicitly.

Face recognition using OpenCV

• Using OpenCVjs, the app can recognize a person's face.
• recognize a person's eye
• recognize a person's eye blink
• count the number of blinking with the timestamp

delete content.js from the content script.

Using content scripts requires host permission in a matched websites.
The problem is that adding host permission requires an in-depth review and will delay publishing.

UX improvement: change icon

We will remove the current html file and the app will be run in the background.
To do this, we will change the icon color if the blink count is low, especially less than 5/min for red and 12/min for yellow.
Also, the notification needs to be investigated.

Setting up the repo

create necessary files for the chrome extension