GithubHelp home page GithubHelp logo

jackyluo1991 / face-skin-hair-segmentaiton-and-skin-color-evaluation Goto Github PK

View Code? Open in Web Editor NEW
177.0 10.0 42.0 4.35 MB

segmentation and color classification

License: Apache License 2.0

Python 100.00%

face-skin-hair-segmentaiton-and-skin-color-evaluation's Introduction

HLNet: A Unified Framework for Real-Time Segmentation and Facial Skin Tones Evaluation

Abstract:

Real-time semantic segmentation plays a crucial role in industrial applications, such as autonomous driving, the beauty industry, and so on. It is a challenging problem to balance the relationship between speed and segmentation performance. To address such a complex task, this paper introduces an efficient convolutional neural network (CNN) architecture named HLNet for devices with limited resources. Based on high-quality design modules, HLNet better integrates high-dimensional and low-dimensional information while obtaining sufficient receptive fields, which achieves remarkable results on three benchmark datasets. To our knowledge, the accuracy of skin tone classification is usually unsatisfactory due to the influence of external environmental factors such as illumination and background impurities. Therefore, we use HLNet to obtain accurate face regions, and further use color moment algorithm to extract its color features. Specifically, for a 224 × 224 input, using our HLNet, we achieve 78.39% mean IoU on Figaro1k dataset at over 17 FPS in the case of the CPU environment. We further use the masked color moment for skin tone grade evaluation and approximate 80% classification accuracy demonstrate the feasibility of the proposed method.

The latest open source work:

https://github.com/JACKYLUO1991/FaceParsing.

Problem correction:

It is worth noting that some training sets are mistaken for test sets in image file copying, which leads to high results in arXiv. The current version has been corrected.

Demos

raw

Please cited:

@article{feng2020hlnet,
  title={HLNet: A Unified Framework for Real-Time Segmentation and Facial Skin Tones Evaluation},
  author={Feng, Xinglong and Gao, Xianwen and Luo, Ling},
  journal={Symmetry},
  volume={12},
  number={11},
  pages={1812},
  year={2020},
  publisher={Multidisciplinary Digital Publishing Institute}
}

face-skin-hair-segmentaiton-and-skin-color-evaluation's People

Contributors

jackyluo1991 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

face-skin-hair-segmentaiton-and-skin-color-evaluation's Issues

Backbone network used

Which backbone segmentation network is being used in each model(Trained with different datasets)?
Thanks

CelebA数据集

你好:
最近再阅读您的paper以及代码。能否将文章中提到的CelebA的子集3556张图片以及对应标签发送给我一份,我在网络上没有找到公开资源,谢谢。
另外,您在文章中提到的手工标准的人脸肤色数据集是否考虑公开呢?

data_loader

hello~
Thanks for your reply to me.
Another question I want to ask you is that you have said "Train three models on three different datasets", and the code is about CelebA datasets, so I want to know how you preprocess the LFW and Figaro1k datasets? Could you offer the related "data_loader" code?
Thank you a lot!

Pretrained model ?

Hi, Thanks for your work! It looks like very funny !
could you share your pre-trained model ? I want to test how nice it is ! I'm glad to see it !

labeled datasets

hello~
Thank you for sharing this wonderful work.
Just now, I'm reading your paper and i have a question that how you labeled the datasets ? Or just used the method "via a super-pixel segmentation algorithm." mentioned in the LFW dataset' description?
In addition, could you offer me some suggtions about how to label the datasets?

请问对于“头发”和“人脸”的识别需要分别进行对应的训练,生成两个模型吗?

目前使用experiments中给出的“照片/脸部区域”的模式对模型进行了训练,模型只能识别到人脸部分。
我想请问下大佬,对于头发部分的识别是需要给到头发区域的训练数据进行二次训练,最后使用两个模型进行对于人脸、头发部分的分别识别吗?
还是有什么训练方法可以一次训练就可以分别识别出脸和头发呢?
谢谢大佬的解答!这个程序做的非常棒!

Question regarding how to run the code

I've been studying your GitHub repository Face-skin-hair-segmentation-and-skin-color-evaluation, I am very interested in this project but I don't know how to run the code. Would you please explain a bit to me?

Training dataset used

Thank you for sharing this wonderful work.

The paper mentions that the data is being acquired from 3 different sources:

  1. LFW subset : 2927 Images, 1500 used for training
  2. CelebA subset : 3556 Images, As in "A Deep Learning Approach to Hair Segmentation and Color
    Extraction from Facial Images"
  3. Figaro1k : Only those images which have faces are used, 171 Images

I could not understand how you used these datasets to train the model. Do you combine them to make one single set of training data, or do you train separate models?
Sorry , if this is a silly question, I could not understand the training procedure from the paper.

Another question that I have is , Nowhere in this code I could find a face detector which would select images from Figaro1k which contain images.

Your help would mean a lot. Thanks

pipline_test.py

hello~
Today I find that the path blow which was written in the pipline_test.py
clf = joblib.load('./experiments/skinGrade/skinColor.pkl'), I just didn't find it, so I want to know
how did this .pkl file generated?

Dataset for skin color classification

Can you please provide the link to the manually annotated face skin tone grading dataset.
I am working on a similar project and the dataset might be useful for me.
Thank You

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.