Comments (10)
I actually get even more, I get 195 outputs, which corersponds to 5values for 39 keypoints. I have not yet found out what the 5th value is for. I have been looking into other things since, but initial results for display were more or less OK when interpreting the 195 values as 39x5 array and taking the first two columns as X/Y values. If you have 156, just use 39x4, it should be fine.
from pinto_model_zoo.
The following implementation is helpful. It doesn't seem to be necessary to use all the key points.
https://github.com/terryky/tfjs_webgl_app/tree/master/blazepose_fullbody
from pinto_model_zoo.
It is closed due to lack of progress.
from pinto_model_zoo.
In case this is still of interest: the model card might help a little.
Output(s)
33x3 array corresponding to (x, y, visibility). X, Y
coordinates are local to the region of interest and range
from [0.0, 255.0]. Visibility is in the range of [min_float,
max_float] and after user-applied sigmoid denotes the
probability that a keypoint is located within the frame. It
does not indicate whether the keypoint is occluded by
another body part.
although various sources state that
a) there are in fact 39kp (33+6 "technical" ones describing center, rotation and ROI)
b) each keypoint has in fact 4 values (x, y, z, visibility), but z-estimation is currently not really well implemented and should not be used in production.
from pinto_model_zoo.
Hi @Laubeee @PINTO0309 , I am facing same problem in Visualization of those 156 keypoints . Can you please help me out
from pinto_model_zoo.
Cool @Laubeee ! Let me try it then :).
from pinto_model_zoo.
I have tried plotting the points as suggested by @Laubeee but seems like the points are not accurate.
def convert_preds_to_xy(preds):
kpts = []
temp = preds[2][0]
for x,y in zip(temp[::4] , temp[1::4]):
kpts.append((int(x),int(y)))
return kpts
When I run the script 11_pose_landmark_full_body_tflite2h5_weight_int_fullint_float16_quant.py
which generates 2 .H5 file which are
full_pose_landmark_39kp.h5
full_pose_detection.h5
Also I have lot of -ve points as a predictions
and I am using full_pose_landmark_39kp.h5
. I believe I am not using the right weights file , @PINTO0309 can you please share/suggest me the right weights file ?
from pinto_model_zoo.
Looks like you figured it in that other thread, might I ask what was the problem?
from pinto_model_zoo.
Hi @Laubeee !
I had 2 problems . The very first one you have solved ( I had 156 points as an predicted output , so I took X/Y pairs as you suggested and it worked )
The 2nd one is visualization. I have developed a code snippet , you can access it from here : #76 (comment)
from pinto_model_zoo.
Hi @Laubeee !
Perhaps you can help me with my issue.
I used BlazePose and I'm training on my new specific dataset (30 k labeled images), but after some epochs and usage of Early Stopping, I have obtained a model, which get me in output (on test set) always the same values (numbers of coordinates) for any image.
What do you think about this? Perhaps, you can propose some ways for the solution of this issue.
from pinto_model_zoo.
Related Issues (20)
- Zoedepth ONNX conversion Script HOT 3
- gfpgan coreml model HOT 1
- License of RAFT models HOT 3
- Script to convert RAFT models HOT 3
- Blazeface onnx model HOT 1
- BodyPix on MacOS - Dilation not supported for AutoPadType::SAME_UPPER or AutoPadType::SAME_LOWER HOT 8
- TOPK operator for RKNN export HOT 1
- InstructIR
- 064_Dense_Depth seems to have wrong dimensions HOT 1
- Midas2 model on coral edge TPU HOT 1
- Difference on model outputs (tflite, openvino IR, and Onnx) in model 227_face-detection-adas-0001 HOT 1
- bad results for 342_ALIKE HOT 1
- Aborted (core dumped) for full quantized tinyhitnet model
- 091_gaze-estimation-adas-0002 network HOT 1
- Release new 303_FAN with heatmaps HOT 3
- dataset HOT 1
- 410_FaceMeshV2 quantized tflite models are not functional HOT 1
- 053_BlazePose / 058_BlazePose_Full_Keypoints source HOT 3
- How to retrain simple MLP (palm_detection_full_inf_post_192x192.onnx) model with custom hand dataset ? HOT 2
- How to retrain simple MLP (palm_detection_full_inf_post_192x192.onnx) model with custom hand dataset ? HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pinto_model_zoo.