Comments (8)
I actually not sure training on 3 classes alone will guarantee you a performance boost. Can I get a bit more insight? When you are fine-tuning, you said mAP was not increased. Is there a performance drop or it maintains the same?
from h3dnet.
For "check with my test data", you mean your customized data right? Your input sampling strategy may make a difference. You can try one sampling, fix your input and test multi-times on the pretrained model. If the results vary a lot, it means that there are something unstable in the pretrained model. If the results do not vary a lot, it means that your input sampling strategy is unstable.
When I was testing with ScanNet/SUNRGBD, the results vary a little bit across each run. (around 1%)
from h3dnet.
What is your sampling method? For pointcloud, the common practice is to use furthest point sampling. If you are not using that, I would suggest you try that. In addition, you can also try larger input point cloud size. For 5m, maybe you can try 80k and 100k points. Hope it helps!
from h3dnet.
If you are using numpy.random.choice, I would highly suggest you use the furthest point sampling method. I am confident that it may cause the issue. Pointnet can take variable sized input. You do not need to sample to 40k for it to work.
from h3dnet.
@zaiweizhang : thank you very much for your suggestion. I will try to use the furthest point sampling method. Have a nice weekend.
from h3dnet.
Hi bro @zaiweizhang , thank you so much. I found my issue, first time I use load weights with strict=False as suggest of Pytorch author. But It dose not work (map decrease strongly ). So I try to load weights layer by layer , and drop all layer dose not match with your pretrained model. after finetuning mAP (IOU 0.5) increases 4% vs your model.
But when I check with my test data, the model is not stable, same point cloud data, but when I repeated to run, the results are very different, some good, some bad. I think maybe because of sample point cloud to 40k, but do you think so ? Do you think any solution for having stable good results on test data. If I fix seed , it maybe stable but not sure it will be good results.
Thank you very much.
from h3dnet.
@zaiweizhang :you are correct, I tested with custom data. I understand your point, in my case my original is point cloud data consisting of 5m points, if I fix the sampling strategy ( I fix the seed) the result is stable. So I think the instability comes from sampling the data from the original data. Because my data consists of 5m points, after sample to 50k points, sometimes the model predicts well, sometimes the model predicts bad. Do you have ideas/suggestions for me to fix this?
Thank you very much.
from h3dnet.
@zaiweizhang : Thank you very much . Currently I only use numpy.random.choice to make point sampling, maybe I should try other algorithm for sample point. I will also try more like 80k or 100k sampling points, but my concern is the model was trained on data with 40k point cloud, so if I use the model to test for data 100k points, the input must be sample to 40k points to be able to fit to model, am I right ?
from h3dnet.
Related Issues (20)
- How to use H3DNet on custom dataset? HOT 4
- Request for trained models. HOT 3
- Doubt regarding heading angle and box sizes !! HOT 5
- Evaluating on custom data/images HOT 6
- OSError: /lib/x86_64-linux-gnu/libm.so.6: version `GLIBC_2.27' not found HOT 12
- ImportError: Could not import _ext module. HOT 13
- Performance of a model with single backbone HOT 6
- Can you share with us pretrained model ? HOT 3
- Questions on implementation details HOT 4
- Question about data augmentation on ScanNet HOT 1
- RuntimeError: Expected isFloatingType(grads[i].type().scalarType()) to be true, but got false HOT 5
- RuntimeError: Error(s) in loading state_dict for DataParallel: HOT 2
- Train H3DNet on Stanford 3D-Semantics Dataset HOT 4
- viewpoint.json HOT 17
- Error when train on sunrgbd HOT 3
- Visualizations HOT 2
- Problems for pre-processed data HOT 1
- One inplace error HOT 1
- Pre-train model for H3DNet?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from h3dnet.