Comments (5)
Actually, this model does not need 8 V100, you can simply comment the codes in the three python files which judge if you have 8 V100 to run this project. It takes about 20 hours to train the model on a single RTX3090.
from jax3d.
@njfugit I have worked out how to get all of the files needed for a pre-trained model.
If you want to download the models for your own use you can get files via this url for synthetic scenes: storage.googleapis.com/jax3d-public/projects/mobilenerf/mobilenerf_viewer/[object_name]_phone/ where [object_name] is the name of the object you are downloading weights for, and this url for all non-synthetic scenes: storage.googleapis.com/jax3d-public/projects/mobilenerf/mobilenerf_viewer_mac/[object_name]_mac/
For each scene you will need an mlp.json file, N .obj files (where N is determined by the 'object_num' key inside mlp.json), and N*2 .png files (2 files for each object_num)
The mlp.json file is at /mlp.json. This contains the mlp weights, and will tell you how many objects there are for a given scene under the key ['object_num']. Using the number of objects you can then get the obj and png files. The obj files will be at /shape[object_num].obj
The png files will be at /shape[obj_num].pngfeat0.png and /shape[obj_num].pngfeat1.png
All of these files should then be stored in a directory named '/[obj_name]_phone' inside your mobilenerf directory.
As a concrete example, if you wish to get the pretrained models for the chair scene, you will need to do the following:
Create directory:
cd mobilenerf
mkdir chair_phone
cd chair_phone
Download mlp weights:
wget https://storage.googleapis.com/jax3d-public/projects/mobilenerf/mobilenerf_viewer/chair_phone/mlp.json
Note the number of objects - the chair mlp.json file has "obj_num":2, so 2 objects.Download your obj files:
wget https://storage.googleapis.com/jax3d-public/projects/mobilenerf/mobilenerf_viewer/chair_phone/shape0.obj
wget https://storage.googleapis.com/jax3d-public/projects/mobilenerf/mobilenerf_viewer/chair_phone/shape1.obj
Download your png files:
wget https://storage.googleapis.com/jax3d-public/projects/mobilenerf/mobilenerf_viewer/chair_phone/shape0.pngfeat0.png
wget https://storage.googleapis.com/jax3d-public/projects/mobilenerf/mobilenerf_viewer/chair_phone/shape0.pngfeat1.png
wget https://storage.googleapis.com/jax3d-public/projects/mobilenerf/mobilenerf_viewer/chair_phone/shape1.pngfeat0.png
wget https://storage.googleapis.com/jax3d-public/projects/mobilenerf/mobilenerf_viewer/chair_phone/shape1.pngfeat1.png
You can then run your own http server from your /mobilenerf directory as instructed in README.md
I've only tested this fully for one example, but it looks like it will hold for the others. If you find something doesn't work for a different scene ping me and hopefully we can workout what the correct URL would be. It's also worth noting that the code uses WebGL, so if you're interested in seeing performance on your own machine you don't need to do any of this. If you just load the viewer on the project website all the graphics will be done locally on your own GPU.
@DWhettam Thanks a lot for your reply, it works.
from jax3d.
You can find all the pretrained models in the online demos in our project page https://mobile-nerf.github.io
You can also download them and run them locally. (You will need some html knowledge to download them.)
from jax3d.
You can find all the pretrained models in the online demos in our project page https://mobile-nerf.github.io
You can also download them and run them locally. (You will need some html knowledge to download them.)
Hello, I am not very knowledgeable about html. Where to download the network_weights in the webpage code, what is the specific download link, can you give an example?
from jax3d.
@njfugit I have worked out how to get all of the files needed for a pre-trained model.
If you want to download the models for your own use you can get files via this url for synthetic scenes: storage.googleapis.com/jax3d-public/projects/mobilenerf/mobilenerf_viewer/[object_name]_phone/ where [object_name] is the name of the object you are downloading weights for, and this url for all non-synthetic scenes: storage.googleapis.com/jax3d-public/projects/mobilenerf/mobilenerf_viewer_mac/[object_name]_mac/
For each scene you will need an mlp.json file, N .obj files (where N is determined by the 'object_num' key inside mlp.json), and N*2 .png files (2 files for each object_num)
The mlp.json file is at /mlp.json. This contains the mlp weights, and will tell you how many objects there are for a given scene under the key ['object_num']. Using the number of objects you can then get the obj and png files.
The obj files will be at /shape[object_num].obj
The png files will be at /shape[obj_num].pngfeat0.png and /shape[obj_num].pngfeat1.png
All of these files should then be stored in a directory named '/[obj_name]_phone' inside your mobilenerf directory.
As a concrete example, if you wish to get the pretrained models for the chair scene, you will need to do the following:
Create directory:
cd mobilenerf
mkdir chair_phone
cd chair_phone
Download mlp weights:
wget https://storage.googleapis.com/jax3d-public/projects/mobilenerf/mobilenerf_viewer/chair_phone/mlp.json
Note the number of objects - the chair mlp.json file has "obj_num":2, so 2 objects.
Download your obj files:
wget https://storage.googleapis.com/jax3d-public/projects/mobilenerf/mobilenerf_viewer/chair_phone/shape0.obj
wget https://storage.googleapis.com/jax3d-public/projects/mobilenerf/mobilenerf_viewer/chair_phone/shape1.obj
Download your png files:
wget https://storage.googleapis.com/jax3d-public/projects/mobilenerf/mobilenerf_viewer/chair_phone/shape0.pngfeat0.png
wget https://storage.googleapis.com/jax3d-public/projects/mobilenerf/mobilenerf_viewer/chair_phone/shape0.pngfeat1.png
wget https://storage.googleapis.com/jax3d-public/projects/mobilenerf/mobilenerf_viewer/chair_phone/shape1.pngfeat0.png
wget https://storage.googleapis.com/jax3d-public/projects/mobilenerf/mobilenerf_viewer/chair_phone/shape1.pngfeat1.png
You can then run your own http server from your /mobilenerf directory as instructed in README.md
I've only tested this fully for one example, but it looks like it will hold for the others. If you find something doesn't work for a different scene ping me and hopefully we can workout what the correct URL would be. It's also worth noting that the code uses WebGL, so if you're interested in seeing performance on your own machine you don't need to do any of this. If you just load the viewer on the project website all the graphics will be done locally on your own GPU.
from jax3d.
Related Issues (20)
- There is no render_semantic_lib file
- Testing Nesf
- MultiNerf Result Samples HOT 3
- Deeplab v3 pretrained model
- Using eight A40GPUs to run the real360 model, the result is not ideal HOT 1
- Massive difference between stage3 psnr and the resulting mesh HOT 1
- Has anyone tried rendering multiple models at the same time๏ผ HOT 1
- NeSF dataset ground truth labels
- test result HOT 1
- .
- Will subjective results on datasets be published? HOT 2
- [MobileNerf] Integrating result to unity or omniverse HOT 1
- MobileNeRF Inference on server side GPU
- Running MobileNeRF on non-GPU server HOT 5
- Creating custom nerf model and use it in ue5 using single 3080, Is it workable?
- Trained model for mobilenerf
- How do I generate a dataset for real 360? HOT 3
- Installation Issue from flax vs jax compatibility HOT 4
- How to train? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ๐๐๐
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google โค๏ธ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from jax3d.