GithubHelp home page GithubHelp logo

thu-lyj-lab / t3bench Goto Github PK

View Code? Open in Web Editor NEW
1.1K 1.0 7.0 11.91 MB

T3Bench: Benchmarking Current Progress in Text-to-3D Generation

Home Page: https://t3bench.com/

Python 100.00%
3d text-to-3d diffusion nerf

t3bench's Issues

There's a conflict in requirements.txt

When using pip install for requirement.txt, salesforce-lavis, and image-reward are in conflict when sharing the transformer. They have different requirements for the version of the transformer.

Question regarding text prompts

Hello! Thanks for your interesting work. I have a question regarding the text prompts you release in this benchmark.
I am wondering if you are providing triplets of the increasingly descriptive text prompts for every object. or if every text prompt is referring to a random object.

For example:

  • single object : "A red fire hydrant"
  • single object with surroundings: "A red fire hydrant on a sidewalk"
  • multiple objects: "A red fire hydrant is on a sidewalk close to a large tree".

Release request for mesh results of the newly added methods

Wonderful work! I've been following this work for a while and I noticed that in your latest submission for ECCV 24, several recent work like MVDream, DreamGaussian, etc. are added in the leaderboard. I'm wondering that whether the mesh results of these newly added methods can be released like the last update in 2023/10/24. I'm planning to leverage these mesh results as part of my dataset. I'll be very appreciated for their release. Overall, T3Bench is truly a contributing work and wish your submission for ECCV be accepted ASAP.
Thanks again! And look forward to your reply.

Question regarding the alignment scores

If I get an average alignment score 3,
then the normalized score is 3/5x100 = 60
or (3-1)/4x100 = 50 ?
Currently based on your paper sec 4.2, I assume the second calculation is correct.
Is that right?

Submit results on t3bench

Hello, thank you for providing a comprehensive benchmark for 3D generation. I am the author of GaussianDreamer and I would like to know how to submit our results on T3bench. Here are our results.

Single Obj. ** Single w/ Surr.** Multi Obj. Average
54.0 48.6 34.5 45.7

Generation time

Hello, this is a wonderful job. I would like to know the generation time of these methods (ProlificDreamer, SJC, Fantasia3D, LatentNeRF, Magic3D, Dreamfusion) in the paper?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.