GithubHelp home page GithubHelp logo

talsperre / infer Goto Github PK

View Code? Open in Web Editor NEW
53.0 53.0 20.0 185.02 MB

The code & datasets for the paper INFER: INtermediate representations for FuturE pRediction

Home Page: https://talsperre.github.io/INFER/

License: MIT License

Python 47.71% Jupyter Notebook 52.29%

infer's People

Contributors

junaidcs032 avatar krrish94 avatar talsperre avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

infer's Issues

Discrepancy of the model performance in KITTI dataset

Hi Shashank,

I run the infer-main.ipynb. By default, it is using INFER-Skip (Top 5) in the KITTI dataset, but the result that I get is

1s: 2.209328362278883, 2s: 2.9157824738774303, 3s: 3.683025655408532, 4s: 5.294841714296214

I believe this is the same ADE metric that you used in Table 1 of your paper, but why the ADE here is significantly worser than what your paper recorded? How should I replay the result in the paper?

Regards,
DK

The right way to set up the virtual environment

The requirements.txt file is broken. Do not use that one to set up your virtual environment.

Do this

# Create a conda environment first
conda create --name pytorch04

# Enter the environment
conda activate pytorch04

# Install pytorch 
conda install pytorch=0.4.1 cuda90 -c pytorch

Replace everything in the requirements.txt file to the following

matplotlib
pandas
jupyterlab
torchvision==0.2.1

then run pip install -r requirements.txt. Now you should be able to run the infer-main.ipynb and train.py

Obstacle loss function

In the paper you say that you add a safety loss term, that penalizes all predicted
states of vehicles that lie in an obstacle cell. In the args.txt file supplied with the pretrained KITTI model, --lossOT = True, suggesting you have used this loss function. However, in the training code you define the obstacleLossFun then never use it.

This is just one example of a load of seemingly unused args, making it very difficult to recreate your results given that it is not clear exactly which args you used in your training.

How to generate the picture as shown in Fig. 5 as paper

Hello, I would like to know how you generate a picture like Figure 5 in the paper. I think such a visual picture is very intuitive, and I want to generate it myself.I would be more grateful if you could provide the source code。Thanks!

How does it work at inference time?

In order to predict multiple time steps ahead for the training/validation/testing where you already have access to the future intermediate representations you simply combine the prediction at the previous time step with the next incoming intermediate representation and use this as the next time step's input. But how do you predict multiple time steps ahead live at inference time when you don't have access to the future intermediate representations? I couldn't see any code for this in the repo.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.