GithubHelp home page GithubHelp logo

About the holiday dataset. about crow HOT 9 OPEN

yahooarchive avatar yahooarchive commented on June 16, 2024
About the holiday dataset.

from crow.

Comments (9)

skamalas avatar skamalas commented on June 16, 2024

Hi Niudond,

This is weird - I assume you are able to reproduce the Oxford and Paris numbers?
Unfortunately that code is not available. Just making sure, did you noticed this detail: As we say in the text, we used the rotated version of Holidays for your test, i.e. we manually turned all photos to have the same upright orientation. As I remember, though, such photos are not that many, and only this difference does not explain a 20% gap. It would be great if you also tried with rotated images and let us know.

Thanks,
Yannis

from crow.

Niudong avatar Niudong commented on June 16, 2024

Hi.

You are right, I get almost the same numbers on the Oxford and Pairs datasets. I do not consider upright orientation the picture on the Holiday dataset.

Some details. For the limitation of GPU(11G), I set the input size with 768*768 because the Holiday image is too large, and I use the evaluation on the Holiday website, I get 63.372%.
I wonder if you can give me some suggestions.

Many thanks in advance.

from crow.

pumpikano avatar pumpikano commented on June 16, 2024

It seems there are two differences at least:

  1. We corrected the orientation of all the images.
  2. We did not resize the images when computing the features, if I remember correctly. I think for Holidays we computed the features on CPU, so avoided GPU memory issues.

But I think 20% is still surprising, even with these differences.

from crow.

Niudong avatar Niudong commented on June 16, 2024

Many thanks. I will do some experiments with your advice. By the way, I want to know what kind of evaluation method do you have on the Holiday dataset?

from crow.

skamalas avatar skamalas commented on June 16, 2024

As I remember we use the same evaluation protocol as in the other two datasets.

Another detail, whitening: As we say in the paper "We use the Oxford100k dataset for whitening on the Holidays."

from crow.

Niudong avatar Niudong commented on June 16, 2024

I will have another try. Thanks for your timely response.

from crow.

xiaozhi2015 avatar xiaozhi2015 commented on June 16, 2024

Are there any requirements for the PCA_whitening_data? Should they have the same distribution with the under test data?
@skamalas Much thx!

from crow.

flyinsky323 avatar flyinsky323 commented on June 16, 2024

I will have another try. Thanks for your timely response.

Hello, mAP calculation on the Holiday dataset, have you implemented it? Can you tell me how to achieve it?

from crow.

 avatar commented on June 16, 2024

@Niudong Can you tell me how to achieve the method of map calculation on the Holiday dataset ?

Thanks in advance.

from crow.

Related Issues (8)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.