shiaoming / alike

ALIKE: Accurate and Lightweight Keypoint Detection and Descriptor Extraction

Hi there 👋

alike's Issues

about reprojection error

Is the model trained with reprojection error works better in Hpatches dataset?such as localization error Anyone tried?
please!!!

MegaDepth数据设置

请问训练代码中的MegaDepth数据集的json文件能单独发一下吗？

Hi, can you share the training code?

great job，thanks for your explanation！

After studying enough, I found that your method is very interesting。Can you provide the training code?

train

I wanna know the reason when I use the model trained by the train code, the error happen.

Thanks!!

Sharing training cod

Hi
Do you mind sharing the training code too?

reproduce trainning result, loss is about 28

i train alike-l using dataset megadepth, and traing loss:

is it correct?

repeatability issue

I have trained ALIKE and the results are quite Good. But I noticed the val_peatability score decrease. Do you have any comment why? Does other loss, like reliability loss will harm the repeatability ability?

Thanks in advance.

Can you share the training code

Reprojection loss

In your paper III-C1:
For a warped keypoint p_AB, we find its closest detected keypoint p_B within th_gt pixels distance as its corresponding keypoint.

• What is the th_gt pixels distance in reprojection loss?
• Do you calculate the distance of keypoints on the score map before DKD？

About aachen day-night dataset evaluation results,

I really appreciate your wonderful work and inference code.

While reading your paper, I had a some questions about details.

Is the visual localization of aachen dataset results on the paper only for night, right?

and in case of the unlimited keypoints, which number did you set for the maximum keypoints number?

8000 or more than 8000 ?

Thank you.

Format conversion

Hello, author! The model saved by your training code is in ckpt format, and the test code is in pth format. May I ask how this ckpt is converted to pth?

I'm very sorry, I have some doubts about your convolutional neural network framework

In order to describe accurately, I want to express it in Chinese.
我对此了解不是十分深刻，但对您文章中提出的训练模式与导数反向传播方式存在一定疑问。文章中使用了NMS层导致整体网络框架不可导，您利用了点邻域的score map构建可导的模式，相当于将一整张图片分割出许多小patch，仅对这些patch做了优化。可是一开始确定NMS点位置的操作是不是没有经过训练优化。您是怎么保证一开始的nms点位置是正确的呢

ALIKE variant trained without dispersity peak loss

In your paper you write, that ALIKE achieves higher matching accuracy when trained without the dispersity peak loss. Can you share the trained model(s)?

Repeatable loss, is exp(), or softmax()

Thank you for great job!!!
i have a small question about repeatable loss.In ALIKE paper, the matching probability map is obtained by normalizing the similarity map.but use exp() while in decriptor loss use softmax().
it is a careless mistake?or i misunderstood.
Thanks

Export the model to ONNX

Hi author,

Thank you for your amazing work.

I'm trying to export the ALIKE models to ONNX for inferencing on edge-devices. However, the some operation in the model are not supported to convert to ONNX, including : grid_sampler, argsort.

Have you tried converting the model to ONNX before, and was it successful, if yes, could you please guide me to export to ONNX ? Many thanks in advance !

Best regards,
Michael

Training code

Hi Shiaoming,
Did you plan to release the training code ?
I read this, 'We will publish the training code for ALIKED (the subsequent work of ALIKE, which we are working on). Then you can refer to the training code of ALIKED, they have the same training pipeline.'.
But I see nothing on ALIKED repository ?

Thank you.

Reproduce results

Upon examination of your code, I noticed the existence of a parameter named "sub_pixel," which is set to False by default. Upon further investigation, I discovered that enabling this parameter by setting it to True can result in improved performance. I am interested in understanding whether there are any potential drawbacks to enabling this parameter during inference. Furthermore, I would like to inquire about the rationale behind disabling this parameter by default.

How to calculate the Matching Score in the code

Hello
I have no idea about how to calculate the Matching Score in the code.
Any help would be appreciated.

MISSING JSON FILE

When I was training the network, I encountered an error indicating a missing file.

Training code

This is a very interesting work, that achieves some impressive results. I am very interested in adapting ALIKE to my needs. Would you be willing to share/publish the code used for training the network?

About description loss

Can anyone explain to me why we minus 1 before take softmax in this equation

eval

when i run hesq/eval.py, i got all MMA@3 >MMA@5.
is the code wrong?

and

for code for thr in range(1, 4):
thr should output 1,2,3, not 1,3,5

Any plan to release training code?