Feature Request: Domain name filtering/restrictions on competition participants about codalab-competitions

[Didayolo]

Dear John,

We have implemented a similar feature in Codabench, where you can provide a whitelist of email address to accept or reject users from your competition.

If I'm correct, it is possible to use a regular expression to match a whole domain.

Future development are focused on Codabench now. The platform is stable and faster than CodaLab. You can see it live here: https://codabench.org/

[olyerickson]

Thanks for the suggestion. We didn't learn of Codabench with enough time to pivot for this year's class. Is there something that describes the process of migrating competitions from CodaLab to Codabench? John

…

On Mon, Mar 18, 2024 at 1:53 PM Adrien Pavão ***@***.***> wrote: Dear Jonh, We have implemented a similar feature in Codabench <https://github.com/codalab/codabench/>, where you can provide a whitelist of email address to accept or reject users from your competition. If I'm correct, it is possible to use a regular expression to match a whole domain. Future development are focused on Codabench now. The platform is stable and faster than CodaLab. You can see it live here: https://codabench.org/ — Reply to this email directly, view it on GitHub <#3476 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AACXR6JVZGLOHAXAL5WRNQTYY4S2XAVCNFSM6AAAAABE2DLS7OVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMBUGU3TKNZYGY> . You are receiving this because you authored the thread.Message ID: ***@***.***>

-- John S. Erickson, Ph.D. Director of Operations, The Rensselaer IDEA Deputy Director, Web Science Research Center (RPI) <http://idea.rpi.edu/> <o ***@***.***>***@***.***> Twitter & Skype: olyerickson Fediverse: @***@***.*** *Not sent from my iPhone...because I don't own one!*

[Didayolo]

The process of transitioning from CodaLab to Codabench is quite simple.

Basically, CodaLab bundles are compatible with Codabench. So you can simply upload your bundle there, and start making submissions to familiarize with the platform.

You can follow these resources to help you in this process:

• https://github.com/codalab/codabench/wiki/Getting-started-with-Codabench
• https://adrienpavao.medium.com/how-to-create-your-first-benchmark-on-codabench-910e2aee130c

By the way, I want to write a guide to help transitioning from CodaLab to Codabench, unfortunately I haven't done it yet!

Best regards,

Adrien

[olyerickson]

Thanks Adrien! We'll take a look at it... John

…

On Tue, Mar 19, 2024 at 9:57 AM Adrien Pavão ***@***.***> wrote: The process of transitioning from CodaLab to Codabench is quite simple. Basically, CodaLab bundles are compatible with Codabench. So you can simply upload your bundle there, and start making submissions to familiarize with the platform. You can follow these resources to help you in this process: - https://github.com/codalab/codabench/wiki/Getting-started-with-Codabench - https://adrienpavao.medium.com/how-to-create-your-first-benchmark-on-codabench-910e2aee130c By the way, I want to write a guide to help transitioning from CodaLab to Codabench, unfortunately I haven't done it yet! Best regards, Adrien — Reply to this email directly, view it on GitHub <#3476 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AACXR6JCT75YTHPILQ2HUP3YZA74NAVCNFSM6AAAAABE2DLS7OVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMBXGI2TCMBZGM> . You are receiving this because you authored the thread.Message ID: ***@***.***>

-- John S. Erickson, Ph.D. Director of Operations, The Rensselaer IDEA Deputy Director, Web Science Research Center (RPI) <http://idea.rpi.edu/> <o ***@***.***>***@***.***> Twitter & Skype: olyerickson Fediverse: @***@***.*** *Not sent from my iPhone...because I don't own one!*

[Didayolo]

I close this issue then, but feel free to reach me again if needed.

[olyerickson]

I tried to start a "benchmark" using a downloaded competition bundle...but not the full-sized, just the URI Keys version. I was not able to use that to create a benchmark... I'm trying it now with an Old Skool dump...

…

On Tue, Mar 19, 2024 at 12:21 PM Adrien Pavão ***@***.***> wrote: I close this issue then, but feel free to reach me again if needed. — Reply to this email directly, view it on GitHub <#3476 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AACXR6PL35F4I5OPECHG5LDYZBQW7AVCNFSM6AAAAABE2DLS7OVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMBXGYYTGOJYGA> . You are receiving this because you authored the thread.Message ID: ***@***.***>

-- John S. Erickson, Ph.D. Director of Operations, The Rensselaer IDEA Deputy Director, Web Science Research Center (RPI) <http://idea.rpi.edu/> <o ***@***.***>***@***.***> Twitter & Skype: olyerickson Fediverse: @***@***.*** *Not sent from my iPhone...because I don't own one!*

[olyerickson]

I was able to re-create one of our competitions with a competition bundle https://www.codabench.org/competitions/2342/ but not ChemsRUs: https://codalab.lisn.upsaclay.fr/competitions/17830 This is the error

…

On Tue, Mar 19, 2024 at 2:26 PM John Erickson ***@***.***> wrote: I tried to start a "benchmark" using a downloaded competition bundle...but not the full-sized, just the URI Keys version. I was not able to use that to create a benchmark... I'm trying it now with an Old Skool dump... On Tue, Mar 19, 2024 at 12:21 PM Adrien Pavão ***@***.***> wrote: > I close this issue then, but feel free to reach me again if needed. > > — > Reply to this email directly, view it on GitHub > <#3476 (comment)>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AACXR6PL35F4I5OPECHG5LDYZBQW7AVCNFSM6AAAAABE2DLS7OVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMBXGYYTGOJYGA> > . > You are receiving this because you authored the thread.Message ID: > ***@***.***> > -- John S. Erickson, Ph.D. Director of Operations, The Rensselaer IDEA Deputy Director, Web Science Research Center (RPI) <http://idea.rpi.edu/> <o ***@***.***>***@***.***> Twitter & Skype: olyerickson Fediverse: @***@***.*** *Not sent from my iPhone...because I don't own one!*

-- John S. Erickson, Ph.D. Director of Operations, The Rensselaer IDEA Deputy Director, Web Science Research Center (RPI) <http://idea.rpi.edu/> <o ***@***.***>***@***.***> Twitter & Skype: olyerickson Fediverse: @***@***.*** *Not sent from my iPhone...because I don't own one!*

[Didayolo]

Hi,

I tried to start a "benchmark" using a downloaded competition bundle...but not the full-sized, just the URI Keys version. I was not able to use that to create a benchmark...

This is an expected behavior. Using the URI keys means that the data and programs are refered by the keys in the database. As you are uploading on a different server, the data can't be found.

but not ChemsRUs: https://codalab.lisn.upsaclay.fr/competitions/17830 This is the error

What is the error? I don't see it in your message.

[olyerickson]

I attached it to the ticket, but it didn't seem to stick... Here it is again...

…

On Wed, Mar 20, 2024 at 3:49 PM Adrien Pavão ***@***.***> wrote: Hi, I tried to start a "benchmark" using a downloaded competition bundle...but not the full-sized, just the URI Keys version. I was not able to use that to create a benchmark... This is an expected behavior. Using the URI keys means that the data and programs are refered by the keys in the database. As you are uploading on a different server, the data can't be found. but not ChemsRUs: https://codalab.lisn.upsaclay.fr/competitions/17830 This is the error What is the error? I don't see it in your message. — Reply to this email directly, view it on GitHub <#3476 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AACXR6K2KRBFTUTQ7JEUKZTYZHR23AVCNFSM6AAAAABE2DLS7OVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMJQGQ4TKNJXHE> . You are receiving this because you authored the thread.Message ID: ***@***.***>

-- John S. Erickson, Ph.D. Director of Operations, The Rensselaer IDEA Deputy Director, Web Science Research Center (RPI) <http://idea.rpi.edu/> <o ***@***.***>***@***.***> Twitter & Skype: olyerickson Fediverse: @***@***.*** *Not sent from my iPhone...because I don't own one!*

[Didayolo]

It is still missing. You can reach me directly by email if you want.