Can not reproduce the result on DrugOOD. about imold

[toooooodo]

Hi! Thank you for your interest in our work.

On the DrugOOD dataset, we searched for all hyper-parameters using the grid search method. Here is the demo script:

#!/bin/bash
hyper_list1=(choice1, choice2, ...)
hyper_list2=(choice1, choice2, ...)

# grid search on all hyper-parameters
for p1 in ${hyper_list1[*]}
do
for p2 in ${hyper_list2[*]}
do
python run.py --random_seed 0 --h1 p1 --h2 p2
python run.py --random_seed 1 --h1 p1 --h2 p2
python run.py --random_seed 2 --h1 p1 --h2 p2
done
done

The choices of hyper-parameters are detailed in the appendix.

We repeated the experiments with different random seeds for each group of hyper-parameters, and the results reported in the paper are for the best group. Also, we observed that due to the small size of the drugood dataset, it is prone to larger variance. But because of running many groups results out, the best one will be the one where the results are all a bit better.