olivierjeunen / pessimism-recsys-2021

Source code for our paper "Pessimistic Decision-Making for Recommender Systems" published at ACM TORS, and RecSys 2021.

Pessimistic Decision-Making for Recommender Systems

This repository holds the source code for our paper "Pessimistic Reward Models for Off-Policy Learning in Recommendation" published at RecSys 2021. This work has been extended as "Pessimistic Decision-Making for Recommender Systems", published in the ACM Transactions on Recommender Systems (ToRS) journal.

Reproducibility

• Install RecoGym requirements as described in the official repository.
• Install utilities and common packages: TQDM, NumPy/SciPy, Pandas.
• Run python3 src/PessimisticRidgeRegression.py, which will run all experiments and dump raw measurements in .csv files, along with coarse visualisation in .png files.

Paper

If you use our code in your research, please remember to cite our work:

    @article{JeunenTORS_2022,
      author = {Jeunen, Olivier and Goethals, Bart},
      title = {Pessimistic Decision-Making for Recommender Systems},
      journal = {Transactions on Recommender Systems (TORS)},
      year = {2022},
      publisher = {ACM},
    }

    @inproceedings{JeunenRecSys2021_A,
      author = {Jeunen, Olivier and Goethals, Bart},
      title = {Pessimistic Reward Models for Off-Policy Learning in Recommendation},
      booktitle = {Proceedings of the 15th ACM Conference on Recommender Systems},
      series = {RecSys '21},
      year = {2021},
      publisher = {ACM},
    }

pessimism-recsys-2021's Issues

The environment must specify an action space. https://www.gymlibrary.dev/content/environment_creation/

hello, when i run src/PessimisticRidgeRegression.py, i failed run this code,
env = gym.make('reco-gym-v1')
the error is :
The environment must specify an action space. https://www.gymlibrary.dev/content/environment_creation/

if i add the action_space: self.action_space = Discrete(self.config.num_products)
but failed error info is : The environment must specify an observation_space. https://www.gymlibrary.dev/content/environment_creation/

could you help me? I need to solve this problem urgently，thank you.