civisanalytics / datascience-r Goto Github PK

In a container script using this docker image, I run

sudo apt-get update
sudo apt-get install -y libpoppler-cpp-dev

which is needed to use the pdftools library in the R script the container points to. It'd be great to be able to add this installation to the docker image if possible. We're hoping to build out a PDF scraping tool for our OPM engagement at some point.

We don't yet have a way to pin the versions of installed packages.

packrat seems to be a viable option.

Could the 'zoo' package be added to the docker image? I use it for some more complex date/time finagling (and 'lubridate' doesn't quite do as much as I need it to).

Thanks!

Python 2 is reaching end of life in Januray. Do we want to continue to provide civis-python in Python 2 in this repo?

Options

1. Remove civis-python in January
2. Include civis-python as long as it can be installed in the default python provided by the distribution
3. Start installing civis-python in a python3

My leaning is toward option 2, but just wanted to discuss here for transparency.

Users sometimes expect that logs will be output from the R process in real time, but occasionally they won't. One of the reasons is console output is buffered by default. this ticket changes the default to immediately flush the console automatically.

https://stackoverflow.com/a/29427725/1028939

The set of packages included in the image can change if dependencies are removed. Take a snapshot of the current packages, and make sure that at least those packages are always installed and store in requirements.txt.

Nice to have: make it easy to update requirements.txt.