jeremiak / open-cius

easy to use time series data from the FBI's UCR program

open cius

easy to use (hopefully), time series crime in the us reports from the fbi's ucr program.

sample of cleaned output for table 1 and table 8

installation

0. $ git clone open-cius && cd open-cius
1. $ mkdir data
2. $ docker build -t cius .
3. $ docker run -v $PWD/data:/data -it cius

development

run the container with the scripts directory mounted as well as the data directory

0. $ docker run -v $PWD/data:/data -v $PWD/scripts:/app/scripts -it cius bash

open-cius's Issues

Scrape and combine NIBRS "Agency Tables by State"

There are some high level NIBRS tables that report NIBRS offenses by participating agency (which must submit 12 months of data). Per usual, this data is released in yearly slices. It would be good to combine them into one CSV that could be used for time series analysis.

I can't currently find any agency level tables published before the 2012 report.

Links to download

Year	Excel URL	NIBRS yearly report URL
2012	https://ucr.fbi.gov/nibrs/2012/tables/united-states-offense-type-by-agency-2012	https://ucr.fbi.gov/nibrs/2012/data-tables
2013	https://ucr.fbi.gov/nibrs/2013/tables/united-states-offense-type-by-agency-2013	https://ucr.fbi.gov/nibrs/2013/data-tables
2014	https://ucr.fbi.gov/nibrs/2014/tables/by-state/state-data/united_states_offense_type_by_agency_2014.xls	https://ucr.fbi.gov/nibrs/2014/tables/data-tables
2015	https://ucr.fbi.gov/nibrs/2015/tables/state-excels/united_states_offense_type_by_agency_2015-1/output.xls	https://ucr.fbi.gov/nibrs/2015/tables/data-tables

Include final generated CSVs in website for easy downloading

It would be annoying to have to pull down the repo, build the docker image, and then run the app in order to get the final files. Add those clean files to the /docs website.