internet-equity / netrics-data Goto Github PK

Some of the measurement boxes counted connected devices in the IoT lab during activation. We need to remove these counts from the data for these devices. For example, see "Device Counts" at https://wilson.cs.uchicago.edu:8088/d/mvoxGuDnk/20210915-18d842ef?orgId=1

Develop a pipeline that links the measurement data from our device deployments to geographic data and survey data we collect from study participants. Geographic and survey data can be linked to the measurement data using the unique device ID hash for each device.

Right now, we currently use a manual process to geocode the address data (using Google Maps API) collected in the Qualtrics Screening Questionnaire and link that data to the Qualtrics Broadband Survey data using the device ID for each participant. This is a time-intensive, error-prone task. If we can find a way to optimize and automate as much of this process as possible, we will be able to release measurement data alongside geographic and survey data more quickly.

Remove GEOID and tract identifier for each device ID until we can further confirm the safety of linking devices to households.

Upload CSV files for the measurement data from devices for the month of July 2022.

The test device with the actual device ID of 0819 was transformed into 819 in the geographic survey data (combined_survey_geo_data_04AUG2022.csv).

Update the data files to include measurement data from May and June 2022. Update the geographic and survey supplemental data to include new devices added to deployments in these months.