datasets / co2-ppm-daily

Carbon Dioxide levels in the atmosphere (ppm on a daily basis)

This dataset was created using data from Earth System Research Laboratory. This data contains Atmospheric Carbon Dioxide Dry Air Mole Fractions from quasi-continuous daily measurements at Mauna Loa, Hawaii.

Preparation

To generate output file you should only run the script: co2-ppm-daily-flow.py

Data

Data has been scraped from two different sources:

• First source contains values from 01.01.1958 to 31.12.2004
• Second source contains values from 01.01.1973 to 31.12.2017.
• Third source contains values until today.

Since there is a lot of overlapping between the sources, output file is created in a way that all existing values are included.

Output file is located in: data/co2-ppm-daily.csv

Value represents Mole fraction reported in units of micromol mol-1 (10-6 mol per mol of dry air); equivalent to ppm (parts per million).

License

ODC-PDDL-1.0

This Data Package is made available under the Public Domain Dedication and License v1.0 whose full text can be found at: http://www.opendatacommons.org/licenses/pddl/1.0/

Notes

The terms of use of the source dataset list three specific restrictions on public use of these data:

The information on government servers are in the public domain, unless specifically annotated otherwise, and may be used freely by the public so long as you do not 1) claim it is your own (e.g. by claiming copyright for NOAA information – see next paragraph), 2) use it in a manner that implies an endorsement or affiliation with NOAA, or 3) modify it in content and then present it as official government material.*

co2-ppm-daily's Issues

Improve documentation

• The README is just inaccurate (e.g. preparation section!)
• Data section should explain where data came from and why we have two different data sources
  • I would also have a short comment in the python script about this too ...
• Description at top should be a paragraph
• Should not be a heading at the top of the readme
• Details of source data structure and what we extract (e.g. summary like below and then explain what we extract)

# site_code:long_name : site_name_abbreviation.
# site_code:comment : Site code is an abbreviation for the sampling site name.
# time_components:_FillValue : -9
# time_components:long_name : integer_components_of_UTC_date/time
# time_components:order : year, month, day, hour, minute, second
# time_components:comment : Calendar time components as integers.  Times and dates are UTC. Time-averaged values are reported at the beginning of the averaging interval.
# value:_FillValue : -999.999
# value:long_name : measured_mole_fraction_of_trace_gas_in_dry_air
# value:units : micromol mol-1
# value:comment : Mole fraction reported in units of micromol mol-1 (10-6 mol per mol of dry air); equivalent to ppm (parts per million).
# value_std_dev:_FillValue : -99.99
# value_std_dev:long_name : standard_deviation_in_reported_value
# value_std_dev:units : micromol mol-1
# value_std_dev:comment : This is the standard deviation of the reported mean value when nvalue is greater than 1. See provider_comment if available.
# nvalue:_FillValue : -9
# nvalue:long_name : number_of_measurements_contributing_to_reported_value
# nvalue:comment : Number of individual measurements used to compute reported value. See provider_comment if available.
# latitude:_FillValue : -999.999
# latitude:standard_name : latitude
# latitude:long_name : sample_latitude_in_decimal_degrees
# latitude:units : degrees_north
# latitude:comment : Latitude at which air sample was collected.
# longitude:_FillValue : -999.999
# longitude:standard_name : longitude
# longitude:long_name : sample_longitude_in_decimal_degrees
# longitude:units : degrees_east
# longitude:comment : Longitude at which air sample was collected using a range of -180 degrees to +180 degrees.
# altitude:_FillValue : -999.999
# altitude:standard_name : altitude
# altitude:long_name : sample_altitude_in_meters_above_sea_level
# altitude:units : m
# altitude:comment : Altitude (in meters above sea level). See provider_comment if available.
# altitude:provider_comment : Altitude for this dataset is the sum of surface elevation (masl) and sample intake height (magl).
# elevation:_FillValue : -999.999
# elevation:standard_name : elevation
# elevation:long_name : surface_elevation_in_meters_above_sea_level
# elevation:units : m
# elevation:comment : Surface elevation in meters above sea level. See provider_comment if available.
# intake_height:_FillValue : -999.999
# intake_height:long_name : sample_intake_height_in_meters_above_ground_level
# intake_height:units : m
# intake_height:comment : Sample intake height in meters above ground level (magl). See provider_comment if available.
# qcflag:_FillValue : NA
# qcflag:long_name : quality_control_flag
# qcflag:comment : This quality control flag is provided by the contributing PIs. See provider_comment if available.
# qcflag:provider_comment : This is the NOAA 3-character quality control flag.  Column 1 is the REJECTION flag. An alphanumeric other than a period (.) in the FIRST column indicates a sample with obvious problems during collection or analysis. This measurement should not be interpreted. Column 2 is the SELECTION flag. An alphanumeric other than a period (.) in the SECOND column indicates a sample that is likely valid but does not meet selection criteria determined by the goals of a particular investigation. Column 3 is the INFORMATION flag. An alphanumeric other than a period (.) in the THIRD column provides additional information about the collection or analysis of the sample.
#
# VARIABLE ORDER
#
site_code year month day hour minute second value value_std_dev nvalue latitude longitude altitude elevation intake_height qcflag
MLO 1973 1 1 0 0 0 -999.99 -99.99 0 19.536 -155.576 3437.0 3397.0 40.0 *..
MLO 1973 1 2 0 0 0 -999.99 -99.99 0 19.536 -155.576 3437.0 3397.0 40.0 *..
MLO 1973 1 3 0 0 0 -999.99 -99.99 0 19.536 -155.576 3437.0 3397.0 40.0 *..
MLO 1973 1 4 0 0 0 -999.99 -99.99 0 19.536 -155.576 3437.0 3397.0 40.0 *..
MLO 1973 1 5 0 0 0 -999.99 -99.99 0 19.536 -155.576 3437.0 3397.0 40.0 *..
MLO 1973 1 6 0 0 0 -999.99 -99.99 0 19.536 -155.576 3437.0 3397.0 40.0 *..
MLO 1973 1 7 0 0 0 -999.99 -99.99 0 19.536 -155.576 3437.0 3397.0 40.0 *..
MLO 1973 1 8 0 0 0 -999.99 -99.99 0 19.536 -155.576 3437.0 3397.0 40.0 *..
MLO 1973 1 9 0 0 0 -999.99 -99.99 0 19.536 -155.576 3437.0 3397.0 40.0 *..
MLO 1973 1 10 0 0 0 -999.99 -99.99 0 19.536 -155.576 3437.0 3397.0 40.0 *..
MLO 1973 1 11 0 0 0 -999.99 -99.99 0 19.536 -155.576 3437.0 3397.0 40.0 *..
MLO 1973 1 12 0 0 0 -999.99 -99.99 0 19.536 -155.576 3437.0 3397.0 40.0 *..
MLO 1973 1 13 0 0 0 -999.99 -99.99 0 19.536 -155.576 3437.0 3397.0 40.0 *..
MLO 1973 1 14 0 0 0 -999.99 -99.99 0 19.536 -155.576 3437.0 3397.0 40.0 *..

Remove all null values from the dataset

The dataset uses -999.99 as a null value (or -99.99 for std dev). Rather than having blanks for these dates just remove them from the dataset.

Full version of the dataset

Extract everything including the metadata - both field metadata and summary into a full data package so that we can show what this would look like and someone can get the full version if they want.

Data wasn't updated since 2019-02-05

On https://datahub.io/core/co2-ppm-daily if you check the latest data, it is for 2019-02-05, however, it says it is updated a few hours ago.