jguetschow / unfccc_non-annexi_data Goto Github PK
View Code? Open in Web Editor NEWLicense: Apache License 2.0
License: Apache License 2.0
Eritrea's first BUR. Some detail for 2018, almost no data for other years. Still read as recent data included.
The reading function of the South Korean 2022 inventory leaves some categories untranslated and unmapped.
find mapping for them or ignore them explicitly. All of these categories contain zero only time-series.
Gabon's first BUR. The NIR contains detailed inventories for 1994, 2000, 2005, 2010-2017. The NIR tables use the standard NIR format and should be easy to read.
read_new_unfccc_crf_for_year does not commit it's results because of the error
OSError: [Errno 7] Argument list too long: 'git'
This is probably from the very long list of files that are affected by the commit and passed to datalad. To get rid of this message we could commit country by country or dig deeper and find another solution. As manually committing after the error in the script work fine it's not urgent to solve this issue.
Data from Ethiopia's second national communication is available through the UNFCCC DI interface.
The data shows a spike in 1.A.4 CH4 and N2O emissions from 1997 to 2004 which is not consistent with the CO2 emissions from the sector.
The data in the DI interface is consistent with the NC2 report tables, but the time series look like there is an offset and thus the reason for this should be investigated.
Indonesia's third BUR. Detailed inventory for 2019, almost no other data. Inventory is in standard NIR table format.
The fourth National Communication contains data for 2004 - 2018 in two year intervals. However, only some sectors are present and not all are gas resolved. The data could still be a good addition to the data from BUR2
Data in BUR3/NIR for Montenegro has several issues in the reporting tables. Double check if they are all sorted out in the data read in. F-gases in Sector 2.E have the be checked first.
The energy CO2 time-series from BUR3 show peaks for certain years. As we currently only have aggregate energy CO2 time-series available for use in PRIMAP-hist which are downscaled to the necessary categorical level the peaks appear in all energy CO2 time-series. However, they actually come from flaring. Flaring data are available in the NIR to BUR3. Read the flaring time-series to make the energy CO2 data more accurate.
Uruguay's fourth BUR contains detailed data for 2019 and main sector and gas timeseries for 1990-2019 where some years have no data. More data might exist for individual sectors. Try to obtain the full inventory from a different source before reading the data.
Add data fro the submission of the Nationally Determined Contributions (NDCs) to the dataset. For quantification of the emissions implied by the NDCs as submitted by countries the emissions data submitted with the NDCs are the first priority data source.
All NDC submission are available from the NDC registry.
The format is different from the BUR and NC submissions thus new code is needed for the downloader.
TODOs are:
Integrate data already read and adapt code
F-gases from BUR1/NIR1 for Kyrgyzstan are currently not available. Read BUR1/NIR1
For some countries duplicate download folders exist due to different spellings of the country name in the submission database and / or errors in the treatment of special characters.
Affected countries are at least:
Lebanon's third BUR. Detailed inventory for 2015, not much data for other years. Check if detailed inventory is available somewhere before reading this BUR
Trinidad and Tobago's first BUR. Contains detailed data for 2018 and individual GHG timeseries for 2006-2018 and the main sectors. More data is possibly available for some subsectors.
Integrate data from Oman's first BUR as legacy data.
The CRF reader currently reads no table that contains the "Other" sector. This affects Switzerland and New Zealand
The 2021 Inventory report is available online, but not yet submitted to the UNFCCC. It contains data for 1990 - 2021 with good sectoral and gas resolution.
www.gir.go.kr
Integrate BUR4 data already read and adapt code for data reading.
Rwanda's first BUR contains a detailed inventory for 2018 and aggregate KyotoGHG timeseries for 2006 - 2018. Mayeb more data for specific sectors. Some tables seem to have problem with data showing up under the header for the wrong year span (e.g. Page 41)
Integrate data already read from NIR xlsx file (non-UNFCCC folder) and adapt code to publish it here.
Add information on datalad / git-annex setup to README, as in some linux distributions the default packages are utdated.
Integrate BUR4 data already read and adapt code for data reading.
This likely should read Korea (and maybe another year)?
Several country reading script contain a fix_rows
function to combine rows split up in the pdf reading process (because they contained line breaks in some cells). Make one unified function and place that in the helper module to reduce code and possible confusion.
Submissions that where the fix_rows function is used are:
Additional submission where the code is not integrated into the repository use the function
First BUR from Côte d’Ivoire. Contains some sector and gas detail for 1990 and 2014 but not much data for other years.
Lebanon's fourth BUR. Detailed inventory for 2018, not much data for other years. Check if detailed inventory is available somewhere before reading this BUR
The report resolves individual gases only for 2016, however a spreadsheet containing all data is available from inventariogei.ambiente.gob.ar.
Data is in IPCC 2006 categories with very good sectoral resolution.
Malawi's first BUR contains detailed inventories for 2010 and 2017 in IPCC2006 categories. Time series for some sectors and gases exist. Data reading will take some time as time series have to be collected from tables in different formats.
Moldova's third BUR comes with a NIR that contains a detailed 1990-2019 inventory. Data uses a mixture of IPCC1996 and 2006 sectors (Agriculture and LULUCF split). The table format is similar to the standard NIR format but with separate tables per main category.
These new submissions have been added to the UNFCCC website since July 2022 and have to be considered for inclusion into PRIMAP-hist v2.5
last update: March 14, 2024
Integrate data already read and adapt code
Contains data in IPCC2006 categories for 2010 - 2018 in 2 year intervals.
Integrate data already read and code
Read table from page 27 in BUR1. Data is currently not read
Vanuatu's first BUR contains detailed data for 2017 in IPCC2006 categories but not much data for other years
Some BUR reading script currently don't run. As the data have been read it's not urgent to fix, but should be done at some point.
Affected scripts are
for most cases the errors are in the category aggregation which is done using the process_data_for_country function in newer scripts. Modifying the scripts to also use that function should circumvent the error.
The report resolves individual gases only for 2018, for 1990-2018 gas basket time series exist. However BUR3 data was made available in spreadsheet containing all data is available from inventariogei.ambiente.gob.ar. So before reading the data from pdf check if the spreadsheet has been updated (last check: Jan 24, 2022, not updated).
Data is in IPCC 2006 categories with very good sectoral resolution.
The output of the country_info task is a bit hard to read especially for the many DI datasets.
Integrate data already read and code.
Saint Lucia has recently updated it's first BUR. Neither the BUR nor the NIR seem to contain much emissions data.
Mauritius' BUR1 contains detailed inventories for 2000, 2005, 2010, 2014 - 2016 and KyotoGHG time series for 2000-2016. Data is contained in the NIR and using the standard NIR format.
Integrate data already read and adapt code
The NIR that was submitted with the fourth NC contains a detailed inventory for 2017 and some time series for other sectors and gases though likely not all sectors and gases.
The NIR submitted with Costa Rica's second BUR contains a detailed inventory for 2012.
Colombia's BUR3 contains detailed data for 2018 but full 1990-2018 time series only for some sectors and gases. Before reading the data check if a full inventory is available somewhere. The table format is not the standard NIR format but similar and should be easy to read for the 2018 inventory. The other time series might be more complicated.
When reading data using a UNFCCC reader script for the first time the output files do not yet exist and datalad does not know about them. In consequence they are not saved by the datalad run command as it is configured to only save output files given explicitly. As the file names are determined by the scripts (and differ by submission not following a clear pattern as sometimes we have category conversions) they are not known outside the scripts unless files already exist.
Possible solutions:
When one of the files listing the new downloads (e.g. 00_new_downloads_bur-<date>.csv) already exists it is overwritten without warning. This happen e.g. when running a download script twice on the same day.
This should be fixed and a new filename should be chosen in this case.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.