Comments (2)
Just pushed code changes for this issue. The option for multi-threaded processing was introduced to the PackageData demonstration class. Additionally, the code base now includes a new class called TaskGroupExecutor that coordinates the use multiple threads when partitioning processing into sub-tasks. In some cases, this class is easier to use than the Java standard API's CyclicBarrier and Phaser classes.
In testing with the GEBCO global elevation and bathymetry data set (3.7 billion sample points), the time to compress the entire data set on a mid-sized laptop computer was reduced from 1920 seconds to 1052.
Opportunities for future improvements are being investigated.
from gridfour.
Final changes pushed to repository. These enhancements resulted in a nearly 50 % reduction in processing time for global elevation/bathymetry data sets.
from gridfour.
Related Issues (20)
- Refactor GVRS to improve metadata and API HOT 20
- Post Gridfour Core to Maven Central HOT 4
- Changing GVRS API, need comments HOT 1
- Expand Color Palette Table (CPT) Support HOT 3
- Move coordinate-related classes to a dedicated package HOT 1
- Add direct support for image data into GVRS API HOT 2
- Corrections for real-valued coordinates HOT 2
- Prep for release 1.0.2 HOT 3
- Update GeoTIFF code to use Apache Commons Imaging Alpha-3 API HOT 3
- Expedite read operations by using multiple threads HOT 4
- Expedite Huffman decoder using alternate tree representation HOT 2
- Improve terminology for management classes and methods HOT 1
- Document the GVRS file format, introduce some revisions HOT 2
- Revise GVRS file format, is backward compatibility required? HOT 1
- Port the GVRS API to Rust HOT 4
- File corruption can occur when closing file HOT 1
- Improvements to floating point compression following examples of HDF5 and S-102 data HOT 2
- Enhance PackageData application to support Cartesian coordinates HOT 1
- GridFour as a framework for raster processing HOT 28
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gridfour.