GithubHelp home page GithubHelp logo

MiGz未能解压缩GZIP压缩数据 about migz HOT 5 OPEN

jyf1997 avatar jyf1997 commented on August 14, 2024
MiGz未能解压缩GZIP压缩数据

from migz.

Comments (5)

jeffpasternack avatar jeffpasternack commented on August 14, 2024

Hi--unfortunately, I do not speak Chinese. If possible, could you please restate your issue in English?

from migz.

jyf1997 avatar jyf1997 commented on August 14, 2024

I used GZIP and MiGz to compress the same data respectively, and found that there are several differences in the data compressed by MiGz. The data are as follows:
GZIP1: 1f8b08000000000000003334323634320400ee129cde06000000
MiGz1: 1f8b080400000000020008004d5a0400080000003334323634320400ee129cde06000000
GZIP2: 1f8b08000000000000002b4b2c4b492c2b4b4c010071ec6fe909000000
MiGz2: 1f8b080400000000020008004d5a04000b0000002b4b2c4b492c2b4b4c010071ec6fe909000000
How can I adjust to keep the data compressed by MiGZ consistent with that of GZIP compression?

from migz.

jeffpasternack avatar jeffpasternack commented on August 14, 2024

This is expected behavior--MiGz uses a different header than other GZip tools, and may or may not be using the same block compression. However, any GZip program will still be able to decompress a MiGz-compressed file.

Incidentally, other GZip implementations are also free to produce different bytes, so there's no guarantee that two GZip utilities will produce the exact same data when compressing the same file.

from migz.

jyf1997 avatar jyf1997 commented on August 14, 2024

we have some data compressed using gzip and want to use miGZ, but we are not allowed to ungip and re-miGZ previouse data. Can we still use miGZ to decompress the previouse data that are compressed using gzip? Thanks

from migz.

jeffpasternack avatar jeffpasternack commented on August 14, 2024

Unfortunately it's not (in general) possible to do multithreaded decompression of data GZipped by standard utilities, so using MiGz would have no benefit in this case, and MiGz consequently does not support decompression of non-MiGz-compressed data.

As an aside, if you have multiple GZipped files you need to read, you might consider unzipping each file in separate thread to achieve a degree of parallelism.

from migz.

Related Issues (8)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.