Comments (10)
Hi. Any news on this one? Thx
from gulp-hash.
Hey! I will look into this ASAP. I will be out of town for the weekend but I'll try to get this fixed next week.
from gulp-hash.
Pushed out a potential fix (cd6264d). Can you give it a try, @zepedrorocha or @joaocc?
It should be out on NPM soon as well, version 2.2.1.
from gulp-hash.
Hey sorry for the slow reply.
Now it's not even completing the gulp task. Something breaks the pipeline but no error is given.
return gulp.src('./pack.unitypackage', { //100 MB
buffer: false
})
.pipe(gulp.dest('./temp')); //100 MB file
return gulp.src('./pack.unitypackage', { //100 MB
buffer: false
})
.pipe(hash())
.pipe(gulp.dest('./temp')); // no file. The task that has this piece of code doesn't even finish.
Using gulp 3.9.0 and gulp-hash 2.2.1
from gulp-hash.
Hey,
I pushed out a new fix (version 2.2.2, commit 4694365). The old version didn't wait for the file contents to finish streaming to a temporary buffer (which is restreamed later) and pushed the file onward before being done with it (small files were fine).
Can you check if this one works?
from gulp-hash.
Hey 2 problems. gulp task still not finish like it should. Having multiple src files will only exec the first pipeline file (I tested this with files <1GB).
And the other problem is that you are creating a new Buffer() which is basically invalidating the "buffer: false". Throws an error when a file is >1GB
"buffer.js:71
throw new RangeError('Attempt to allocate Buffer larger than maximum '
RangeError: Attempt to allocate Buffer larger than maximum size: 0x3fffffff bytes."
from gulp-hash.
Hmm, the crypto module definitely supports .update() to hash streamed contents without loading it all into a buffer, but if I change to that method, I need to figure out how to deal with custom hashing functions (or maybe I'll just phase those out altogether, not a very useful feature really). I'll look into this.
The problem with multiple src files I wasn't able to reproduce; I tried by having two ~120MB files in gulp.src and the command finished properly and the hashed files were output. Are you able to give more specific steps to reproducing this issue?
from gulp-hash.
Hi.
We are processing around 280 files, with total size of 13GB. Basically we calculate the hash of all files. luckily only one of those is larger than 1GB.
An alternative to sending you the file repo (which might be difficult) would be to use some kind of instrumented version of the plugin, for analysis after the crash.
Would you be able to do that?
Thx
from gulp-hash.
I rewrote most of the plugin and it should use streams properly now. Can you give it a try? The update is on its own branch at the moment and not on npm yet, so you'll need to do npm install git://github.com:Dragory/gulp-hash.git#3.0.0
Edit: 3.0.0 is now live. Doing npm install --save-dev [email protected]
should do the trick.
from gulp-hash.
I'm closing this issue due to inactivity. Tests related to streams are currently passing. If you still encounter problems using streams, please comment here or open a new issue!
from gulp-hash.
Related Issues (19)
- [ReferenceError: fs is not defined] HOT 4
- Keep getting same hashing values (even with different algorithms) HOT 6
- Different hash on different machine HOT 2
- options.append doesn't seem to be working anymore HOT 3
- Delete Multiple Old Files
- Append is not working... HOT 6
- deleteOld not working? HOT 2
- Add support for SourceMaps
- Can we have a diff hash whenever we run the gulp task? HOT 1
- Remove gulp-util HOT 3
- All hashes in different hash files
- More flexible way to append to a manifest? HOT 10
- Please elaborate on your documentation with an example on how to call the hashed generated file from HTML HOT 1
- give a bundled asset and its sourcemap the same hash
- add basePath option to hash.manifest options object HOT 2
- When setting some Options they are irgnored HOT 1
- FYI: NPM still on 2.0.4 version HOT 2
- Option version HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gulp-hash.