huydx / hget Goto Github PK

View Code? Open in Web Editor NEW

984.0 984.0 71.0 25 KB

interruptable, resumable download accelerator written in golang

License: MIT License

Go 97.05% Makefile 2.95%

hget's People

Contributors

Stargazers

Watchers

hget's Issues

Download bug

~/Music — hget http://www.ex.ua/load/43539311
INFO: Resolve ip: 186.2.163.200
INFO: Download target size: 447.1 MB
43539311-0 208.06 MB / 111.77 MB [==================================================================================================================================================] 186.15% -40s
43539311-1 621 B / 111.77 MB [>--------------------------------------------------------------------------------------------------------------------------------------------------------]   0.00% 0
43539311-2 621 B / 111.77 MB [>--------------------------------------------------------------------------------------------------------------------------------------------------------]   0.00% 0
43539311-3 621 B / 111.77 MB [>--------------------------------------------------------------------------------------------------------------------------------------------------------]   0.00% 0

I noticed that the "README.md" file currently includes some code commands that appear to be unsupported or not working as expected. It's important to ensure that the README provides accurate and functional code snippets for a smoother onboarding experience for new users. The Command "go get" is no longer supported outside a module. Instead "go install" and version does work. ex. (go install example.com/cmd@latest).

Thanks!
TheSoosi

Feature: Download from file list

I use axel one the features I miss from wget is the ability to use a file with links to download as input. This will be nice to have.

Not support host contains port,such as http://example:8000/something

fix http.go:47

//       ips, err := net.LookupIP(parsed.Host) 
        host := parsed.Host
        if strings.LastIndex(host, ":") != -1 {
		host = parsed.Host[:strings.LastIndex(host, ":")]
	}
	ips, err := net.LookupIP(host)

Syntax error ?

I installed get using the instructions in the README, and then tried to test it, but ti throws a syntax error :

huydx/hget/bin $➤ ./hget https://github.com/huydx/hget
    ./hget: line 5: syntax error near unexpected token `newline'
    ./hget: line 5: `<!DOCTYPE html>'

gif of the bug

go version go1.7.3 darwin/amd64
macOS Sierra 10.12.1 (16B2555)

Security issue - directory traversal and os.RemoveAll to delete home directory

Vulnerability info:

Susceptible to removing the users entire home DIR due to unsafe handling of links mixed with the os.RemoveAll usage in main.go. This is particularly dangerous with this tool since it follows redirects. There are likely permutations of this exploit that could have much more serious consequences in a targeted attack (elevation).

Minimal example Warning: do not run this, it will remove your home dir:

hget http://domain.com/..

Suggestion:

Do not construct paths in this way, in code.. ever! Always use a deterministic method for building paths using paradigms known to mitigate directory traversal attempts. In your case changing all instances where you build paths, such as FolderOf to use a basic hash function derived from the URL. The key here is to not attempt to derive any file system operations from the file name directly.

i.e.:

func FolderOf(url string) string {
  return filepath.Join(os.Getenv("HOME"), dataFolder, sha1.Sum([]byte(url)))
}

Download folder collision

If I download https://google.com/file.txt it looks like the directory for saving the progress is ~/.hget/file.txt. Is that correct?

If so, what if I pause and then start downloading https://github.com/file.txt, wouldn't they both be saved in ~/.hget/file.txt.

It looks like you're just using the basename to specify a download job

hget/util.go

Line 68 in 03213a9

func TaskFromUrl(url string) string {

I think the download task/folder should be the full url encoded in a way that's safe as a folder name, either a hash of the url or just encode some of the url params.

Build binaries by travis

Would be nice to build binaries for tags (which I also don't see for the moment). Here is an example:

https://github.com/sagikazarmark/bingo-example/blob/master/.travis.yml#L20

I can't download the file on website

hget report

Rel: can't make D:\BT Downloads.hget\k00H8-xm?dl=1 relative to .hgetpanic: Rel: can't make D:\BT Downloads.hget\k00H8-xm?dl=1 relative to .hget

I got this to work in Windows

I just followed the setup instructions in the Readme file, there are some changes

Step 0: Setup GOPATH ENV in your machine
Step 1: go get -d github.com/huydx/hget
Step 2: cd <GOPATH>/src/github.com/huydx/hget // Replace GOPATH with the actual path you set
Step 3: Edit Line 17 in the Makefile to be go build -o 'hget.exe'
Step 4: If you have Make installed you can use the command make install in the hget directory
Step 5: If you dont have Make you can execute these command one by one

go get -d github.com/fatih/color
go get -d github.com/mattn/go-colorable
go get -d github.com/mattn/go-isatty
go get -d gopkg.in/cheggaaa/pb.v1
go get -d github.com/fatih/color
go build -o 'hget.exe'

That's all.

Future Request: Headers

I would love to see this in Future Update of this Project.
It would be awesome if theres an header option in hget.

Proxy support

Please add support to obey:

http_proxy=http://.../
https_proxy=http.../
ftp_proxy=http://../
no_proxy="*.intern,.local,10.*,127.*,localhost"

or written in capital letters.

hget EOFpanic

OS: CentOS7

[razvan@oc8737400701 tmp]$ hget http://ipv4.download.thinkbroadband.com/1GB.zip
INFO: Resolve ip: 80.249.99.148
INFO: Start download with 8 connections
INFO: Download target size: 1.0 GB
1GB.zip-0 128.00 MiB / 128.00 MiB [=============================================================================================================================================] 100.00% 1m7s
1GB.zip-1 92.35 MiB / 128.00 MiB [=======================================================================================================>---------------------------------------] 72.15% 30s
1GB.zip-2 120.26 MiB / 128.00 MiB [======================================================================================================================================>--------] 93.96% 5s
1GB.zip-3 128.00 MiB / 128.00 MiB [============================================================================================================================================] 100.00% 1m16s
1GB.zip-4 41.26 MiB / 128.00 MiB [=============================================>-----------------------------------------------------------------------------------------------] 32.23% 2m46s
1GB.zip-5 128.00 MiB / 128.00 MiB [============================================================================================================================================] 100.00% 1m11s
1GB.zip-6 128.00 MiB / 128.00 MiB [==============================================================================================================================================] 100.00% 51s
1GB.zip-7 128.00 MiB / 128.00 MiB [==============================================================================================================================================] 100.00% 50s
ERROR: unexpected EOFpanic: unexpected EOF

goroutine 1 [running]:
main.Execute(0x7ffc5afe82ed, 0x2f, 0x0, 0x8, 0x1)
/go/src/github.com/huydx/hget/main.go:105 +0xc8e
main.main()
/go/src/github.com/huydx/hget/main.go:58 +0x3b5

hget panic and not resumable when connection reset by peer

% ./bin/hget https://download.jetbrains.com/go/goland-2019.2.dmg\?_ga\=2.155218107.1855567477.1566137657-1279663696.1566137657                                                                                                                               cuonglm@Cuongs-MBP
INFO: Resolve ip: 52.17.184.56 | 52.50.241.213
INFO: Start download with 12 connections
INFO: Download target size: 339.5 MB
goland-2019.2.dmg?_ga=2.155218107.1855567477.1566137657-1279663696.1566137657-0 13.27 MiB / 28.29 MiB [=======================================================================>---------------------------------------------------------------------------------]  46.91% 18m50s
goland-2019.2.dmg?_ga=2.155218107.1855567477.1566137657-1279663696.1566137657-1 28.29 MiB / 28.29 MiB [=========================================================================================================================================================] 100.00% 16m41s
goland-2019.2.dmg?_ga=2.155218107.1855567477.1566137657-1279663696.1566137657-2 18.81 MiB / 28.29 MiB [=====================================================================================================>---------------------------------------------------]  66.50% 08m22s
goland-2019.2.dmg?_ga=2.155218107.1855567477.1566137657-1279663696.1566137657-3 14.61 MiB / 28.29 MiB [===============================================================================>-------------------------------------------------------------------------]  51.65% 15m37s
goland-2019.2.dmg?_ga=2.155218107.1855567477.1566137657-1279663696.1566137657-4 20.58 MiB / 28.29 MiB [===============================================================================================================>-----------------------------------------]  72.74% 04m09s
goland-2019.2.dmg?_ga=2.155218107.1855567477.1566137657-1279663696.1566137657-5 16.33 MiB / 28.29 MiB [========================================================================================>----------------------------------------------------------------]  57.72% 12m13s
goland-2019.2.dmg?_ga=2.155218107.1855567477.1566137657-1279663696.1566137657-6 15.81 MiB / 28.29 MiB [=====================================================================================>-------------------------------------------------------------------]  55.90% 13m04s
goland-2019.2.dmg?_ga=2.155218107.1855567477.1566137657-1279663696.1566137657-7 16.80 MiB / 28.29 MiB [==========================================================================================>--------------------------------------------------------------]  59.39% 11m24s
goland-2019.2.dmg?_ga=2.155218107.1855567477.1566137657-1279663696.1566137657-8 8.98 MiB / 28.29 MiB [================================================>---------------------------------------------------------------------------------------------------------]  31.76% 31m23s
goland-2019.2.dmg?_ga=2.155218107.1855567477.1566137657-1279663696.1566137657-9 5.11 MiB / 28.29 MiB [===========================>----------------------------------------------------------------------------------------------------------------------------]  18.05% 1h14m40s
goland-2019.2.dmg?_ga=2.155218107.1855567477.1566137657-1279663696.1566137657-10 28.29 MiB / 28.29 MiB [========================================================================================================================================================] 100.00% 16m41s
goland-2019.2.dmg?_ga=2.155218107.1855567477.1566137657-1279663696.1566137657-11 15.33 MiB / 28.29 MiB [==================================================================================>---------------------------------------------------------------------]  54.18% 11m52s
ERROR: read tcp 192.168.1.226:50509->13.225.103.16:443: read: connection reset by peerpanic: read tcp 192.168.1.226:50509->13.225.103.16:443: read: connection reset by peer

goroutine 1 [running]:
main.Execute(0x7ffeefbff833, 0x6f, 0x0, 0xc, 0x139d801)
	/Users/cuonglm/go/src/github.com/huydx/hget/main.go:105 +0xd83
main.main()
	/Users/cuonglm/go/src/github.com/huydx/hget/main.go:58 +0x208
±|master ✔| hget
% ./bin/hget tasks                                                                                                                                                                                                                                           cuonglm@Cuongs-MBP
INFO: Currently on going download:
goland-2019.2.dmg?_ga=2.155218107.1855567477.1566137657-1279663696.1566137657
±|master ✔| hget
% ./bin/hget resume https://download.jetbrains.com/go/goland-2019.2.dmg\?_ga\=2.155218107.1855567477.1566137657-1279663696.1566137657                                                                                                                        cuonglm@Cuongs-MBP
INFO: Getting data from /Users/cuonglm/.hget/goland-2019.2.dmg?_ga=2.155218107.1855567477.1566137657-1279663696.1566137657/state.json
ERROR: open /Users/cuonglm/.hget/goland-2019.2.dmg?_ga=2.155218107.1855567477.1566137657-1279663696.1566137657/state.json: no such file or directorypanic: open /Users/cuonglm/.hget/goland-2019.2.dmg?_ga=2.155218107.1855567477.1566137657-1279663696.1566137657/state.json: no such file or directory

goroutine 1 [running]:
main.FatalCheck(...)
	/Users/cuonglm/go/src/github.com/huydx/hget/util.go:16
main.main()
	/Users/cuonglm/go/src/github.com/huydx/hget/main.go:49 +0x6e5

Missing Content-Length in http responses

I found that, can not get content-length when download large files.
$ ./hget http://host/large_file.sql
INFO: Resolve ip: 10.10.0.23
INFO: Target url not contain Content-Length header, fallback to parallel 1
INFO: Start download with 1 connections
INFO: Download size: not specified

resp, err := client.Do(req) FatalCheck(err) if resp.Header.Get(acceptRangeHeader) == "" { Printf("Target url is not supported range download, fallback to parallel 1\n") //fallback to par = 1 par = 1 } //get download range clen := resp.Header.Get(contentLengthHeader) if clen == "" { Printf("Target url not contain Content-Length header, fallback to parallel 1\n") clen = "1" //set 1 because of progress bar not accept 0 length par = 1 resumable = false }

$ curl -I http://host/large_file.sql
HTTP/1.1 200 OK
Accept-Ranges: bytes
Content-Length: 433664897762
Content-Type: text/plain; charset=utf-8
Last-Modified: Wed, 13 Sep 2017 06:00:48 GMT
X-Request-Id: ee9fb164c75a
Date: Wed, 13 Sep 2017 08:14:19 GMT

Please add a license

Could you add license information please?

Feature: Custom Headers

Hi there,
Your script's such a help, keep up the good work 🙂
Please, add custom headers option too!
I sometimes need to add Referer in the headers, but can't, kindly introduce it as a new feature!
Thanks!

Return current connection speed

Hi,

First thank you for your tool 👍

One only thing is missing to me, is a line with the current speed of the "global connection".

Thanks.

Try HTTPS first if scheme is missing

I think projects like this are in a good position to push the envelope with what is considered the norm / standard.

Given a URL like this, for instance:

example.com/files/download.zip

I'm willing to bet HTTP is assumed. I suggest trying HTTPS first:

https://example.com/files/download.zip

And if the connection is refused, only then revert to HTTP.

my download URL is contain special character,then download fail

Environment:Windows
my download URL contain special character;
target URL is supported range download, but hget detect incorrect.

 hget.exe https://d.pcs.baidu.com/file/bab5cf0974c5d1a864e0823f86216800?fid=1560318009-250528-1048376041497695&time=15 12735101&rt=sh&sign=FDTAERVY-DCb740ccc5511e5e8fedcff06b081203-ja6NDIP7uLX6%2FGd2GYy4MpGIODM%3D&expires=8h&chkv=1&chkbd=0&chkpc=et&dp-logid=7928268522202503033&dp-callid=0&r=338272077
INFO: Resolve ip: 111.206.*.*
INFO: Target url is not supported range download, fallback to parallel 1
INFO: Start download with 1 connections
INFO: Download target size: 0.0 MB
ERROR: mkdir C:\Users\user\.hget\bab5cf0974c5d1a864e0823f86216800?fid=1560318009-250528-1048376041497695: The filename, directory name, or volume label syntax is incorrect.The system cannot accept the time entered.
Enter the new time:
'rt' is not recognized as an internal or external command,
operable program or batch file.
'sign' is not recognized as an internal or external command,
operable program or batch file.
'expires' is not recognized as an internal or external command,
operable program or batch file.
'chkv' is not recognized as an internal or external command,
operable program or batch file.
'chkbd' is not recognized as an internal or external command,
operable program or batch file.
'chkpc' is not recognized as an internal or external command,
operable program or batch file.
'dp-logid' is not recognized as an internal or external command,
operable program or batch file.
'dp-callid' is not recognized as an internal or external command,
operable program or batch file.
'r' is not recognized as an internal or external command,
operable program or batch file.

"Over" downloading ?

Hi friend,

First time using the software to download QT Creator.

It seems like it has "over-download" some file parts at more than 100% ? It seems to stop at 400%.

Go luck :)

Hget doesn't finish downloading

Hi,

I just installed hget and tried to download intellij to test. The download continues well after 100%, and in the end I did ctrl-c on the app. Using go version go1.3.3 linux/amd64 on ubuntu 16.04.

➜ bin git:(master) time ./hget https://download.jetbrains.com/idea/ideaIC-2016.2.1.tar.gz INFO: Resolve ip: 54.217.236.18 INFO: Start download with 8 connections INFO: Download target size: 320.6 MB ideaIC-2016.2.1.tar.gz-0 59.04 MB / 40.08 MB [===================================================================================================================================] 147.33% -1m23s ideaIC-2016.2.1.tar.gz-1 67.68 MB / 40.08 MB [===================================================================================================================================] 168.87% -1m45s ideaIC-2016.2.1.tar.gz-2 65.32 MB / 40.08 MB [===================================================================================================================================] 162.98% -1m40s ideaIC-2016.2.1.tar.gz-3 62.48 MB / 40.08 MB [===================================================================================================================================] 155.91% -1m33s ideaIC-2016.2.1.tar.gz-4 64.70 MB / 40.08 MB [===================================================================================================================================] 161.45% -1m38s ideaIC-2016.2.1.tar.gz-5 62.25 MB / 40.08 MB [===================================================================================================================================] 155.32% -1m32s ideaIC-2016.2.1.tar.gz-6 58.30 MB / 40.08 MB [===================================================================================================================================] 145.46% -1m21s ideaIC-2016.2.1.tar.gz-7 58.67 MB / 40.08 MB [===================================================================================================================================] 146.40% -1m22s INFO: Interrupted, saving state ... INFO: Saving current download data in /home/mike/.hget/ideaIC-2016.2.1.tar.gz ./hget https://download.jetbrains.com/idea/ideaIC-2016.2.1.tar.gz 98.78s user 18.40s system 45% cpu 4:20.01 total ➜ bin git:(master) du -ch ~/.hget/ideaIC-2016.2.1.tar.gz 499M /home/mike/.hget/ideaIC-2016.2.1.tar.gz 499M total

can’t download file with port specified in url

as below:

hget http://www.golangtc.com:80/static/go/1.7rc6/go1.7rc6.darwin-amd64.pkg

panic

╰─○ hget http://www.grpc.io/img/grpc_inverse.svg
INFO: Resolve ip: 151.101.16.133
WARN: Target url not contain Content-Length header
INFO: Dowload size: not specified
panic: runtime error: makeslice: len out of range

goroutine 23 [running]:
panic(0x38e3c0, 0xc820136220)
    /usr/local/Cellar/go/1.6.2/libexec/src/runtime/panic.go:481 +0x3e6
strings.Repeat(0x401108, 0x1, 0xfffffffffffffff8, 0x0, 0x0)
    /usr/local/Cellar/go/1.6.2/libexec/src/strings/strings.go:427 +0x5f
gopkg.in/cheggaaa/pb%2ev1.(*ProgressBar).write(0xc8201063c0, 0x1ce6)
    /Users/gonzalo/dev/sp/go/src/gopkg.in/cheggaaa/pb.v1/pb.go:357 +0x10e9
gopkg.in/cheggaaa/pb%2ev1.(*ProgressBar).Finish.func1()
    /Users/gonzalo/dev/sp/go/src/gopkg.in/cheggaaa/pb.v1/pb.go:216 +0x5a
sync.(*Once).Do(0xc820106428, 0xc820053d38)
    /usr/local/Cellar/go/1.6.2/libexec/src/sync/once.go:44 +0xe4
gopkg.in/cheggaaa/pb%2ev1.(*ProgressBar).Finish(0xc8201063c0)
    /Users/gonzalo/dev/sp/go/src/gopkg.in/cheggaaa/pb.v1/pb.go:221 +0x45
main.(*HttpDownloader).Do.func1(0xc8200ee2b0, 0xc8200fa2a0, 0xc82001a660, 0xc82005a620, 0xc82001a6c0, 0xc82001a600, 0xc8200fe0e0, 0x2, 0x7fff5fbfd005, 0x27, ...)
    /Users/gonzalo/dev/sp/go/src/github.com/huydx/hget/http.go:198 +0x9b9
created by main.(*HttpDownloader).Do
    /Users/gonzalo/dev/sp/go/src/github.com/huydx/hget/http.go:204 +0x688

-n not work

i want it download with 5 connections but it download with 2 connections .

./hget https://cdn.kernel.org/pub/linux/kernel/v4.x/linux-4.8.10.tar.xz -n 5
INFO: Resolve ip: 151.101.60.69
INFO: Start download with 2 connections 
INFO: Download target size: 87.7 MB
linux-4.8.10.tar.xz-0 800.15 KB / 43.86 MB [>--------------------]   1.78% 2m57s
linux-4.8.10.tar.xz-1 735.48 KB / 43.86 MB [>--------------------]   1.64% 3m13s
INFO: Interrupted, saving state ...

Hget way slower than WGet

Just tried that :

 ❯ time wget https://storage.googleapis.com/golang/go1.6.3.darwin-amd64.pkg                                            [14:57:13]
--2016-12-07 14:57:13--  https://storage.googleapis.com/golang/go1.6.3.darwin-amd64.pkg
Résolution de storage.googleapis.com (storage.googleapis.com)… 216.58.208.208, 2a00:1450:4007:80d::2010
Connexion à storage.googleapis.com (storage.googleapis.com)|216.58.208.208|:443… connecté.
requête HTTP transmise, en attente de la réponse… 200 OK
Taille : 84842135 (81M) [application/octet-stream]
Sauvegarde en : « go1.6.3.darwin-amd64.pkg.2 »

go1.6.3.darwin-amd64.pkg.2       100%[========================================================>]  80,91M  11,0MB/s    in 8,0s    

2016-12-07 14:57:21 (10,2 MB/s) — « go1.6.3.darwin-amd64.pkg.2 » sauvegardé [84842135/84842135]

# Time : 8,387 total

 ❯ time hget https://storage.googleapis.com/golang/go1.6.3.darwin-amd64.pkg                                            [14:57:33]
INFO: Resolve ip: 216.58.213.144
INFO: Start download with 4 connections 
INFO: Download target size: 80.9 MB
go1.6.3.darwin-amd64.pkg-0 20.13 MB / 20.23 MB [======================================================================]  99.54% 0s
go1.6.3.darwin-amd64.pkg-1 19.94 MB / 20.23 MB [======================================================================]  98.58% 0s
go1.6.3.darwin-amd64.pkg-2 20.23 MB / 20.23 MB [=====================================================================] 100.00% 13s
go1.6.3.darwin-amd64.pkg-3 20.19 MB / 20.23 MB [======================================================================]  99.79% 0s
INFO: Start joining 
Joining 4 / 4 [=======================================================================================================] 100.00% 0s

# Time : 13,894 total

 ❯ time hget -n 1 https://storage.googleapis.com/golang/go1.6.3.darwin-amd64.pkg                                       [14:58:38]
WARN: Downloading task already exist, remove first 
INFO: Resolve ip: 216.58.213.144
INFO: Start download with 1 connections 
INFO: Download target size: 80.9 MB
go1.6.3.darwin-amd64.pkg-0 80.77 MB / 80.91 MB [======================================================================]  99.83% 0s
INFO: Start joining 
Joining 1 / 1 [=======================================================================================================] 100.00% 0s

# Time : 16,535 total

STDOUT no longer works after running

After running ./hget commands are able to be executed, but nothing is visibly typed in. Likely because STDOUT (EDITED) is being redirected to some subshell or process created by hget. I'm running OSX 10.11.1 and have version 1.5.3 of go

fails on ftp, not sure if that's by design?

error message:
`unsupported protocol scheme "ftp"panic: Get ftp://ftp.eyenetworks.no/AirTies/Air%204920/Firmware/AirTies_Air4920NO-EN_FW_1.23.6.4.872.bin: unsupported protocol scheme "ftp"

goroutine 1 [running]:
panic(0x7a6ec0, 0xc82010a450)
/usr/lib/golang/src/runtime/panic.go:481 +0x3e6
main.FatalCheck(0x7f0c43e521b0, 0xc82010a450)
/home/dag/go/src/github.com/huydx/hget/util.go:16 +0x106
main.NewHttpDownloader(0x7ffcb01cb1b7, 0x5d, 0x4, 0x9f7e01, 0x0)
/home/dag/go/src/github.com/huydx/hget/http.go:58 +0x326
main.Execute(0x7ffcb01cb1b7, 0x5d, 0x0, 0x4, 0x1)
/home/dag/go/src/github.com/huydx/hget/main.go:87 +0x4df
main.main()
/home/dag/go/src/github.com/huydx/hget/main.go:58 +0x778
`

hget xfercommand on archlinux gpgme errors

INFO: Resolve ip: 87.121.121.2
INFO: Start download with 8 connections
INFO: Download target size: 0.1 MB
core.db-0 17.60 KiB / 17.60 KiB [===========================================================================================================================================] 100.01% 0s
core.db-1 17.60 KiB / 17.60 KiB [===========================================================================================================================================] 100.01% 0s
core.db-2 17.60 KiB / 17.60 KiB [===========================================================================================================================================] 100.01% 0s
core.db-3 0 B / 17.60 KiB [----------------------------------------------------------------------------------------------------------------------------------------------------] 0.00%
core.db-4 17.60 KiB / 17.60 KiB [===========================================================================================================================================] 100.01% 0s
core.db-5 17.60 KiB / 17.60 KiB [===========================================================================================================================================] 100.01% 0s
core.db-6 17.60 KiB / 17.60 KiB [===========================================================================================================================================] 100.01% 0s
core.db-7 17.60 KiB / 17.60 KiB [===========================================================================================================================================] 100.00% 0s
INFO: Start joining
Joining 8 / 8 [=============================================================================================================================================================] 100.00% 0s
INFO: Resolve ip: 87.121.121.2
INFO: Target url is not supported range download, fallback to parallel 1
INFO: Start download with 1 connections
INFO: Download target size: 0.0 MB
core.db.sig-0 0 B / 237 B [----------------------------------------------------------------------------------------------------------------------------------------------------] 0.00%
INFO: Start joining
Joining 1 / 1 [=============================================================================================================================================================] 100.00% 0s
error: GPGME error: No data
error: failed to update core (invalid or corrupted database (PGP signature))
INFO: Resolve ip: 87.121.121.2
INFO: Start download with 8 connections
INFO: Download target size: 1.8 MB
extra.db-0 225.86 KiB / 225.86 KiB [========================================================================================================================================] 100.00% 1s
extra.db-1 225.86 KiB / 225.86 KiB [========================================================================================================================================] 100.00% 1s
extra.db-2 225.86 KiB / 225.86 KiB [========================================================================================================================================] 100.00% 1s
extra.db-3 225.86 KiB / 225.86 KiB [========================================================================================================================================] 100.00% 1s
extra.db-4 225.86 KiB / 225.86 KiB [========================================================================================================================================] 100.00% 1s
extra.db-5 210.94 KiB / 225.86 KiB [===============================================================================================================================>--------] 93.39% 0s
extra.db-6 225.86 KiB / 225.86 KiB [========================================================================================================================================] 100.00% 1s
extra.db-7 225.86 KiB / 225.86 KiB [========================================================================================================================================] 100.00% 1s
INFO: Start joining
Joining 8 / 8 [=============================================================================================================================================================] 100.00% 0s
INFO: Resolve ip: 87.121.121.2
INFO: Target url is not supported range download, fallback to parallel 1
INFO: Start download with 1 connections
INFO: Download target size: 0.0 MB
extra.db.sig-0 0 B / 239 B [---------------------------------------------------------------------------------------------------------------------------------------------------] 0.00%
INFO: Start joining
Joining 1 / 1 [=============================================================================================================================================================] 100.00% 0s
error: GPGME error: No data
error: failed to update extra (invalid or corrupted database (PGP signature))
INFO: Resolve ip: 87.121.121.2
INFO: Start download with 8 connections
INFO: Download target size: 4.2 MB
community.db-0 532.05 KiB / 532.05 KiB [====================================================================================================================================] 100.00% 1s
community.db-1 532.05 KiB / 532.05 KiB [====================================================================================================================================] 100.00% 1s
community.db-2 532.05 KiB / 532.05 KiB [====================================================================================================================================] 100.00% 1s
community.db-3 532.05 KiB / 532.05 KiB [====================================================================================================================================] 100.00% 1s
community.db-4 532.05 KiB / 532.05 KiB [====================================================================================================================================] 100.00% 1s
community.db-5 532.05 KiB / 532.05 KiB [====================================================================================================================================] 100.00% 1s
community.db-6 532.05 KiB / 532.05 KiB [====================================================================================================================================] 100.00% 1s
community.db-7 343.75 KiB / 532.06 KiB [=====================================================================================>----------------------------------------------] 64.61% 0s
INFO: Start joining
Joining 8 / 8 [=============================================================================================================================================================] 100.00% 0s
INFO: Resolve ip: 87.121.121.2
INFO: Target url is not supported range download, fallback to parallel 1
INFO: Start download with 1 connections
INFO: Download target size: 0.0 MB
INFO: Start joining
Joining 1 / 1 [=============================================================================================================================================================] 100.00% 0s
error: GPGME error: No data
error: failed to update community (invalid or corrupted database (PGP signature))
INFO: Resolve ip: 87.121.121.2
INFO: Start download with 8 connections
INFO: Download target size: 0.2 MB
multilib.db-0 22.68 KiB / 22.68 KiB [=======================================================================================================================================] 100.00% 0s
multilib.db-1 22.68 KiB / 22.68 KiB [=======================================================================================================================================] 100.00% 0s
multilib.db-2 15.62 KiB / 22.68 KiB [=============================================================================================>-----------------------------------------] 68.90% 0s
multilib.db-3 22.68 KiB / 22.68 KiB [=======================================================================================================================================] 100.00% 0s
multilib.db-4 22.68 KiB / 22.68 KiB [=======================================================================================================================================] 100.00% 0s
multilib.db-5 15.62 KiB / 22.68 KiB [=============================================================================================>-----------------------------------------] 68.90% 0s
multilib.db-6 0 B / 22.68 KiB [------------------------------------------------------------------------------------------------------------------------------------------------] 0.00%
multilib.db-7 22.68 KiB / 22.68 KiB [=======================================================================================================================================] 100.00% 0s
INFO: Start joining
Joining 8 / 8 [=============================================================================================================================================================] 100.00% 0s
INFO: Resolve ip: 87.121.121.2
INFO: Target url is not supported range download, fallback to parallel 1
INFO: Start download with 1 connections
INFO: Download target size: 0.0 MB
INFO: Start joining
Joining 1 / 1 [=============================================================================================================================================================] 100.00% 0s
error: GPGME error: No data
error: failed to update multilib (invalid or corrupted database (PGP signature))
error: failed to synchronize any databases
error: failed to init transaction (invalid or corrupted database (PGP signature))
1 root@FX8320-GA-990-FXA-UD3 ~ # nano /etc/pacman.conf :(
root@FX8320-GA-990-FXA-UD3 ~ # pacman -Syy
warning: config file /etc/pacman.conf, line 50: directive 'SygLevel' in section 'options' not recognized.
error: GPGME error: No data
error: GPGME error: No data
error: GPGME error: No data
error: GPGME error: No data
:: Synchronizing package databases...
INFO: Resolve ip: 87.121.121.2
INFO: Start download with 8 connections
INFO: Download target size: 0.1 MB
core.db-0 17.60 KiB / 17.60 KiB [===========================================================================================================================================] 100.01% 0s
core.db-1 0 B / 17.60 KiB [----------------------------------------------------------------------------------------------------------------------------------------------------] 0.00%
core.db-2 0 B / 17.60 KiB [----------------------------------------------------------------------------------------------------------------------------------------------------] 0.00%
core.db-3 17.60 KiB / 17.60 KiB [===========================================================================================================================================] 100.01% 0s
core.db-4 7.81 KiB / 17.60 KiB [==============================================================>-----------------------------------------------------------------------------] 44.39% 0s
core.db-5 0 B / 17.60 KiB [----------------------------------------------------------------------------------------------------------------------------------------------------] 0.00%
core.db-6 17.60 KiB / 17.60 KiB [===========================================================================================================================================] 100.01% 0s
core.db-7 17.60 KiB / 17.60 KiB [===========================================================================================================================================] 100.00% 0s
INFO: Start joining
Joining 8 / 8 [=============================================================================================================================================================] 100.00% 0s
INFO: Resolve ip: 87.121.121.2
INFO: Target url is not supported range download, fallback to parallel 1
INFO: Start download with 1 connections
INFO: Download target size: 0.0 MB
INFO: Start joining
Joining 1 / 1 [=============================================================================================================================================================] 100.00% 0s
error: GPGME error: No data
error: failed to update core (invalid or corrupted database (PGP signature))
INFO: Resolve ip: 87.121.121.2
INFO: Start download with 8 connections
INFO: Download target size: 1.8 MB
extra.db-0 225.86 KiB / 225.86 KiB [========================================================================================================================================] 100.00% 3s
extra.db-1 225.86 KiB / 225.86 KiB [========================================================================================================================================] 100.00% 3s
extra.db-2 225.86 KiB / 225.86 KiB [========================================================================================================================================] 100.00% 3s
extra.db-3 225.86 KiB / 225.86 KiB [========================================================================================================================================] 100.00% 3s
extra.db-4 225.86 KiB / 225.86 KiB [========================================================================================================================================] 100.00% 3s
extra.db-5 125.00 KiB / 225.86 KiB [===========================================================================>------------------------------------------------------------] 55.34% 2s
extra.db-6 225.86 KiB / 225.86 KiB [========================================================================================================================================] 100.00% 3s
extra.db-7 225.86 KiB / 225.86 KiB [========================================================================================================================================] 100.00% 3s
INFO: Start joining
Joining 8 / 8 [=============================================================================================================================================================] 100.00% 0s
INFO: Resolve ip: 87.121.121.2
INFO: Target url is not supported range download, fallback to parallel 1
INFO: Start download with 1 connections
INFO: Download target size: 0.0 MB
INFO: Start joining
Joining 1 / 1 [=============================================================================================================================================================] 100.00% 0s
error: GPGME error: No data
error: failed to update extra (invalid or corrupted database (PGP signature))
INFO: Resolve ip: 87.121.121.2
INFO: Start download with 8 connections
INFO: Download target size: 4.2 MB
community.db-0 532.05 KiB / 532.05 KiB [====================================================================================================================================] 100.00% 1s
community.db-1 532.05 KiB / 532.05 KiB [====================================================================================================================================] 100.00% 1s
community.db-2 532.05 KiB / 532.05 KiB [====================================================================================================================================] 100.00% 1s
community.db-3 531.25 KiB / 532.05 KiB [====================================================================================================================================] 99.85% 0s
community.db-4 532.05 KiB / 532.05 KiB [====================================================================================================================================] 100.00% 1s
community.db-5 532.05 KiB / 532.05 KiB [====================================================================================================================================] 100.00% 1s
community.db-6 532.05 KiB / 532.05 KiB [====================================================================================================================================] 100.00% 1s
community.db-7 532.06 KiB / 532.06 KiB [====================================================================================================================================] 100.00% 1s
INFO: Start joining
Joining 8 / 8 [=============================================================================================================================================================] 100.00% 0s
INFO: Resolve ip: 87.121.121.2
INFO: Target url is not supported range download, fallback to parallel 1
INFO: Start download with 1 connections
INFO: Download target size: 0.0 MB
INFO: Start joining
Joining 1 / 1 [=============================================================================================================================================================] 100.00% 0s
error: GPGME error: No data
error: failed to update community (invalid or corrupted database (PGP signature))
INFO: Resolve ip: 87.121.121.2
INFO: Start download with 8 connections
INFO: Download target size: 0.2 MB
multilib.db-0 22.68 KiB / 22.68 KiB [=======================================================================================================================================] 100.00% 0s
multilib.db-1 22.68 KiB / 22.68 KiB [=======================================================================================================================================] 100.00% 0s
multilib.db-2 22.68 KiB / 22.68 KiB [=======================================================================================================================================] 100.00% 0s
multilib.db-3 22.68 KiB / 22.68 KiB [=======================================================================================================================================] 100.00% 0s
multilib.db-4 22.68 KiB / 22.68 KiB [=======================================================================================================================================] 100.00% 0s
multilib.db-5 15.62 KiB / 22.68 KiB [=============================================================================================>-----------------------------------------] 68.90% 0s
multilib.db-6 22.68 KiB / 22.68 KiB [=======================================================================================================================================] 100.00% 0s
multilib.db-7 0 B / 22.68 KiB [------------------------------------------------------------------------------------------------------------------------------------------------] 0.00%
INFO: Start joining
Joining 8 / 8 [=============================================================================================================================================================] 100.00% 0s
INFO: Resolve ip: 87.121.121.2
INFO: Target url is not supported range download, fallback to parallel 1
INFO: Start download with 1 connections
INFO: Download target size: 0.0 MB
multilib.db.sig-0 0 B / 245 B [------------------------------------------------------------------------------------------------------------------------------------------------] 0.00%
INFO: Start joining
Joining 1 / 1 [=============================================================================================================================================================] 100.00% 0s
error: GPGME error: No data
error: failed to update multilib (invalid or corrupted database (PGP signature))
error: failed to synchronize any databases
error: failed to init transaction (invalid or corrupted database (PGP signature))

Support wget-like resume

This is a fantastic tool, thank you!

Is there any chance of supporting something like wget's continue flag?

wget -c http://foo.bar/baz

That will check for baz to continue, and if it exists, resume the transfer. If it doesn't exist, it starts a new transfer.

Right now, I have to run hget tasks (or guess at the task name) and then run hget resume taskname. I'd love to be able to just run hget -c http://foo.bar/baz (or -r or whatever) and have it look for an existing download to resume and help me out a bit.

Again, super minor niggle, this is a great tool. I'm easily able to saturate my connection! ❤️

Feature: Specify download folder

As the title says. A command parameter to specify a download directory instead of just the directory the command was launched from.

tlsClient: No such file or directory

Felix:actor sunfmin$ hget https://download.docker.com/mac/stable/Docker.dmg
tlsClient: No such file or directory
tlsClient: No such file or directory
tlsClient: No such file or directory
tlsClient: No such file or directory
tlsClient: No such file or directory
tlsClient: No such file or directory
tlsClient: No such file or directory
tlsClient: No such file or directory
tlsClient: No such file or directory
tlsClient: No such file or directory
tlsClient: No such file or directory
hget: too many errors with no progress No such file or directory

huydx / hget Goto Github PK

hget's People

Contributors

Stargazers

Watchers

Forkers

hget's Issues

Recommend Projects

Recommend Topics

Recommend Org

Jobs