ip2location / ip2proxy-go

IP2Proxy Go package allows users to query an IP address to determine if it was being used as open proxy, web proxy, VPN anonymizer and TOR exits.

IP2Proxy Go Package

This package allows user to query an IP address if it was being used as VPN anonymizer, open proxies, web proxies, Tor exits, data center, web hosting (DCH) range, search engine robots (SES), residential proxies (RES), consumer privacy networks (CPN), and enterprise private networks (EPN). It lookup the proxy IP address from IP2Proxy BIN Data file. This data file can be downloaded at

• Free IP2Proxy BIN Data: https://lite.ip2location.com
• Commercial IP2Proxy BIN Data: https://www.ip2location.com/database/ip2proxy

Developer Documentation

To learn more about installation, usage, and code examples, please visit the developer documentation at https://ip2proxy-go.readthedocs.io/en/latest/index.html.

ip2proxy-go's Issues

GetAll causes runtime exception

Hi,

We recently upgraded our ip2proxy package version from 2.2.0 to 2.3.0, and we started to get the following exception on calling db.GetAll("8.8.8.8"):

panic: runtime error: slice bounds out of range [:16] with capacity 12

goroutine 1 [running]:
github.com/ip2location/ip2proxy-go.(*DB).readuint32_row(0xc0001ce070, 0xc00049af10, 0xc, 0xc, 0xc, 0x0)
	/Users/USER/go/pkg/mod/github.com/ip2location/[email protected]+incompatible/ip2proxy.go:195 +0xbf
github.com/ip2location/ip2proxy-go.(*DB).query(0xc0001ce070, 0x177e7ea, 0x7, 0xc000000fff, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
	/Users/USER/go/pkg/mod/github.com/ip2location/[email protected]+incompatible/ip2proxy.go:874 +0x10f6
github.com/ip2location/ip2proxy-go.(*DB).GetAll(0xc0001ce070, 0x177e7ea, 0x7, 0x0, 0x0, 0x0)
	/Users/USER/go/pkg/mod/github.com/ip2location/[email protected]+incompatible/ip2proxy.go:636 +0xb5
...

After trying to debug it, I've found out that the exception is caused at:

ip2proxy-go/ip2proxy.go

Lines 871 to 877 in 5f6cbea

	if mode&city != 0 && d.city_enabled {
	// x.City = readstr(readuint32(rowoffset + city_position_offset))
	// x.City = readstr(readuint32_row(row, city_position_offset))
	if x.City, err = d.readstr(d.readuint32_row(row, d.city_position_offset)); err != nil {
	return x, err
	}
	}

row is 12 bytes and d.readuint32_row tries to read range [12:16].

We need this fixed to use release v2.3.0 to benefit from concurrency improvements.

Some suggestion to reduce memory allocation for better performance

Background:

• Recently, my company project is adopting ip2location vendor as the main IP DB source and we found that this package is running unexpectedly slow.

Findings:

• A lot of memory allocation (Although there are some optimisation changes added to the latest version v3.4.1).
• Map is abused as getter result even though fields are known.

Optimisation:

• Replace big.Int with "lukechampine.com/uint128" (Credit: @calvinxiao)
• Replace map with struct in its GetAll method like "https://github.com/ip2location/ip2location-go"
• Use no-copy bytes to string conversion suggested here: "golang/go#25484"

Benchmark:

• Using Google Bot's IP:"66.249.66.1" as input:

goos: darwin
goarch: amd64
pkg: draft.65
cpu: Intel(R) Core(TM) i7-9750H CPU @ 2.60GHz
Benchmark2WithMemoryReader_PX11
Benchmark2WithMemoryReader_PX11-12        	  241352	      4778 ns/op	    7014 B/op	      80 allocs/op
Benchmark2WithMemoryReader_PX11_New
Benchmark2WithMemoryReader_PX11_New-12    	  804042	      1355 ns/op	    3928 B/op	      24 allocs/op
PASS

May I know if you guys are fine to accept my PR to know more? (incl. "https://github.com/ip2location/ip2location-go")