hdm / inetdata Goto Github PK

Looks like the normalize method is not implemented in the caida_prefix2as data source. My Ruby is really poor so I'm not sure what's going on here. What can I do to provide additional context?

2017-08-05 00:13:20 [normalize] Error: Source caida_prefix2as threw an exception: RuntimeError Normalize not implemented for source caida_prefix2as ["/mnt/data_lake/Research/inetdata/lib/inetdata/source/base.rb:64:in `normalize'", "/mnt/data_lake/Research/inetdata/bin/normalize.rb:80:in `block in <main>'", "/mnt/data_lake/Research/inetdata/bin/normalize.rb:78:in `each'", "/mnt/data_lake/Research/inetdata/bin/normalize.rb:78:in `<main>'"]

Hi hdm,

could you please help me with below error message to get that great tool running. I'd really love to use it, but I don't understand where to put the tools into the execution path. :-)

:/opt/inetdata/bin# ./normalize.sh
2018-10-04 07:18:36 [normalize] Warning: Source wwwsio is disabled due to configuration
2018-10-04 07:18:36 [normalize] Warning: Source ct must be specified manually
2018-10-04 07:18:36 [normalize] Warning: Source censys_ipv4 must be specified manually
2018-10-04 07:18:36 [normalize] Warning: Source whoisxmlapi is disabled due to configuration
2018-10-04 07:18:36 [normalize] Warning: Source censys_certs must be specified manually
2018-10-04 07:18:36 [normalize] Warning: Source czds is disabled due to configuration
2018-10-04 07:18:36 [normalize] Warning: Source arin is disabled due to configuration
2018-10-04 07:18:36 [normalize] Warning: Source premiumdrops is disabled due to configuration
2018-10-04 07:18:36 [normalize] Normalize initiated with sources: govuk, sonar, rir, caida_prefix2as, gov
2018-10-04 07:18:36 [normalize] Error: Source govuk threw an exception: RuntimeError No dataset available for govuk ["/opt/inetdata/lib/inetdata/source/govuk.rb:173:in latest_data'", "/opt/inetdata/lib/inetdata/source/govuk.rb:128:in normalize'", "/opt/inetdata/bin/normalize.rb:80:in block in <main>'", "/opt/inetdata/bin/normalize.rb:78:in each'", "/opt/inetdata/bin/normalize.rb:78:in <main>'"] **2018-10-04 07:18:36 [normalize] [sonar] The inetdata-parsers tools are not in the execution path, aborting normalization** 2018-10-04 07:18:36 [normalize] Error: Source gov threw an exception: RuntimeError No dataset available for gov ["/opt/inetdata/lib/inetdata/source/gov.rb:129:in latest_data'", "/opt/inetdata/lib/inetdata/source/gov.rb:90:in normalize'", "/opt/inetdata/bin/normalize.rb:80:in block in

'", "/opt/inetdata/bin/normalize.rb:78:in each'", "/opt/inetdata/bin/normalize.rb:78:in '"]
2018-10-04 07:18:36 [normalize] Normalize completed with sources: govuk, sonar, rir, caida_prefix2as, gov
:/opt/inetdata/bin# ./normalize.sh

Thanks so much.

Marcus