abh / ntppool

NTP Pool Project

NTP Pool Project

This is the code for the NTP Pool project, http://www.pool.ntp.org/

See the LICENSE file for detailed copyright and licensing information.

For installation instructions, see https://dev.ntppool.org/install/ or https://hub.helm.sh/charts/ntppool/ntppool

Other relevant repositories are at

• https://github.com/abh/geodns/
• https://github.com/ntppool/monitor/
• https://github.com/ntppool/archiver/

License

• Copyright 2005-2020 Ask Bjørn Hansen, Develooper LLC

• Copyright 2003-2005 Adrian von Bidder

  Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

  http://www.apache.org/licenses/LICENSE-2.0

  Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

ntppool's Issues

Deploy new monitor system to ntppool prod environment

Make RRD data and graphs include all monitor stations

On the rrd graphs we need to include all monitor stations with data for that server; in addition to the "total" data as saved in the "servers" table (and with monitor_id=NULL in the log_scores table).

Monitor leap flag

Monitor the leap flag in the server replies. For now just monitor it and show it on the relevant pages; later make the score be affected when the flag is wrong.

Depends on #54.

The only real use of this is alerting server operators. ntpds will already use the IP address and SNTP clients don't care about the leap flag (generally at least).

Sort sub-zones on zone pages

At some point the zone pages lost the sorting of sub-zones: http://www.pool.ntp.org/zone/asia

v2.3

Update use.html page to explain the geo location

use.html claims geo location isn't working, update the page to say that it is but explain the limitations.

Disassociate RRD storage and graphing from the main site

Support custom vendor zone dns roots

Work better with small zones

Small zones should fallback to the "upstream" zone. Maybe if there are less than X servers, only populate the not-numbered and 0 zone with servers from that country.

v2.3

Fix servers added by name

Sometimes when a server is added by name (maybe when the DNS lookup fails?) the system tries adding the name as the IP address and it doesn't go well.

Make yu.pool be served by the european pool

there's no more .yu, so make yu.pool not be in the web interface.

• Assign the current servers there to the appropriate country
• Make DNS queries going there be cnamed or otherwise serviced by the european pool

Update windows instructions on use.html page

I'm mailing you to inform that the option /SETSNTP in the http://www.pool.ntp.org/en/use.html page is degraded. Now it is used "w32tm.exe /config /manualpeerlist:<address>" command to set up the windows 7 ntp service.

Braiam Peguero

Review/remove/replace <div class="block">

Just about all the templates have

. Maybe it's harmless, but if not we should remove/replace it as appropriate. If it makes sense, maybe it should just be around [% content %] in the style template.

$ grep -lr '<div class="block">' docs
docs/manage/tpl/manage/delete_instructions.html
docs/manage/tpl/manage/delete_set.html
docs/manage/tpl/vendor/form.html
docs/manage/tpl/vendor/show.html
docs/manage/tpl/vendor/submitted.html
docs/manage/tpl/vendor.html
docs/ntppool/ca/join/configuration.html
docs/ntppool/ca/join.html
docs/ntppool/ca/use.html
docs/ntppool/de/join/configuration.html
docs/ntppool/de/join.html
docs/ntppool/de/use.html
docs/ntppool/dns-server.html
docs/ntppool/en/join/configuration.html
docs/ntppool/en/join.html
docs/ntppool/en/use.html
docs/ntppool/equipment/application.html
docs/ntppool/es/join/configuration.html
docs/ntppool/es/join.html
docs/ntppool/es/use.html
docs/ntppool/fi/join/configuration.html
docs/ntppool/fi/join.html
docs/ntppool/fi/use.html
docs/ntppool/fr/join.html
docs/ntppool/fr/vendors.html
docs/ntppool/index.html
docs/ntppool/jp/join/configuration.html
docs/ntppool/jp/join.html
docs/ntppool/jp/use.html
docs/ntppool/ko/join/configuration.html
docs/ntppool/ko/join.html
docs/ntppool/ko/use.html
docs/ntppool/mailinglists.html
docs/ntppool/nl/join/configuration.html
docs/ntppool/nl/join.html
docs/ntppool/nl/use.html
docs/ntppool/ru/join/configuration.html
docs/ntppool/ru/join.html
docs/ntppool/ru/use.html
docs/ntppool/sv/join/configuration.html
docs/ntppool/sv/join.html
docs/ntppool/sv/use.html
docs/ntppool/tpl/equipment/form.html
docs/ntppool/tpl/equipment/show.html
docs/ntppool/tpl/user/profile_not_public.html
docs/ntppool/tpl/zone.html
docs/ntppool/translators.html
docs/ntppool/uk/join/configuration.html
docs/ntppool/uk/join.html
docs/ntppool/uk/use.html
docs/ntppool/vendors/contribute.html
docs/ntppool/vendors.html
docs/shared/tpl/server.html

Make undelete work again

I have canceled the deletion of 93.125.234.34 on 2011-07-25. The machine is not enabled again. Could you look into this?

On undeleting we need to make sure server_scores have the relevant entries setup so monitoring gets scheduled again.

Parser for mtr --raw format

The monitor nodes should be able to do a traceroute when a node is down.

First thing to do for this is to have a bit of perl code that can parse the 'mtr --raw' format and format it pretty with perl/template toolkit code.

(After that we can build the monitors to understand a "do a traceroute" request and the central system to know when to ask the monitors to do a traceroute and archive the result).

Add more logging to staff API use

Add IPv6 setting for vendor zones

Add setting to control IPv6 availability on vendor zones.

Can't delete servers

Server just times out or returns an error when trying to delete a server. See

http://rt.develooper.com/rt/Ticket/Display.html?id=2503

Add extra attributes data to log_scores

Add extra 'attributes' column (JSON packed) to the log_scores table for extra monitoring information.

Automatic traceroutes

Periodically (daily?) do a traceroute to each monitored server. On changes in health (from good to bad or bad to better) do a traceroute if it's not been done within ~20 minutes.

Update scores page to explain the accuracy better

Add explanation of asynchronous routing affecting measurements of very accurate servers.

Setup rrd_worker in ntpbeta environment

Make monitor script a daemon

Change monitor script to run continuously (under supervise, systemd, launchd etc – not daemonized, though that could be an option, too).

Whenever the last API 'poll' returned servers to check it should do so again immediately after posting results; if there were no servers to check, wait two minutes before polling again.

Replace the LanguagePath controller

Replace NTPPool::Control::LanguagePath with middleware or some such.

Fix adding a server by hostname

(Just make it work for IPv4 again at least).

Currently errors out with:

Can't call method "iptype" on an undefined value at lib/NTPPool/Control/Manage.pm line 155.

(reported by DizZa - http://www.pool.ntp.org/user/dizza )

Add legend back on zone graphs

http://www.pool.ntp.org/zone/nl etc needs a legend again.

Turquoise: Total number of servers
Green: active/working servers
Yellow: inactive/bad/down servers

Solid lines: IPv4
Dotted lines: IPv6

Restructure user_privileges table

The user_privileges table should be user_id and privilege varchar or maybe privilege_id pointing to another table instead of a tinyint column for each privilege.

Make sure IPv6 addresses are stored "compressed"

We need to make sure we normalize the IPv6 addresses when the servers are added. We could either do it with two unsigned BIGINTs (and store them numerically); but the space isn't really a concern and it's convenient to have them easily readable I think; so better to keep storing them like we are now – but normalized ...

Some of the IP related CPAN modules have a "compress IPv6 address" function or method; but I haven't looked too closely at any of them (they all have terrible APIs). Net::IP::XS seemed promising.

Include monitor name in csv export

When exporting log data in csv format; include the monitor name.

Clarify join/configuration.html page

The join/configuration.html page could describe more clearly the "3-5" server requirement.

Replace YUI grids with bootstrap grids

The sidebar navigation is setup with yui grids. Need to remove grids.css from docs/shared/static/.static.groups.json and change the markup to work with the bootstrap grid css.

The yui- classes are only used in docs/shared/tpl/style/default.html (and base.html in the same directory, but that is only used for an internal page).

Spacing above top navigation

The spacing above and around the logo and the top navigation (the three graphical buttons) isn't as neat as it was with YUI reset.

Do AAAA DNS lookups when adding servers

When adding servers by name, also do an AAAA lookup and offer to add the IPv6 IPs if any to the pool, too. (Probably present a list of IPs with check boxes (checked by default) to approve.

See also issue #3.

Better sanity checking in monitor script

Use Capture::Tiny to run ntpdc -c loopinfo or ntpq -c rv to check that the offset is < 20ms.

Should look for ntpdc or ntpq executables in the PATH and in various other standard locations (specifically /usr/sbin/).

Fix bug making some servers not get added to the meta "all" zone (".")

Maybe if you add a server that didn't get geo-ip identified it doesn't get added to the "." zone?

NTP-pool zone stats do not update

the zone statistics are not updated. For example
http://www.pool.ntp.org/zone/nl
shows a raise of 26 for several days, while the total stays at 151 servers for "today". This is the case for multiple (all?) zones.

This reveals two issues.

1. the statistics seem to be stuck at a certain date (given the increase, it is likely the first day IPv6 servers were counted).
2. the statistics page have no reference to the last date/time they were updated, so it is impossible to tell if you are looking at actual or outdated statistics.

Create a sample ntpd.conf file for the join.html page

Too much spacing around headers

On the /en/mailinglists.html page there's a bit too much margin/padding/spacing below the headers.

Release PSGI version to production site

Fix user profile link from manage page

Upgrade ntpbeta to plack version

Update use.html with information about 'pool' statement

Update use.html with information about 'pool' statement and review what the short version on the /zone pages should recommend.

Add more monitors

Spacing around sub-header on homepage

There's too much spacing above/below the "pool.ntp.org: public ntp time server for everyone" sub-header on the homepage.

Show a decimal point in the ms y axis when all measurements are within ~2ms

Display IPv6 hosts in server counts

It would be nice if the UI would display how many IPv6 servers we have in each region.

For the condensed views (eg. Active Servers), I propose to put the IPv6 counts into parentheses, e.g.

Africa 0
Asia 4 (IPv6: 2)
Europe 91 (IPv6: 20)
North America 30 (IPv6: 4)
Oceania 1
South America 10 (IPv6: 2)

Alternatively, we could always use an IPv4:IPv6 syntax, so that people may recognize what

Germany — de.beta.grundclock.com (16:14)

means.

On the individual region pages, I'd have two separate listings:

There are 93 active servers in this zone.
history

20 of these are reachable over IPv6
history

Make score urls work with IPv6 addresses ending in the zero stanza

#From George Shammas:

It is a minor issue, but an ipv6 address that ends in zero stanza,
creates a 301 redirect removing it entirely.

http://www.pool.ntp.org/scores/2001:470:1f07:1278:cafe:: redirects to
http://www.pool.ntp.org/scores/2001:470:1f07:1278:cafe which then
404s.

Remove Vary: Accept-Language from json responses

http://www.pool.ntp.org/scores/2607:f238:3::123:2/json?monitor=*&limit=400 includes 'Accept-Language' in the Vary header.

Make an (optional) separate domain for graph urls

On the production site, the graphs should be served from graphs.ntppool.org (for better caching).