ideal / mirror

Task scheduler for open source mirror site (initially for https://mirror.bjtu.edu.cn)

Mirror

Mirror is an open source python application for mirror site (e.g. mirror.bjtu.edu.cn) to sync files from upstreams (it uses rsync internally), it actually works like a cron, but still has some differences. It has been served for mirror.bjtu.edu.cn with more than 40 rsync tasks.

You are welcome to send comments, patches and any others to github or to @idealities.

Homepage: https://mirror.bjtu.edu.cn

Authors

• Shang Yuanchun
• Bob Gao
• Chestnut

For contributors and past developers see: AUTHORS

Installation Instructions

Install from PyPI

You can install mirror by running pip:

$ sudo pip install mirror

Install from source

Or if you want to build and install from source:

$ python setup.py build
$ sudo python setup.py install

Config and running

After that, you are going to set up environment, you are encouraged to add a specific user to run mirrord, here we suppose the username is mirror and its home directory is /home/mirror.

Make necessary directories:

$ sudo chown mirror:mirror /var/log/mirrord /var/log/rsync
$ sudo mkdir /etc/mirror
$ sudo cp config/mirror.ini /etc/mirror/

Now you can edit mirror.ini to fit your needs and run:

$ mirrord

and that's done. Also you can use man mirrord or mirrord -h to read the documents.

If mirrord is running, you can run:

$ mirrord -t

to show the current task queue.

Contact/Support

Email: [email protected]

Features

• It's simple and easy to add a mirror
• You can set a priorty for each mirror, from 1 to 10, 1 is highest
• And scheduler will schedule a task depending on current conditions
• You can also set a timeout for each mirror
• Support for two stage syncing (for ubuntu, debian)
• You can also use it as another cron...

mirror's Issues

希望增加 SteamOS 镜像

SteamOS 是基于 Debian 的一个发行版
上游是 ：http://repo.steampowered.com/
由于国内网络原因加上Valve CDN的问题，下载安装光盘很缓慢，更新软件包也经常出错
希望添加，谢谢！

centos镜像未同步，报告“Task: centos is still running and no timeout set, skipped”

问题描述：
因为最近在关注CentOS 7.4的发布，想着去看一下内部源是否自动同步了CentOS 7.4，结果却发现更新日志最新是2017/9/9的。另外的一个epel源是正常的。查看status/task_status.json，似乎是推迟到了2017/9/16日更新，这是为什么？查看mirrord.log发现“Task: centos is still running and no timeout set, skipped”？像这种情况，要重启mirrod还是要设置超时之类的？

相关配置：
[root@~ mirror]# mirrord -v
mirrord: 0.6.8

[root@~ mirror]# mirrord -t
Task:logcleaner type: System task time: Sat Sep 16 01:00:00 2017
Task:centos type: Normal task time: Sat Sep 16 01:00:00 2017
Task:taskcleaner type: System task time: Sat Sep 16 02:00:00 2017
Task:epel type: Normal task time: Sat Sep 16 02:00:00 2017

[root@~ mirror]# ll /var/log/rsync/
total 3324
-rw-r--r-- 1 root root 53563 Sep 5 01:00 centos.log.2017-09-05
-rw-r--r-- 1 root root 79485 Sep 6 01:04 centos.log.2017-09-06
-rw-r--r-- 1 root root 53566 Sep 7 01:00 centos.log.2017-09-07
-rw-r--r-- 1 root root 112157 Sep 8 01:03 centos.log.2017-09-08
-rw-r--r-- 1 root root 159564 Sep 9 01:27 centos.log.2017-09-09
-rw-r--r-- 1 root root 37180 Sep 5 02:00 epel.log.2017-09-05
-rw-r--r-- 1 root root 1368120 Sep 6 05:58 epel.log.2017-09-06
-rw-r--r-- 1 root root 37081 Sep 7 02:00 epel.log.2017-09-07
-rw-r--r-- 1 root root 211104 Sep 8 02:15 epel.log.2017-09-08
-rw-r--r-- 1 root root 37105 Sep 9 02:00 epel.log.2017-09-09
-rw-r--r-- 1 root root 250337 Sep 10 02:26 epel.log.2017-09-10
-rw-r--r-- 1 root root 141833 Sep 11 02:09 epel.log.2017-09-11
-rw-r--r-- 1 root root 197220 Sep 12 02:20 epel.log.2017-09-12
-rw-r--r-- 1 root root 417374 Sep 13 03:39 epel.log.2017-09-13
-rw-r--r-- 1 root root 37207 Sep 14 02:00 epel.log.2017-09-14
-rw-r--r-- 1 root root 160385 Sep 15 02:06 epel.log.2017-09-15

[root@~ mirror]# cat status/task_status.json
{"centos": {"status": 1, "date": "2017-09-09 01:00:00", "upstream": "mirrors.tuna.tsinghua.edu.cn::centos//", "schedule": "2017-09-16 01:00:00"}, "epel": {"status": 2, "schedule": "2017-09-16 02:00:00", "upstream": "mirrors.tuna.tsinghua.edu.cn::epel//", "date": "2017-09-15 02:06:15", "message": "Sync succeed", "exitcode": 0}}

[root@~ mirror]# grep -vE '^;|^$' mirror.ini
[general]
emails = [email protected]
loadlimit = 4.0
httpconn = 1200
logdir = /var/log/rsync/
maxtasks = 10
[centos]
upstream[] = mirrors.tuna.tsinghua.edu.cn
command = rsync
exclude = --exclude .tmp/
time = 00 01 * * *
rsyncdir = centos/
localdir = /sdb/mirrors/centos
args = --bwlimit=512 -avPH --delete --delete-excluded --delete-after
twostage = 0
timeout = 0
priority = 9
autoretry = 1m
[epel]
upstream[] = mirrors.tuna.tsinghua.edu.cn
command = rsync
exclude = --exclude .tmp/
time = 00 02 * * *
rsyncdir = epel/
localdir = /sdb/mirrors/epel
args = --bwlimit=512 -avPH --delete --delete-excluded --delete-after
twostage = 0
timeout = 0
priority = 9
autoretry = 1m

[root@~ mirror]# tail -n 50 /var/log/mirrord/mirrord.log
09-12 02:20:28 [INFO ][mirror.scheduler] Task: epel ended with return code 0, pid 30265
09-12 02:20:28 [INFO ][mirror.scheduler] I am going to sleep, next waking up: Wed Sep 13 01:00:00 2017
09-13 01:00:00 [INFO ][mirror.scheduler] I am waking up...
09-13 01:00:00 [INFO ][mirror.scheduler] Starting task: centos ...
09-13 01:00:00 [INFO ][mirror.scheduler] Task: centos is still running and no timeout set, skipped
09-13 01:00:00 [INFO ][mirror.scheduler] I am going to sleep, next waking up: Wed Sep 13 02:00:00 2017
09-13 01:00:00 [INFO ][systemtask ] Running task: logcleaner
09-13 01:00:00 [INFO ][logcleaner ] Deleted log file: /var/log/rsync/epel.log.2017-09-02
09-13 01:00:00 [INFO ][logcleaner ] Deleted log file: /var/log/rsync/centos.log.2017-09-02
09-13 01:00:00 [INFO ][systemtask ] Finished task: logcleaner
09-13 02:00:00 [INFO ][mirror.scheduler] I am waking up...
09-13 02:00:00 [INFO ][mirror.scheduler] Starting task: epel ...
09-13 02:00:00 [INFO ][mirror.scheduler] Task: epel begin to run with pid 10789
09-13 02:00:00 [INFO ][mirror.scheduler] I am going to sleep, next waking up: Thu Sep 14 01:00:00 2017
09-13 02:00:00 [INFO ][systemtask ] Running task: taskcleaner
09-13 02:00:00 [INFO ][systemtask ] Finished task: taskcleaner
09-13 03:39:22 [INFO ][mirror.scheduler] Task: epel ended with return code 0, pid 10789
09-13 03:39:22 [INFO ][mirror.scheduler] I am going to sleep, next waking up: Thu Sep 14 01:00:00 2017
09-14 01:00:00 [INFO ][mirror.scheduler] I am waking up...
09-14 01:00:00 [INFO ][mirror.scheduler] Starting task: centos ...
09-14 01:00:00 [INFO ][mirror.scheduler] Task: centos is still running and no timeout set, skipped
09-14 01:00:00 [INFO ][mirror.scheduler] I am going to sleep, next waking up: Thu Sep 14 02:00:00 2017
09-14 01:00:00 [INFO ][systemtask ] Running task: logcleaner
09-14 01:00:00 [INFO ][logcleaner ] Deleted log file: /var/log/rsync/centos.log.2017-09-03
09-14 01:00:00 [INFO ][logcleaner ] Deleted log file: /var/log/rsync/epel.log.2017-09-03
09-14 01:00:00 [INFO ][systemtask ] Finished task: logcleaner
09-14 02:00:00 [INFO ][mirror.scheduler] I am waking up...
09-14 02:00:00 [INFO ][mirror.scheduler] Starting task: epel ...
09-14 02:00:00 [INFO ][mirror.scheduler] Task: epel begin to run with pid 23523
09-14 02:00:00 [INFO ][mirror.scheduler] I am going to sleep, next waking up: Fri Sep 15 01:00:00 2017
09-14 02:00:00 [INFO ][systemtask ] Running task: taskcleaner
09-14 02:00:00 [INFO ][systemtask ] Finished task: taskcleaner
09-14 02:00:28 [INFO ][mirror.scheduler] Task: epel ended with return code 0, pid 23523
09-14 02:00:28 [INFO ][mirror.scheduler] I am going to sleep, next waking up: Fri Sep 15 01:00:00 2017
09-15 01:00:00 [INFO ][mirror.scheduler] I am waking up...
09-15 01:00:00 [INFO ][mirror.scheduler] Starting task: centos ...
09-15 01:00:00 [INFO ][mirror.scheduler] Task: centos is still running and no timeout set, skipped
09-15 01:00:00 [INFO ][mirror.scheduler] I am going to sleep, next waking up: Fri Sep 15 02:00:00 2017
09-15 01:00:00 [INFO ][systemtask ] Running task: logcleaner
09-15 01:00:00 [INFO ][logcleaner ] Deleted log file: /var/log/rsync/epel.log.2017-09-04
09-15 01:00:00 [INFO ][logcleaner ] Deleted log file: /var/log/rsync/centos.log.2017-09-04
09-15 01:00:00 [INFO ][systemtask ] Finished task: logcleaner
09-15 02:00:00 [INFO ][mirror.scheduler] I am waking up...
09-15 02:00:00 [INFO ][mirror.scheduler] Starting task: epel ...
09-15 02:00:00 [INFO ][mirror.scheduler] Task: epel begin to run with pid 4047
09-15 02:00:00 [INFO ][mirror.scheduler] I am going to sleep, next waking up: Sat Sep 16 01:00:00 2017
09-15 02:00:00 [INFO ][systemtask ] Running task: taskcleaner
09-15 02:00:00 [INFO ][systemtask ] Finished task: taskcleaner
09-15 02:06:15 [INFO ][mirror.scheduler] Task: epel ended with return code 0, pid 4047
09-15 02:06:15 [INFO ][mirror.scheduler] I am going to sleep, next waking up: Sat Sep 16 01:00:00 2017

python: Python-3.12.1.tar.xz 签名校验失败

gpg --verify orig-Python-3.12.1.tar.xz.asc

gpg: 于 2023年12月08日 星期五 05时02分02秒 CST 创建的签名，使用 RSA，钥匙号 E5FA6305
gpg: 完好的签名，来自于“Thomas Wouters [email protected]”
gpg: 亦即“Thomas Wouters [email protected]”
gpg: 亦即“Thomas Wouters [email protected]”
gpg: 警告：这把密钥未经受信任的签名认证！
gpg: 没有证据表明这个签名属于它所声称的持有者。
主钥指纹： 7169 605F 62C7 5135 6D05 4A26 A821 E680 E5FA 6305

gpg --verify mirror-Python-3.12.1.tar.xz.asc

gpg: 于 2023年12月08日 星期五 05时02分02秒 CST 创建的签名，使用 RSA，钥匙号 E5FA6305
gpg: 已损坏的签名，来自于“Thomas Wouters [email protected]”

mirror的任务会重复执行吗

如果上一次cron的任务一直没有运行完，是会等到上一次任务结束再开始新的任务吗？

taskstatus这个插件怎么用啊

可以请问下目前https://mirror.bjtu.edu.cn上每个被同步的镜像占用的磁盘空间是多少呢？

目前想要在学校建立一个镜像源，所以咨询一下所需的硬件设备。感谢各位的工作，希望这个小小的问题能得到解答。

建议simple task返回值非0时记录failed

RT，刚才发现pypi已经挂了很久但是因为不检查返回值所以一直显示success.

Something confused about the daemon proccess.

Thank you for your awesome tool. I just have some puzzles about the daemon process.

#1

How can I know the daemon process's status ?

I get the id from the pid file.

then I run the command:

Is the pid correct ?

My suggestion is to add the option called "status" that can print the process's status on the screen.

#2

Another puzzle is that I get the error when I run the command for twice.

I edit the source code, and I try to kill the process when the process catches the error? And I failed to fix the error, the worse is I can NOT kill the daemon process on the condition that the pid is valid(IOError[2]). .

My suggestion is to kill the previous process when we run the command for the second time.

Many thanks.

无规律Crash

升级后有时会在运行中异常退出，暂时没有发现规律。

附两次crash的日志

Sep 24 14:00:00 mirror mirrord[25259]: 09-24 14:00:00 [ERROR   ][mirror.main     ] [Errno 3] No such process
Sep 24 14:00:00 mirror mirrord[25259]: Traceback (most recent call last):
Sep 24 14:00:00 mirror mirrord[25259]:   File "/usr/local/lib/python3.6/dist-packages/mirror/main.py", line 249, in start_daemon
Sep 24 14:00:00 mirror mirrord[25259]:     daemon.start()
Sep 24 14:00:00 mirror mirrord[25259]:   File "/usr/local/lib/python3.6/dist-packages/mirror/daemon.py", line 43, in start
Sep 24 14:00:00 mirror mirrord[25259]:     self.scheduler.start()
Sep 24 14:00:00 mirror mirrord[25259]:   File "/usr/local/lib/python3.6/dist-packages/mirror/scheduler.py", line 84, in start
Sep 24 14:00:00 mirror mirrord[25259]:     self.schedule()
Sep 24 14:00:00 mirror mirrord[25259]:   File "/usr/local/lib/python3.6/dist-packages/mirror/scheduler.py", line 169, in schedule
Sep 24 14:00:00 mirror mirrord[25259]:     self.stop_task(taskinfo)
Sep 24 14:00:00 mirror mirrord[25259]:   File "/usr/local/lib/python3.6/dist-packages/mirror/scheduler.py", line 458, in stop_task
Sep 24 14:00:00 mirror mirrord[25259]:     task.stop()
Sep 24 14:00:00 mirror mirrord[25259]:   File "/usr/local/lib/python3.6/dist-packages/mirror/task.py", line 160, in stop
Sep 24 14:00:00 mirror mirrord[25259]:     os.kill(self.pid, signo)
Sep 24 14:00:00 mirror mirrord[25259]: ProcessLookupError: [Errno 3] No such process
Sep 24 14:00:00 mirror mirrord[25259]: 09-24 14:00:00 [INFO    ][taskstatus      ] Task Start: archlinuxcn
Sep 24 14:00:00 mirror mirrord[25259]: 09-24 14:00:00 [INFO    ][taskstatus      ] Task Enqueue: archlinuxcn
Sep 24 14:00:00 mirror mirrord[25259]: 09-24 14:00:00 [INFO    ][taskstatus      ] Task Start: archlinuxarm
Sep 24 14:00:00 mirror mirrord[25259]: 09-24 14:00:00 [INFO    ][taskstatus      ] Task Enqueue: archlinuxarm
Sep 24 14:00:00 mirror mirrord[25259]: 09-24 14:00:00 [INFO    ][taskstatus      ] Task Start: linuxmint
Sep 24 14:00:00 mirror mirrord[25259]: 09-24 14:00:00 [INFO    ][taskstatus      ] Task Enqueue: linuxmint
Sep 24 14:00:00 mirror mirrord[25259]: 09-24 14:00:00 [INFO    ][taskstatus      ] Task Start: grafana-panel
Sep 24 14:00:00 mirror mirrord[25259]: 09-24 14:00:00 [INFO    ][taskstatus      ] Task Enqueue: grafana-panel
Sep 24 14:01:00 mirror mirrord[25259]: --- Logging error ---
Sep 24 14:01:00 mirror mirrord[25259]: Traceback (most recent call last):
Sep 24 14:01:00 mirror mirrord[25259]:   File "/usr/lib/python3.6/logging/handlers.py", line 71, in emit
Sep 24 14:01:00 mirror mirrord[25259]:     if self.shouldRollover(record):
Sep 24 14:01:00 mirror mirrord[25259]:   File "/usr/lib/python3.6/logging/handlers.py", line 185, in shouldRollover
Sep 24 14:01:00 mirror mirrord[25259]:     self.stream = self._open()
Sep 24 14:01:00 mirror mirrord[25259]:   File "/usr/lib/python3.6/logging/__init__.py", line 1061, in _open
Sep 24 14:01:00 mirror mirrord[25259]:     return open(self.baseFilename, self.mode, encoding=self.encoding)
Sep 24 14:01:00 mirror mirrord[25259]: NameError: name 'open' is not defined
Sep 24 14:01:00 mirror mirrord[25259]: Call stack:
Sep 24 14:01:00 mirror mirrord[25259]:   File "/usr/local/lib/python3.6/dist-packages/mirror/component.py", line 35, in __del__
Sep 24 14:01:00 mirror mirrord[25259]:     _component_registry.deregister(self)
Sep 24 14:01:00 mirror mirrord[25259]:   File "/usr/local/lib/python3.6/dist-packages/mirror/component.py", line 90, in deregister
Sep 24 14:01:00 mirror mirrord[25259]:     self.stop([obj._name])
Sep 24 14:01:00 mirror mirrord[25259]:   File "/usr/local/lib/python3.6/dist-packages/mirror/component.py", line 141, in stop
Sep 24 14:01:00 mirror mirrord[25259]:     self.components[name].stop()
Sep 24 14:01:00 mirror mirrord[25259]:   File "/usr/local/lib/python3.6/dist-packages/mirror/scheduler.py", line 320, in stop
Sep 24 14:01:00 mirror mirrord[25259]:     log.info("Stopping mirror scheduler")
Sep 24 14:01:00 mirror mirrord[25259]: Message: 'Stopping mirror scheduler'
Sep 24 14:01:00 mirror mirrord[25259]: Arguments: ()
Sep 24 14:01:00 mirror mirrord[25259]: 09-24 14:01:00 [INFO    ][mirror.scheduler] Stopping mirror scheduler
Sep 24 14:01:00 mirror systemd[1]: [email protected]: Main process exited, code=exited, status=1/FAILURE
Sep 24 14:01:00 mirror systemd[1]: [email protected]: Failed with result 'exit-code'.

Sep 30 01:00:00 mirror mirrord[10157]: 09-30 01:00:00 [INFO    ][systemtask      ] Finished task: logcleaner
Sep 30 01:00:00 mirror mirrord[10157]: 09-30 01:00:00 [INFO    ][taskstatus      ] Task Enqueue: logcleaner
Sep 30 01:00:00 mirror mirrord[10157]: 09-30 01:00:00 [INFO    ][taskstatus      ] Task Start: statistics-dayly
Sep 30 01:00:00 mirror mirrord[10157]: 09-30 01:00:00 [INFO    ][taskstatus      ] Task Enqueue: statistics-dayly
Sep 30 01:00:00 mirror mirrord[10157]: 09-30 01:00:00 [ERROR   ][pluginthread    ] Event handler TaskEnqueueEvent failed in <bound method Plugin.__on_task_enqueue of <mirror.plugins.taskstatus.plugin.Plugin object at 0x7fa3e148ddd8>> with exception: 'NoneType' object has no attribute 'time'
Sep 30 01:00:00 mirror mirrord[10157]: 09-30 01:00:00 [INFO    ][taskstatus      ] Task Start: grafana-panel
Sep 30 01:00:00 mirror mirrord[10157]: 09-30 01:00:00 [INFO    ][taskstatus      ] Task Enqueue: grafana-panel
Sep 30 01:00:24 mirror mirrord[10157]: 09-30 01:00:24 [INFO    ][mirror.scheduler] Task: grafana-panel ended with return code 0, pid 24723
Sep 30 01:00:24 mirror mirrord[10157]: Exception ignored in: <module 'threading' from '/usr/lib/python3.6/threading.py'>
Sep 30 01:00:24 mirror mirrord[10157]: Traceback (most recent call last):
Sep 30 01:00:24 mirror mirrord[10157]:   File "/usr/lib/python3.6/threading.py", line 1294, in _shutdown
Sep 30 01:00:24 mirror mirrord[10157]:     t.join()
Sep 30 01:00:24 mirror mirrord[10157]:   File "/usr/lib/python3.6/threading.py", line 1056, in join
Sep 30 01:00:24 mirror mirrord[10157]:     self._wait_for_tstate_lock()
Sep 30 01:00:24 mirror mirrord[10157]:   File "/usr/lib/python3.6/threading.py", line 1072, in _wait_for_tstate_lock
Sep 30 01:00:24 mirror mirrord[10157]:     elif lock.acquire(block, timeout):
Sep 30 01:00:24 mirror mirrord[10157]:   File "/usr/local/lib/python3.6/dist-packages/mirror/handler.py", line 92, in sigchld_handler
Sep 30 01:00:24 mirror mirrord[10157]:     raise mirror.error.MirrordTaskFinishedFakeError("Task finished, please stop sleep")
Sep 30 01:00:24 mirror mirrord[10157]: mirror.error.MirrordTaskFinishedFakeError: Task finished, please stop sleep
Sep 30 01:00:24 mirror systemd[1]: [email protected]: Main process exited, code=exited, status=1/FAILURE
Sep 30 01:00:25 mirror systemd[1]: [email protected]: Failed with result 'exit-code'.

Support python 2 only

NameError: global name 'F_GETFD' is not defined

NameError: global name 'F_GETFD' is not defined
05-18 02:04:30.106 [INFO    ][slatefish       :44  ] Hi, this is message from SlateFish: 1400349870.106033
05-18 02:04:30.107 [INFO    ][systemtask      :64  ] Task: logcleaner added
05-18 02:04:30.107 [INFO    ][systemtask      :68  ] Task: taskcleaner added
05-18 02:05:40.064 [INFO    ][mirror.main     :202 ] Starting mirror daemon...
05-18 02:05:40.076 [INFO    ][slatefish       :35  ] I am a slate fish living in the upstream river of Qiandao Lake.
05-18 02:05:40.076 [INFO    ][pluginmanager   :93  ] Plugin SlateFish enabled...
05-18 02:05:40.078 [INFO    ][pluginmanager   :93  ] Plugin SystemTask enabled...
05-18 02:05:40.082 [INFO    ][pluginmanager   :93  ] Plugin TaskStatus enabled...
05-18 02:05:40.084 [INFO    ][mirror.daemon   :40  ] Starting mirror scheduler...
05-18 02:05:40.085 [ERROR   ][mirror.main     :206 ] global name 'F_GETFD' is not defined
Traceback (most recent call last):
  File "build/bdist.linux-x86_64/egg/mirror/main.py", line 204, in start_daemon
    daemon = MirrorDaemon(options, args)
  File "build/bdist.linux-x86_64/egg/mirror/daemon.py", line 41, in __init__
    self.scheduler.start()
  File "build/bdist.linux-x86_64/egg/mirror/scheduler.py", line 76, in start
    self.sleep()
  File "build/bdist.linux-x86_64/egg/mirror/scheduler.py", line 88, in sleep
    self.write_mmap()
  File "build/bdist.linux-x86_64/egg/mirror/scheduler.py", line 284, in write_mmap
    flag = fcntl.fcntl(self.bufferfd, F_GETFD)
NameError: global name 'F_GETFD' is not defined
05-18 02:05:40.185 [INFO    ][slatefish       :44  ] Hi, this is message from SlateFish: 1400349940.184923
05-18 02:05:40.185 [INFO    ][systemtask      :64  ] Task: logcleaner added
05-18 02:05:40.185 [INFO    ][systemtask      :68  ] Task: taskcleaner added
05-18 02:06:40.303 [INFO    ][mirror.handler  :85  ] Got signal SIGHUP, start reloading...
05-18 02:06:40.303 [INFO    ][mirror.scheduler:353 ] Stopping running tasks...
05-18 02:06:40.304 [INFO    ][mirror.scheduler:358 ] Clearing old data...
05-18 02:06:40.304 [INFO    ][mirror.scheduler:364 ] Reloading new configs...
05-18 02:06:40.306 [INFO    ][mirror.handler  :40  ] Got signal SIGINT, exiting...
05-18 02:06:40.307 [INFO    ][mirror.scheduler:294 ] Stopping mirror scheduler
05-18 02:06:40.307 [INFO    ][mirror.handler  :70  ] Bye bye... :)

这个bug好像是新引入的，用早些时候的一个版本没问题。

#无此问题的某版本最近一条commint。
commit 254beba2317b4ae86756f392ab2287db12ac30fa
Author: ideal <[email protected]>
Date:   Sun Apr 6 20:22:58 2014 +0800

    fix bug

支持IPVC……

mirror-web能开放么？

web页面的同步状态框架能开放么？
喜欢这种清爽的hexo，比清华的好看
其次是希望能加入镜像大小的状态显示

请问这个程序有没有导出同步信息的接口？

比如我想把把同步的时间，同步状态导出到一个json文件里，方便网页前端调用，请问是否有现成的功能呢？或者需要修改哪些代码呢？

Reload可否不清理当前运行的任务

这样当需要更新配置的时候可以减少镜像滞后的时间，如果需要完整reload的时候可以直接restart

运行测试日志；

08-29 15:40:57.606 [INFO ][mirror.main :195 ] Starting mirror scheduler...
08-29 15:40:57.608 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Thu Aug 29 15:41:00 2013
08-29 15:41:00.004 [INFO ][mirror.scheduler:70 ] I am waking up...
08-29 15:41:00.048 [INFO ][mirror.scheduler:165 ] Starting task: sleep ...
08-29 15:41:00.053 [INFO ][mirror.scheduler:329 ] Task: sleep begin to run with pid 4342
08-29 15:41:00.057 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Thu Aug 29 16:00:00 2013
08-29 15:41:05.063 [INFO ][mirror.scheduler:374 ] Task: sleep ended with status 0, pid 4342
08-29 15:41:05.064 [INFO ][mirror.scheduler:388 ] Task: sleep scheduled to second stage
08-29 15:41:05.067 [INFO ][mirror.scheduler:329 ] Task: sleep begin to run with pid 4352
08-29 15:41:05.097 [INFO ][mirror.scheduler:70 ] I am waking up...
08-29 15:41:05.125 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Thu Aug 29 16:00:00 2013
08-29 15:41:15.093 [INFO ][mirror.scheduler:374 ] Task: sleep ended with status 0, pid 4352
08-29 15:41:15.094 [INFO ][mirror.scheduler:70 ] I am waking up...
08-29 15:41:15.113 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Thu Aug 29 15:42:00 2013
08-29 15:42:00.020 [INFO ][mirror.scheduler:70 ] I am waking up...
08-29 15:42:00.070 [INFO ][mirror.scheduler:165 ] Starting task: sleep ...
08-29 15:42:00.074 [INFO ][mirror.scheduler:329 ] Task: sleep begin to run with pid 4363
08-29 15:42:00.087 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Thu Aug 29 16:00:00 2013
08-29 15:42:05.086 [INFO ][mirror.scheduler:374 ] Task: sleep ended with status 0, pid 4363
08-29 15:42:05.087 [INFO ][mirror.scheduler:388 ] Task: sleep scheduled to second stage
08-29 15:42:05.091 [INFO ][mirror.scheduler:329 ] Task: sleep begin to run with pid 4364
08-29 15:42:05.108 [INFO ][mirror.scheduler:70 ] I am waking up...
08-29 15:42:05.140 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Thu Aug 29 16:00:00 2013
08-29 15:42:15.103 [INFO ][mirror.scheduler:374 ] Task: sleep ended with status 0, pid 4364
08-29 15:42:15.104 [INFO ][mirror.scheduler:70 ] I am waking up...
08-29 15:42:15.145 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Thu Aug 29 15:43:00 2013
08-29 15:43:00.021 [INFO ][mirror.scheduler:70 ] I am waking up...
08-29 15:43:00.062 [INFO ][mirror.scheduler:165 ] Starting task: sleep ...
08-29 15:43:00.065 [INFO ][mirror.scheduler:329 ] Task: sleep begin to run with pid 4368
08-29 15:43:00.072 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Thu Aug 29 16:00:00 2013
08-29 15:43:05.074 [INFO ][mirror.scheduler:374 ] Task: sleep ended with status 0, pid 4368
08-29 15:43:05.075 [INFO ][mirror.scheduler:388 ] Task: sleep scheduled to second stage
08-29 15:43:05.077 [INFO ][mirror.scheduler:329 ] Task: sleep begin to run with pid 4369
08-29 15:43:05.093 [INFO ][mirror.scheduler:70 ] I am waking up...
08-29 15:43:05.125 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Thu Aug 29 16:00:00 2013
08-29 15:43:15.099 [INFO ][mirror.scheduler:374 ] Task: sleep ended with status 0, pid 4369
08-29 15:43:15.100 [INFO ][mirror.scheduler:70 ] I am waking up...
08-29 15:43:15.114 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Thu Aug 29 15:44:00 2013
08-29 16:08:24.374 [INFO ][mirror.main :195 ] Starting mirror scheduler...
08-29 16:08:24.377 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Thu Aug 29 18:00:00 2013
08-29 16:22:15.687 [INFO ][mirror.main :195 ] Starting mirror scheduler...
08-29 16:22:15.691 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Thu Aug 29 16:23:00 2013
08-29 16:23:00.044 [INFO ][mirror.scheduler:70 ] I am waking up...
08-29 16:23:00.106 [INFO ][mirror.scheduler:165 ] Starting task: archlinux ...
08-29 16:23:00.115 [INFO ][mirror.scheduler:329 ] Task: archlinux begin to run with pid 4585
08-29 16:23:00.133 [INFO ][mirror.scheduler:165 ] Starting task: ubuntu ...
08-29 16:23:00.150 [INFO ][mirror.scheduler:329 ] Task: ubuntu begin to run with pid 4586
08-29 16:23:00.164 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 04:23:00 2013
08-29 16:40:09.650 [WARNING ][mirror.config :244 ] Unable to open config file /home/mirror/.config/mirror/mirror.ini: [Errno 2] No such file or directory: '/home/mirror/.config/mirror/mirror.ini'
08-29 16:40:09.652 [ERROR ][mirror.scheduler:293 ] Error in config file, no general section, will use default setting.
08-29 16:40:09.652 [INFO ][mirror.main :195 ] Starting mirror scheduler...
08-29 16:40:09.654 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Thu Aug 29 17:10:09 2013
08-29 16:54:31.784 [INFO ][mirror.main :195 ] Starting mirror scheduler...
08-29 16:54:31.786 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Thu Aug 29 16:55:00 2013
08-29 16:55:00.020 [INFO ][mirror.scheduler:70 ] I am waking up...
08-29 16:55:00.057 [INFO ][mirror.scheduler:165 ] Starting task: archlinux ...
08-29 16:55:00.061 [INFO ][mirror.scheduler:329 ] Task: archlinux begin to run with pid 5311
08-29 16:55:00.064 [INFO ][mirror.scheduler:165 ] Starting task: ubuntu ...
08-29 16:55:00.072 [INFO ][mirror.scheduler:329 ] Task: ubuntu begin to run with pid 5312
08-29 16:55:00.074 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 04:55:00 2013
08-29 22:27:50.805 [INFO ][mirror.main :195 ] Starting mirror scheduler...
08-29 22:27:50.825 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 16:55:00 2013
08-29 22:29:00.595 [INFO ][mirror.main :195 ] Starting mirror scheduler...
08-29 22:29:00.598 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Thu Aug 29 22:30:00 2013
08-29 22:30:00.059 [INFO ][mirror.scheduler:70 ] I am waking up...
08-29 22:30:00.097 [INFO ][mirror.scheduler:165 ] Starting task: archlinux ...
08-29 22:30:00.100 [INFO ][mirror.scheduler:329 ] Task: archlinux begin to run with pid 5785
08-29 22:30:00.125 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 00:30:00 2013
08-29 22:51:02.483 [INFO ][mirror.scheduler:374 ] Task: archlinux ended with status 3072, pid 5785
08-29 22:51:02.507 [INFO ][mirror.scheduler:70 ] I am waking up...
08-29 22:51:02.565 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 00:30:00 2013
08-29 23:02:31.228 [ERROR ][mirror.main :176 ] Another mirrord is running with pid: 5778
08-29 23:02:31.230 [ERROR ][mirror.main :177 ] You cannot run multiple daemons with the same config directory set.
08-29 23:02:59.681 [INFO ][mirror.main :195 ] Starting mirror scheduler...
08-29 23:02:59.689 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 00:30:00 2013
08-29 23:06:07.279 [INFO ][mirror.main :195 ] Starting mirror scheduler...
08-29 23:06:07.295 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 00:00:00 2013
08-29 23:10:21.347 [INFO ][mirror.main :195 ] Starting mirror scheduler...
08-29 23:10:21.360 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 00:00:00 2013
08-30 00:00:00.075 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 00:00:00.094 [INFO ][mirror.scheduler:165 ] Starting task: archlinux ...
08-30 00:00:00.097 [INFO ][mirror.scheduler:329 ] Task: archlinux begin to run with pid 6150
08-30 00:00:00.111 [INFO ][mirror.scheduler:165 ] Starting task: ubuntu ...
08-30 00:00:00.114 [INFO ][mirror.scheduler:329 ] Task: ubuntu begin to run with pid 6151
08-30 00:00:00.164 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 00:10:00 2013
08-30 00:10:00.096 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 00:10:00.126 [INFO ][mirror.scheduler:165 ] Starting task: debian ...
08-30 00:10:00.129 [INFO ][mirror.scheduler:329 ] Task: debian begin to run with pid 6295
08-30 00:10:00.145 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 00:15:00 2013
08-30 00:15:00.099 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 00:15:00.171 [INFO ][mirror.scheduler:165 ] Starting task: debian-security ...
08-30 00:15:00.175 [INFO ][mirror.scheduler:329 ] Task: debian-security begin to run with pid 6780
08-30 00:15:00.310 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 00:18:00 2013
08-30 00:18:00.107 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 00:18:00.130 [INFO ][mirror.scheduler:165 ] Starting task: debian-multimedia ...
08-30 00:18:00.138 [INFO ][mirror.scheduler:329 ] Task: debian-multimedia begin to run with pid 6881
08-30 00:18:00.173 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 00:20:00 2013
08-30 00:18:02.322 [INFO ][mirror.scheduler:374 ] Task: debian-multimedia ended with status 2560, pid 6881
08-30 00:18:02.323 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 00:18:02.351 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 00:20:00 2013
08-30 00:20:00.099 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 00:20:00.200 [INFO ][mirror.scheduler:165 ] Starting task: tldp ...
08-30 00:20:00.272 [INFO ][mirror.scheduler:329 ] Task: tldp begin to run with pid 6916
08-30 00:20:00.334 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 00:25:00 2013
08-30 00:25:00.111 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 00:25:00.165 [INFO ][mirror.scheduler:165 ] Starting task: ubuntu-releases ...
08-30 00:25:00.174 [INFO ][mirror.scheduler:329 ] Task: ubuntu-releases begin to run with pid 7068
08-30 00:25:00.210 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 00:26:00 2013
08-30 00:26:00.059 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 00:26:00.097 [INFO ][mirror.scheduler:165 ] Starting task: debian-cd ...
08-30 00:26:00.135 [INFO ][mirror.scheduler:329 ] Task: debian-cd begin to run with pid 7116
08-30 00:26:00.173 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 00:28:00 2013
08-30 00:28:00.081 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 00:28:00.095 [INFO ][mirror.scheduler:165 ] Starting task: gentoo ...
08-30 00:28:00.100 [INFO ][mirror.scheduler:329 ] Task: gentoo begin to run with pid 7180
08-30 00:28:00.112 [INFO ][mirror.scheduler:165 ] Starting task: gentoo-portage ...
08-30 00:28:00.124 [INFO ][mirror.scheduler:329 ] Task: gentoo-portage begin to run with pid 7181
08-30 00:28:00.179 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 00:30:00 2013
08-30 00:28:00.186 [INFO ][mirror.scheduler:374 ] Task: gentoo ended with status 2560, pid 7180
08-30 00:28:00.188 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 00:28:00.212 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 00:30:00 2013
08-30 00:30:00.101 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 00:30:00.150 [INFO ][mirror.scheduler:165 ] Starting task: slackware ...
08-30 00:30:00.160 [INFO ][mirror.scheduler:329 ] Task: slackware begin to run with pid 8181
08-30 00:30:00.209 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 00:50:00 2013
08-30 00:32:06.756 [INFO ][mirror.scheduler:374 ] Task: slackware ended with status 2560, pid 8181
08-30 00:32:06.757 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 00:32:06.784 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 00:50:00 2013
08-30 00:50:00.107 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 00:50:00.168 [INFO ][mirror.scheduler:165 ] Starting task: apache ...
08-30 00:50:00.200 [INFO ][mirror.scheduler:329 ] Task: apache begin to run with pid 9521
08-30 00:50:00.212 [INFO ][mirror.scheduler:165 ] Starting task: gnu ...
08-30 00:50:00.259 [INFO ][mirror.scheduler:329 ] Task: gnu begin to run with pid 9524
08-30 00:50:00.324 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 00:55:00 2013
08-30 00:55:00.103 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 00:55:00.148 [INFO ][mirror.scheduler:162 ] Task: (name: rpmfusion, type: 1, time: 1377795300, priority: 8) not scheduled because running tasks is larger than 10
08-30 00:55:00.169 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 01:25:00 2013
08-30 01:25:00.103 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 01:25:00.171 [INFO ][mirror.scheduler:162 ] Task: (name: rpmfusion, type: 1, time: 1377797100, priority: 8) not scheduled because running tasks is larger than 10
08-30 01:25:00.175 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: kdemod schedule time is in past,maybe I sleeped too long...
08-30 01:25:00.176 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: cpan schedule time is in past,maybe I sleeped too long...
08-30 01:25:00.177 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: lfs schedule time is in past,maybe I sleeped too long...
08-30 01:25:00.178 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: qomo schedule time is in past,maybe I sleeped too long...
08-30 01:25:00.179 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: clfs schedule time is in past,maybe I sleeped too long...
08-30 01:25:00.215 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 01:55:00 2013
08-30 01:55:00.089 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 01:55:00.102 [INFO ][mirror.scheduler:162 ] Task: (name: rpmfusion, type: 1, time: 1377798900, priority: 8) not scheduled because running tasks is larger than 10
08-30 01:55:00.103 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: packman schedule time is in past,maybe I sleeped too long...
08-30 01:55:00.104 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: lfs-cd schedule time is in past,maybe I sleeped too long...
08-30 01:55:00.105 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: cruxppc schedule time is in past,maybe I sleeped too long...
08-30 01:55:00.106 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: kde schedule time is in past,maybe I sleeped too long...
08-30 01:55:00.107 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: opensuse schedule time is in past,maybe I sleeped too long...
08-30 01:55:00.109 [INFO ][mirror.scheduler:162 ] Task: (name: centos, type: 1, time: 1377798900, priority: 8) not scheduled because running tasks is larger than 10
08-30 01:55:00.154 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 02:25:00 2013
08-30 02:25:00.099 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 02:25:00.144 [INFO ][mirror.scheduler:162 ] Task: (name: rpmfusion, type: 1, time: 1377800700, priority: 8) not scheduled because running tasks is larger than 10
08-30 02:25:00.167 [INFO ][mirror.scheduler:162 ] Task: (name: centos, type: 1, time: 1377800700, priority: 8) not scheduled because running tasks is larger than 10
08-30 02:25:00.170 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: linuxmint schedule time is in past,maybe I sleeped too long...
08-30 02:25:00.171 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: gnome schedule time is in past,maybe I sleeped too long...
08-30 02:25:00.174 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: freebsd schedule time is in past,maybe I sleeped too long...
08-30 02:25:00.220 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: ctan schedule time is in past,maybe I sleeped too long...
08-30 02:25:00.221 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: deepin schedule time is in past,maybe I sleeped too long...
08-30 02:25:00.222 [INFO ][mirror.scheduler:132 ] Task: archlinux timeouts
08-30 02:25:00.650 [INFO ][mirror.scheduler:361 ] Killed task: archlinux with pid 6150, status 5120
08-30 02:25:00.652 [INFO ][mirror.scheduler:132 ] Task: debian-security timeouts
08-30 02:25:01.055 [INFO ][mirror.scheduler:361 ] Killed task: debian-security with pid 6780, status 5120
08-30 02:25:01.056 [INFO ][mirror.scheduler:132 ] Task: tldp timeouts
08-30 02:25:01.458 [INFO ][mirror.scheduler:361 ] Killed task: tldp with pid 6916, status 5120
08-30 02:25:01.468 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 02:55:00 2013
08-30 02:55:00.101 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 02:55:00.113 [INFO ][mirror.scheduler:165 ] Starting task: rpmfusion ...
08-30 02:55:00.117 [INFO ][mirror.scheduler:329 ] Task: rpmfusion begin to run with pid 10798
08-30 02:55:00.125 [INFO ][mirror.scheduler:165 ] Starting task: centos ...
08-30 02:55:00.129 [INFO ][mirror.scheduler:329 ] Task: centos begin to run with pid 10799
08-30 02:55:00.135 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: gimp schedule time is in past,maybe I sleeped too long...
08-30 02:55:00.136 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: deepin-cd schedule time is in past,maybe I sleeped too long...
08-30 02:55:00.137 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: kernel schedule time is in past,maybe I sleeped too long...
08-30 02:55:00.138 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: cran schedule time is in past,maybe I sleeped too long...
08-30 02:55:00.139 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: tdf schedule time is in past,maybe I sleeped too long...
08-30 02:55:00.140 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: scientific schedule time is in past,maybe I sleeped too long...
08-30 02:55:00.150 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 03:00:00 2013
08-30 03:00:00.093 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 03:00:00.106 [INFO ][mirror.scheduler:165 ] Starting task: startos ...
08-30 03:00:00.109 [INFO ][mirror.scheduler:329 ] Task: startos begin to run with pid 10842
08-30 03:00:00.140 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 03:10:00 2013
08-30 03:10:00.101 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 03:10:00.115 [INFO ][mirror.scheduler:162 ] Task: (name: cinnarch, type: 1, time: 1377803400, priority: 8) not scheduled because running tasks is larger than 10
08-30 03:10:00.127 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 03:40:00 2013
08-30 03:40:00.076 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 03:40:00.095 [INFO ][mirror.scheduler:162 ] Task: (name: cinnarch, type: 1, time: 1377805200, priority: 8) not scheduled because running tasks is larger than 10
08-30 03:40:00.096 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: sabayon schedule time is in past,maybe I sleeped too long...
08-30 03:40:00.097 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: qt schedule time is in past,maybe I sleeped too long...
08-30 03:40:00.104 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 04:10:00 2013
08-30 03:54:20.134 [INFO ][mirror.scheduler:374 ] Task: centos ended with status 3072, pid 10799
08-30 03:54:20.136 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 03:54:20.166 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 04:10:00 2013
08-30 04:10:00.099 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 04:10:00.112 [INFO ][mirror.scheduler:165 ] Starting task: cinnarch ...
08-30 04:10:00.116 [INFO ][mirror.scheduler:329 ] Task: cinnarch begin to run with pid 11039
08-30 04:10:00.122 [INFO ][mirror.scheduler:118 ] Strange problem happened,task: archlinux schedule time is in past,maybe I sleeped too long...
08-30 04:10:00.141 [INFO ][mirror.scheduler:132 ] Task: ubuntu timeouts
08-30 04:10:00.547 [INFO ][mirror.scheduler:361 ] Killed task: ubuntu with pid 6151, status 5120
08-30 04:10:00.548 [INFO ][mirror.scheduler:388 ] Task: ubuntu scheduled to second stage
08-30 04:10:00.551 [INFO ][mirror.scheduler:329 ] Task: ubuntu begin to run with pid 11040
08-30 04:10:00.554 [INFO ][mirror.scheduler:132 ] Task: debian timeouts
08-30 04:10:00.965 [INFO ][mirror.scheduler:361 ] Killed task: debian with pid 6295, status 5120
08-30 04:10:00.966 [INFO ][mirror.scheduler:388 ] Task: debian scheduled to second stage
08-30 04:10:00.970 [INFO ][mirror.scheduler:329 ] Task: debian begin to run with pid 11041
08-30 04:10:00.988 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 04:28:00 2013
08-30 04:28:00.102 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 04:28:00.116 [INFO ][mirror.scheduler:162 ] Task: (name: gentoo, type: 1, time: 1377808080, priority: 10) not scheduled because running tasks is larger than 10
08-30 04:28:00.117 [INFO ][mirror.scheduler:132 ] Task: gentoo-portage timeouts
08-30 04:28:00.527 [INFO ][mirror.scheduler:361 ] Killed task: gentoo-portage with pid 7181, status 5120
08-30 04:28:00.534 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 04:58:00 2013
08-30 04:58:00.078 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 04:58:00.096 [INFO ][mirror.scheduler:165 ] Starting task: gentoo ...
08-30 04:58:00.100 [INFO ][mirror.scheduler:329 ] Task: gentoo begin to run with pid 11301
08-30 04:58:00.113 [INFO ][mirror.scheduler:132 ] Task: gnu timeouts
08-30 04:58:00.516 [INFO ][mirror.scheduler:361 ] Killed task: gnu with pid 9524, status 5120
08-30 04:58:00.528 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 06:00:00 2013
08-30 06:00:00.077 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 06:00:00.098 [INFO ][mirror.scheduler:165 ] Starting task: archlinux ...
08-30 06:00:00.102 [INFO ][mirror.scheduler:329 ] Task: archlinux begin to run with pid 11378
08-30 06:00:00.116 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 06:55:00 2013
08-30 06:55:00.120 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 06:55:00.138 [INFO ][mirror.scheduler:132 ] Task: rpmfusion timeouts
08-30 06:55:00.543 [INFO ][mirror.scheduler:361 ] Killed task: rpmfusion with pid 10798, status 5120
08-30 06:55:00.575 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 06:58:00 2013
08-30 06:58:00.097 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 06:58:00.110 [INFO ][mirror.scheduler:132 ] Task: gentoo timeouts
08-30 06:58:00.112 [INFO ][mirror.scheduler:361 ] Killed task: gentoo with pid 11301, status 2560
08-30 06:58:00.119 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 08:00:00 2013
08-30 08:00:00.080 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 08:00:00.176 [INFO ][mirror.scheduler:132 ] Task: archlinux timeouts
08-30 08:00:00.580 [INFO ][mirror.scheduler:361 ] Killed task: archlinux with pid 11378, status 5120
08-30 08:00:00.772 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 08:10:00 2013
08-30 08:10:00.095 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 08:10:00.108 [INFO ][mirror.scheduler:165 ] Starting task: ctan ...
08-30 08:10:00.111 [INFO ][mirror.scheduler:329 ] Task: ctan begin to run with pid 11752
08-30 08:10:00.116 [INFO ][mirror.scheduler:132 ] Task: debian timeouts
08-30 08:10:00.520 [INFO ][mirror.scheduler:361 ] Killed task: debian with pid 11041, status 5120
08-30 08:10:00.521 [INFO ][mirror.scheduler:132 ] Task: ubuntu timeouts
08-30 08:10:00.924 [INFO ][mirror.scheduler:361 ] Killed task: ubuntu with pid 11040, status 5120
08-30 08:10:00.934 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 08:28:00 2013
08-30 08:28:00.092 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 08:28:00.181 [INFO ][mirror.scheduler:165 ] Starting task: gentoo-portage ...
08-30 08:28:00.185 [INFO ][mirror.scheduler:329 ] Task: gentoo-portage begin to run with pid 11862
08-30 08:28:00.190 [INFO ][mirror.scheduler:165 ] Starting task: gentoo ...
08-30 08:28:00.194 [INFO ][mirror.scheduler:329 ] Task: gentoo begin to run with pid 11863
08-30 08:28:00.218 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 10:00:00 2013
08-30 08:28:00.549 [INFO ][mirror.scheduler:374 ] Task: gentoo ended with status 2560, pid 11863
08-30 08:28:00.550 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 08:28:00.596 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 10:00:00 2013
08-30 08:34:41.871 [INFO ][mirror.scheduler:374 ] Task: gentoo-portage ended with status 0, pid 11862
08-30 08:34:41.872 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 08:34:41.915 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 10:00:00 2013
08-30 10:00:00.120 [INFO ][mirror.scheduler:70 ] I am waking up...
08-30 10:00:00.246 [INFO ][mirror.scheduler:165 ] Starting task: archlinux ...
08-30 10:00:00.265 [INFO ][mirror.scheduler:329 ] Task: archlinux begin to run with pid 12182
08-30 10:00:00.681 [INFO ][mirror.scheduler:93 ] I am going to sleep, next waking up: Fri Aug 30 12:00:00 2013

openSUSE和packman两个源都不能用

repomd.xml列出的元数据根本对不上真实的元数据
例如 http://mirror.bjtu.edu.cn/opensuse/repositories/home%3a/Horst3180/openSUSE_Leap_42.1/repodata/repomd.xml 里面列出的是这三个：

560343eb2f1faa0ae672be18f0a52802a9ebc6a2531c22a739cc8250d0c70c10-filelists.xml.gz
d9afa1cec7874695ebb7f26a28f4ad30f833041bfc2c813d8c3d122b4f3492bd-other.xml.gz
bc672dfdd98c3bf6a38cc1c5311766ac0e84ec1115f4c179fbe6cf921e157132-primary.xml.gz

但在同一目录的数据是：

元数据没一个对应的上
对照opensuse官方的源很容易得出repomd.xml这个文件是错的，所以北交大的opensuse源不是从官方源同步的？