lg / murder Goto Github PK
View Code? Open in Web Editor NEWLarge scale server deploys using BitTorrent and the BitTornado library (NOTE: project no longer maintained)
Home Page: http://twitter.com
License: Other
Large scale server deploys using BitTorrent and the BitTornado library (NOTE: project no longer maintained)
Home Page: http://twitter.com
License: Other
Is there any way to see percentage of transfert ?
I understood that, that wasnt possible with "pv" because bittorrent preallocates space on disk.
Hi,
I am a little bit confused for "screen -dms". Below is what I get when man screen on ubuntu 14.04.
-s program
sets the default shell to the program specified, instead of the value in the environment variable $SHELL (or "/bin/sh" if not defined). This can also be defined through the "shell" .screenrc command.
Thus I guess what code wants for is "screen -dmS".
-S sessionname
When creating a new session, this option can be used to specify a meaningful name for the session. This name identifies the session for "screen -list" and "screen -r" actions. It substitutes the default [tty.host] suffix.
Pls correct me if I'm wrong. And if necessary I can help provide a patch.
Thanks a lot.
Environment:
OS: CentOS 5.5 (Final)
Python 2.4.3
Traceback (most recent call last):
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/RawServer.py", line 142, in listen_forever
self.sockethandler.handle_events(events)
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/SocketHandler.py", line 319, in handle_events
s.handler.data_came_in(s, data)
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Encrypter.py", line 190, in data_came_in
x = self.next_func(m)
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Encrypter.py", line 148, in read_message
self.connecter.got_message(self, s)
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Connecter.py", line 285, in got_message
if c.download.got_piece(i, toint(message[5:9]), message[9:]):
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Downloader.py", line 182, in got_piece
self._request_more()
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Downloader.py", line 189, in _request_more
self.fix_download_endgame(new_unchoke)
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Downloader.py", line 256, in fix_download_endgame
del want[self.backlog - len(self.active_requests):]
TypeError: slice indices must be integers or None
Traceback (most recent call last):
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/RawServer.py", line 142, in listen_forever
self.sockethandler.handle_events(events)
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/SocketHandler.py", line 319, in handle_events
s.handler.data_came_in(s, data)
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Encrypter.py", line 190, in data_came_in
x = self.next_func(m)
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Encrypter.py", line 148, in read_message
self.connecter.got_message(self, s)
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Connecter.py", line 285, in got_message
if c.download.got_piece(i, toint(message[5:9]), message[9:]):
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Downloader.py", line 182, in got_piece
self._request_more()
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Downloader.py", line 189, in _request_more
self.fix_download_endgame(new_unchoke)
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Downloader.py", line 256, in fix_download_endgame
del want[self.backlog - len(self.active_requests):]
TypeError: slice indices must be integers or None
Traceback (most recent call last):
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/RawServer.py", line 142, in listen_forever
self.sockethandler.handle_events(events)
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/SocketHandler.py", line 319, in handle_events
s.handler.data_came_in(s, data)
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Encrypter.py", line 190, in data_came_in
x = self.next_func(m)
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Encrypter.py", line 148, in read_message
self.connecter.got_message(self, s)
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Connecter.py", line 285, in got_message
if c.download.got_piece(i, toint(message[5:9]), message[9:]):
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Downloader.py", line 182, in got_piece
self._request_more()
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Downloader.py", line 189, in _request_more
self.fix_download_endgame(new_unchoke)
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Downloader.py", line 256, in fix_download_endgame
del want[self.backlog - len(self.active_requests):]
TypeError: slice indices must be integers or None
Traceback (most recent call last):
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/RawServer.py", line 142, in listen_forever
self.sockethandler.handle_events(events)
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/SocketHandler.py", line 319, in handle_events
s.handler.data_came_in(s, data)
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Encrypter.py", line 195, in data_came_in
self.close()
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Encrypter.py", line 161, in close
self.sever()
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Encrypter.py", line 167, in sever
self.connecter.connection_lost(self)
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Connecter.py", line 206, in connection_lost
c.download.disconnected()
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Downloader.py", line 88, in disconnected
self._letgo()
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/Downloader.py", line 101, in _letgo
self.downloader.storage.request_lost(index, begin, length)
File "/home/rmartinez/murder-deploy/murder/dist/BitTornado/BT1/StorageWrapper.py", line 738, in request_lost
assert not (begin, length) in self.inactive_requests[index]
AssertionError
done and done
In the introduction video, the functionality of disabling DHT, UPnP, Encryption was mentioned. Could please point me to the files doing them? I cannot find them in the code as I went through murder code and also did a diff on bittornado directory. Thanks.
when I run "cap murder: peer" the following error occurs
** [out :: LABO03] /tmp/Deploy0000002.tgz.torrent is not a valid responsefile
** [out :: LABO02] Incorrect number of arguments
** [out :: LABO02]
** [out :: LABO02] Usage:
** [out :: LABO02] python murder_client.py peer/seed out.torrent OUT.OUT 127.0.0.1
** [out :: LABO02]
** [out :: LABO02] The last parameter is the local ip address, normally 10.x.x.x
** [out :: LABO02]
** [out :: LABO01] /tmp/Deploy0000002.tgz.torrent is not a valid responsefile
Any idea?
Regards
Hello,
I get this error while trying to deploy:
call failed #<Capistrano::CommandError: failed: "sh -c 'pkill -f \"murder_client.py peer.*/tmp/20110927221958.tar.gz.tgz\"'" on server1,server2...>
*** [deploy:update_code] rolling back
I can't figure out why it is failing.
I ended up ignoring the issue by using the following code:
namespace :murder do
task :stop_peering, :roles=>:peer do
logger.info 'override'
end
task :stop_seeding, :roles=>:peer do
logger.info 'override'
end
task :stop_tracker, :roles=>:peer do
logger.info 'override'
end
end
Then after each deploy, i have to go and kill murder (lol) processes.
ENV:
Thanks,
-Dave
lrl@Ubuntu4-8LW3:cap murder:start_seeding tag="Deploy1"
LC_ALL=C host $HOSTNAME | awk '/has address/ {print $4}' | head -n 1
"Hi,
I successfully deployed a 2mo image file with only python scripts.
I now try with a tar.xz of 3,9Go, the .torrent creation is a bit longer.
When i start seeding, i dont have the same message "done and done" that i saw with the little file.
Same if i start peers, the file is created but keep showing 0b wih du.
Any idea ?
Thx for help
after i enter the peer command, it shows the following error:
** [out :: 172.23.99.7] Incorrect number of arguments
** [out :: 172.23.99.7]
** [out :: 172.23.99.7] Usage:
** [out :: 172.23.99.7] python murder_client.py peer/seed out.torrent OUT.OUT 127.0.0.1
** [out :: 172.23.99.7]
** [out :: 172.23.99.7] The last parameter is the local ip address, normally 10.x.x.x
** [out :: 172.23.99.7]
** [out :: 172.23.99.5] Incorrect number of arguments
** [out :: 172.23.99.5]
** [out :: 172.23.99.5] Usage:
** [out :: 172.23.99.5] python murder_client.py peer/seed out.torrent OUT.OUT 127.0.0.1
** [out :: 172.23.99.5]
** [out :: 172.23.99.5] The last parameter is the local ip address, normally 10.x.x.x
** [out :: 172.23.99.5]
** [out :: 172.23.98.78] Incorrect number of arguments
** [out :: 172.23.98.78]
** [out :: 172.23.98.78] Usage:
** [out :: 172.23.98.78] python murder_client.py peer/seed out.torrent OUT.OUT 127.0.0.1
** [out :: 172.23.98.78]
** [out :: 172.23.98.78] The last parameter is the local ip address, normally 10.x.x.x
** [out :: 172.23.98.78]
command finished
failed: "sh -c 'python /u/apps/example-app/shared/murder/murder_client.py peer '''/tmp/Test_2.tgz.torrent''' '''/tmp/Test_2.tgz''' LC_ALL=C host 172.23.99.7 | awk '\\''/has address/ {print $4}'\\'' | head -n 1
'" on 172.23.99.7; "sh -c 'python /u/apps/example-app/shared/murder/murder_client.py peer '''/tmp/Test_2.tgz.torrent''' '''/tmp/Test_2.tgz''' LC_ALL=C host 172.23.98.78 | awk '\\''/has address/ {print $4}'\\'' | head -n 1
'" on 172.23.98.78; "sh -c 'python /u/apps/example-app/shared/murder/murder_client.py peer '''/tmp/Test_2.tgz.torrent''' '''/tmp/Test_2.tgz''' LC_ALL=C host 172.23.99.5 | awk '\\''/has address/ {print $4}'\\'' | head -n 1
'" on 172.23.99.5
As you can see, it throws an "Incorrect number of arguments" error on every peer.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.