ctripcorp / tars

携程下一代发布系统

Docker bootstrap

Requirements

• docker and docker-compose
• GNU make

Preperations

cp tars/settings/local.py.example tars/settings/local.py

Just type

make docker_bootstrap

Then, please visit http://localhost:8000 to access Tars

Frontend

Build frontend

make frontend

Build frontend using docker, please ensure container exit code is 0

make frontend_docker

If failed to install bower components, please try branch demo/static_embedded

Docker demo

./demo/bootstrap.sh

Demo admin account:

• username: admin
• password: nomoresecrete

tars's Issues

saltstack 的部署脚步state.sls文件或state.conf

tars好像是用saltstack发布包到应用服务器上面并对应用进行启停操作，但我在源码里面没有找到启停应用和发包的state描述文件

no work in demo,hang at点火

demo 第一次跑任务，会在点火环境hang住 ，只能点击rolling out

找不到入口startup.sh

java应用发布目录里的startup.sh 是怎么生成的，代码里面没有找到

make docker_bootstrap过程中需要输入用户名密码

Running migrations:
Rendering model states... DONE
Applying contenttypes.0001_initial... OK
Applying auth.0001_initial... OK
Applying admin.0001_initial... OK
Applying contenttypes.0002_remove_content_type_name... OK
Applying auth.0002_alter_permission_name_max_length... OK
Applying auth.0003_alter_user_email_max_length... OK
Applying auth.0004_alter_user_username_opts... OK
Applying auth.0005_alter_user_last_login_null... OK
Applying auth.0006_require_contenttypes_0002... OK
Applying sessions.0001_initial... OK
docker-compose run worker python manage.py createsuperuser --settings=tars.settings.docker
Starting tars_db_1_132f87672d41 ... done
Starting tars_backend_1_78d5909a9f9e ... done
/usr/local/lib/python2.7/site-packages/django/db/utils.py:239: RemovedInDjango19Warning: In Django 1.9 the TEST_COLLATION connection setting will be moved to a COLLATION entry in the TEST setting
self.prepare_test_settings(alias)

/usr/local/lib/python2.7/site-packages/django/db/utils.py:239: RemovedInDjango19Warning: In Django 1.9 the TEST_CHARSET connection setting will be moved to a CHARSET entry in the TEST setting
self.prepare_test_settings(alias)

/usr/local/lib/python2.7/site-packages/django/db/models/base.py:309: RuntimeWarning: Model 'server.group' was already registered. Reloading models is not advised as it can lead to inconsistencies, most notably with related models.
new_class._meta.apps.register_model(new_class._meta.app_label, new_class)

WARNING:py.warnings:/usr/local/lib/python2.7/site-packages/django/db/models/base.py:309: RuntimeWarning: Model 'server.group' was already registered. Reloading models is not advised as it can lead to inconsistencies, most notably with related models.
new_class._meta.apps.register_model(new_class._meta.app_label, new_class)

/usr/local/lib/python2.7/site-packages/rest_framework/settings.py:23: RemovedInDjango19Warning: django.utils.importlib will be removed in Django 1.9.
from django.utils import importlib, six

WARNING:py.warnings:/usr/local/lib/python2.7/site-packages/rest_framework/settings.py:23: RemovedInDjango19Warning: django.utils.importlib will be removed in Django 1.9.
from django.utils import importlib, six

Username (leave blank to use 'root'):
Email address:
Password:
Password (again):

项目还在维护吗

salt_modules 有点看不懂

项目不维护了么？好久都不更新了

如题

submit a task after webpage report an error no “batch_pattern”

修改tars/api/seriailzers/deployment.py 的validate_batch_pattern。
估计开源版本抹去了验证，但是代码维护出现问题

建议

    def validate_batch_pattern(self, pattern_str):
        return  pattern_str

        # validator = self.Meta.model.deployment.related.model._meta\
        #     .batch_factory.validate_batch_pattern
        # try:
        #     return validator(pattern_str)
        # except Exception as e:
        #     raise ValidationError(e)

烂尾工程

烂尾工程

submit a task after report error on terminal

点击发布后出现错误代码：

worker_1   | [2018-06-17 10:26:18,916: WARNING/Worker-1] POST http://es:9200/tars-2018-06-11/controller [status:N/A request:3.059s]
worker_1   | Traceback (most recent call last):
worker_1   |   File "/usr/local/lib/python2.7/site-packages/elasticsearch/connection/http_urllib3.py", line 166, in perform_request
worker_1   |     response = self.pool.urlopen(method, url, body, retries=False, headers=request_headers, **kw)
worker_1   |   File "/usr/local/lib/python2.7/site-packages/urllib3/connectionpool.py", line 639, in urlopen
worker_1   |     _stacktrace=sys.exc_info()[2])
worker_1   |   File "/usr/local/lib/python2.7/site-packages/urllib3/util/retry.py", line 333, in increment
worker_1   |     raise six.reraise(type(error), error, _stacktrace)
worker_1   |   File "/usr/local/lib/python2.7/site-packages/urllib3/connectionpool.py", line 601, in urlopen
worker_1   |     chunked=chunked)
worker_1   |   File "/usr/local/lib/python2.7/site-packages/urllib3/connectionpool.py", line 357, in _make_request
worker_1   |     conn.request(method, url, **httplib_request_kw)
worker_1   |   File "/usr/local/lib/python2.7/httplib.py", line 1042, in request
worker_1   |     self._send_request(method, url, body, headers)
worker_1   |   File "/usr/local/lib/python2.7/httplib.py", line 1082, in _send_request
worker_1   |     self.endheaders(body)
worker_1   |   File "/usr/local/lib/python2.7/httplib.py", line 1038, in endheaders
worker_1   |     self._send_output(message_body)
worker_1   |   File "/usr/local/lib/python2.7/httplib.py", line 882, in _send_output
worker_1   |     self.send(msg)
worker_1   |   File "/usr/local/lib/python2.7/httplib.py", line 844, in send
worker_1   |     self.connect()
worker_1   |   File "/usr/local/lib/python2.7/site-packages/urllib3/connection.py", line 166, in connect
worker_1   |     conn = self._new_conn()
worker_1   |   File "/usr/local/lib/python2.7/site-packages/urllib3/connection.py", line 150, in _new_conn
worker_1   |     self, "Failed to establish a new connection: %s" % e)
worker_1   | NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7fd319c37850>: Failed to establish a new connection: [Errno 113] No route to host
web_1      | WARNING:elasticsearch:POST http://es:9200/tars-2018-06-11/controller [status:N/A request:3.063s]
web_1      | Traceback (most recent call last):
web_1      |   File "/usr/local/lib/python2.7/site-packages/elasticsearch/connection/http_urllib3.py", line 166, in perform_request
web_1      |     response = self.pool.urlopen(method, url, body, retries=False, headers=request_headers, **kw)
web_1      |   File "/usr/local/lib/python2.7/site-packages/urllib3/connectionpool.py", line 639, in urlopen
web_1      |     _stacktrace=sys.exc_info()[2])
web_1      |   File "/usr/local/lib/python2.7/site-packages/urllib3/util/retry.py", line 333, in increment
web_1      |     raise six.reraise(type(error), error, _stacktrace)
web_1      |   File "/usr/local/lib/python2.7/site-packages/urllib3/connectionpool.py", line 601, in urlopen
web_1      |     chunked=chunked)
web_1      |   File "/usr/local/lib/python2.7/site-packages/urllib3/connectionpool.py", line 357, in _make_request
web_1      |     conn.request(method, url, **httplib_request_kw)
web_1      |   File "/usr/local/lib/python2.7/httplib.py", line 1042, in request
web_1      |     self._send_request(method, url, body, headers)
web_1      |   File "/usr/local/lib/python2.7/httplib.py", line 1082, in _send_request
web_1      |     self.endheaders(body)
web_1      |   File "/usr/local/lib/python2.7/httplib.py", line 1038, in endheaders
web_1      |     self._send_output(message_body)
web_1      |   File "/usr/local/lib/python2.7/httplib.py", line 882, in _send_output
web_1      |     self.send(msg)
web_1      |   File "/usr/local/lib/python2.7/httplib.py", line 844, in send
web_1      |     self.connect()
web_1      |   File "/usr/local/lib/python2.7/site-packages/urllib3/connection.py", line 166, in connect
web_1      |     conn = self._new_conn()
web_1      |   File "/usr/local/lib/python2.7/site-packages/urllib3/connection.py", line 150, in _new_conn
web_1      |     self, "Failed to establish a new connection: %s" % e)
web_1      | NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f86081f71d0>: Failed to establish a new connection: [Errno 113] No route to host
web_1      | [17/Jun/2018 10:26:20]"GET /api/v1/applications/1?_method=GET HTTP/1.1" 200 473
web_1      | [17/Jun/2018 10:26:20]"GET /api/v1/applications?app_id=1&page=1&page_size=10&_method=GET HTTP/1.1" 200 515
web_1      | [17/Jun/2018 10:26:20]"GET /api/v1/groups/1?_method=GET HTTP/1.1" 200 575
web_1      |

应用列表为空，提示添加，但是找不到按钮。

有使用的文档吗，是和内部其他系统紧绑定吗

实在搞不明白

好像没人维护了

前后端分离 但前端gulp报错起不起来
python组件的版本也都是比较低的

demo build error

搭建demo环境出现

worker_1   |     main()
worker_1   |   File "/usr/local/lib/python2.7/site-packages/celery/bin/celery.py", line 81, in main
worker_1   |     cmd.execute_from_commandline(argv)
worker_1   |   File "/usr/local/lib/python2.7/site-packages/celery/bin/celery.py", line 793, in execute_from_commandline
worker_1   |     super(CeleryCommand, self).execute_from_commandline(argv)))
worker_1   |   File "/usr/local/lib/python2.7/site-packages/celery/bin/base.py", line 311, in execute_from_commandline
worker_1   |     return self.handle_argv(self.prog_name, argv[1:])
worker_1   |   File "/usr/local/lib/python2.7/site-packages/celery/bin/celery.py", line 785, in handle_argv
worker_1   |     return self.execute(command, argv)
worker_1   |   File "/usr/local/lib/python2.7/site-packages/celery/bin/celery.py", line 717, in execute
worker_1   |     ).run_from_argv(self.prog_name, argv[1:], command=argv[0])
worker_1   |   File "/usr/local/lib/python2.7/site-packages/celery/bin/worker.py", line 179, in run_from_argv
worker_1   |     return self(*args, **options)
worker_1   |   File "/usr/local/lib/python2.7/site-packages/celery/bin/base.py", line 274, in __call__
worker_1   |     ret = self.run(*args, **kwargs)
worker_1   |   File "/usr/local/lib/python2.7/site-packages/celery/bin/worker.py", line 212, in run
worker_1   |     state_db=self.node_format(state_db, hostname), **kwargs
worker_1   |   File "/usr/local/lib/python2.7/site-packages/celery/worker/__init__.py", line 95, in __init__
worker_1   |     self.app.loader.init_worker()
worker_1   |   File "/usr/local/lib/python2.7/site-packages/celery/loaders/base.py", line 128, in init_worker
worker_1   |     self.import_default_modules()
worker_1   |   File "/usr/local/lib/python2.7/site-packages/celery/loaders/base.py", line 116, in import_default_modules
worker_1   |     signals.import_modules.send(sender=self.app)
worker_1   |   File "/usr/local/lib/python2.7/site-packages/celery/utils/dispatch/signal.py", line 166, in send
worker_1   |     response = receiver(signal=self, sender=sender, **named)
worker_1   |   File "/usr/local/lib/python2.7/site-packages/celery/fixups/django.py", line 73, in on_import_modules
worker_1   |     self.worker_fixup.validate_models()
worker_1   |   File "/usr/local/lib/python2.7/site-packages/celery/fixups/django.py", line 158, in validate_models
worker_1   |     django_setup()
worker_1   |   File "/usr/local/lib/python2.7/site-packages/django/__init__.py", line 21, in setup
worker_1   |     apps.populate(settings.INSTALLED_APPS)
worker_1   |   File "/usr/local/lib/python2.7/site-packages/django/apps/registry.py", line 115, in populate
worker_1   |     app_config.ready()
worker_1   |   File "/usr/local/lib/python2.7/site-packages/django/contrib/admin/apps.py", line 22, in ready
worker_1   |     self.module.autodiscover()
worker_1   |   File "/usr/local/lib/python2.7/site-packages/django/contrib/admin/__init__.py", line 23, in autodiscover
worker_1   |     autodiscover_modules('admin', register_to=site)
worker_1   |   File "/usr/local/lib/python2.7/site-packages/django/utils/module_loading.py", line 74, in autodiscover_modules
worker_1   |     import_module('%s.%s' % (app_config.name, module_to_search))
worker_1   |   File "/usr/local/lib/python2.7/importlib/__init__.py", line 37, in import_module
worker_1   |     __import__(name)
worker_1   |   File "/usr/local/lib/python2.7/site-packages/constance/admin.py", line 48, in <module>
worker_1   |     fields.DurationField, {'widget': widgets.AdminTextInputWidget}
worker_1   | AttributeError: 'module' object has no attribute 'DurationField'

As well as run demo (web,redis and demo client) , elasticsearch server musit down

报错内容太多，级别是 elasticsearch问题
报错内容
参考 elastic/elasticsearch-py#167

上面的参考 提供的解决方法是设立 timeout，但是tars一定要 elasticsearch接入

有没有详细的安装配置使用教程？

本人没玩过dock，你们给的readme文档看不懂到底是如何在安装配置使用的

A Syntax error at pip install -r local.txt

源码中 requirements/local.txt 出现pip安装包的语法错误，注意小于，等号 这些符号前的空格

requests Dependent use urllib3 which version is special declare

需要在requests前加入指定版本，否则就会出现版本在1.23的不支持问题

urllib3>=1.21.1,<1.23
requests>=2.6.0

请问我在mac本地安装有问题，可以请教吗？帮忙留一个联系方式

帮忙留一个联系方式，想体验一下tars

请问配置server的时候没有配置账号密码，是怎么将包传上去的

发布nodejs的项目超时，也没有更详细的错误日志

[2019-01-17 15:07:34,997: DEBUG/MainProcess(11936)/DummyThread-7] Starting new HTTP connection (1): 172.16.220.101
[2019-01-17 15:07:37,243: DEBUG/MainProcess(11936)/DummyThread-7] http://172.16.220.101:8001 "POST /run HTTP/1.1" 200 223
[2019-01-17 15:07:37,244: WARNING/MainProcess(11936)/DummyThread-7] active thread count: 3
[2019-01-17 15:07:40,610: ERROR/MainProcess(11936)/DummyThread-7] Hard time limit (300.0s) exceeded for tars.deployment.tasks.download[8f623a04-95a2-4e5f-80b9-214039ec9461]

只能看到这个错