cloudwise-opensource / omp

OMP（Operation Management Platform）是云智慧公司自主设计、研发的轻量级、聚合型、智能运维管理平台。是一款为用户提供便捷运维能力和业务管理的综合平台。具备运维一应俱全的功能，目的是提升运维自动化、智能化，提高运维效率，提升业务连续性和安全性。

Readme

OMP-运维管理平台

OMP（Operation Management Platform）是云智慧公司自主设计、研发的轻量级、聚合型、智能运维管理平台。是一款为用户提供便捷运维能力和业务管理的综合平台。具备运维一应俱全的功能，目的是提升运维自动化、智能化，提高运维效率，提升业务连续性和安全性。

OMP设计初衷

目前运维面临的痛点：

• 主机环境多样性，难以统一管理：如：混合云、私有云、跨IDC、虚拟化、容器化等
• 业务变更难度较大，自动编排能力较低
• 业务状态监控，多平台难以数据联动
• 业务出现异常，难以实现故障自愈
• 业务运行状态，难以评估，更难以分析
• 运维知识匮乏，缺少专家指导及专家解决方案

运维管理平台(OMP)的设计初衷就是想打造一应俱全的运维平台，降低交付难度，提升运维自动化、智能化，提高运维效率，提升业务连续性和安全性。

OMP核心功能

• 主机纳管：纳管主机资源，实时监控主机运行状态，可在线管理、在线连接终端等
• 应用管理：平台已内置常用基础组件，也支持符合标准的自研服务发布到应用商店，从而提供便捷的应用管理，如：安装部署、变更发布、弹性扩缩容、在线配置、优化等
• 应用监控：涵盖标准监控、定制监控、链路监控、智能监控等多种业务场景，通过大数据智能测算，可感知未来趋势，将异常控制在发生前
• 故障自愈：当业务系统出现异常或故障时，可按照预定的自愈策略进行故障治理，极大降低故障对业务影响，减少企业损失
• 状态巡检：自动、手动进行业务指标、运行状态汇总，支持自动发送报告到指定邮箱
• 备份/恢复：针对核心数据进行本地+异地备份，支持自动执行备份并将数据发送至指定邮箱，达到异地的存储效果，确保数据安全
• 精简工具：提供运维常用工具、命令、脚本、SQL等，为日常运维操作提供便利，减少误操作、减低技术门槛，支持自行维护、扩充更多工具
• 权限管理：针对不同用户、角色，进行权限控制，及操作审计

架构设计

Demo

通过浏览器访问页面，访问入口为：http://omp.cloudwise.com/#/login
默认用户名：admin
默认密码：Yunweiguanli@OMP
每晚 00:00 将重置数据

使用 OMP

安装部署

当前OMP安装包内部包含了其使用的所有组件，建议将OMP部署在 /data/ 下，当前版本部署流程如下：
step0：下载解压安装包

tar -xvf omp_open-*.tar.gz -C /data

step1：编辑文件，检查环境配置

vim /data/omp/config/omp.yaml

注意：当前版本已携带mysql、redis安装，配置信息如下，如需修改请在安装前修改

# redis相关配置
redis:
  host: 127.0.0.1
  port: 6380
  password: common123
# mysql相关配置
mysql:
  host: 127.0.0.1
  port: 3307
  username: common
  password: Common@123

step2：执行安装脚本

cd /data/omp && bash scripts/install.sh
# 注意1：执行后根据提示选择本机ip，如主机上存在多网卡多IP情况，需要根据业务需求自行判断使用哪个ip地址
# 注意2：当前执行操作的用户即为OMP中各个服务进程的运行用户，在以后的维护中，也应使用此用户进行操作

管理OMP

注意：如需停止 OMP 相关服务，请先执行 “停止 OMP 定时保活任务” 操作

# [服务名称] 值为： all 为对所有组件操作
# all|mysql|redis|tengine|uwsgi|worker|cron|salt|prometheus|alertmanager|grafana|loki
bash /data/omp/scripts/omp [服务名称] [status|start|stop|restart]

停止 OMP 定时保活任务：

# 查看定时任务
crontab -e

# 删除或注释如下内容，否则定时任务会将 OMP 自动拉起
# */5 * * * * bash /data/omp/scripts/omp all start &>/dev/null

卸载OMP

omp节点上卸载操作如下：

bash /data/omp/scripts/uninstall.sh

升级 & 回滚 OMP

# 升级命令
bash cmd_manager omp_upgrade [必填参数：升级目标路径(如:/data/omp，注意此处路径末尾无/)] [选填参数:从某个断点处升级,默认开头]
# 例如
bash 升级包路径/scripts/cmd_manager omp_upgrade /data/omp(当前正在运行的旧安装路径)

# 回滚命令
bash cmd_manager omp_upgrade [必填参数：升级目标路径(如:/data/omp，注意此处路径末尾无/)] [选填参数:从某个断点处升级,默认开头]
# 例如
bash 升级包路径/scripts/cmd_manager omp_rollback /data/omp(当前正在运行的旧安装路径)

断点执行

常用于执行过程中某一步骤失败时，期望从失败步骤处再次执行时使用，正常情况无需考虑此参数，参数默认下标为0

升级回滚可以理解成为jenkins的pipliene 是分步骤执行的，当我们在某一个位置出现异常时，手动修复后通过错误节点再次进行时使用，而跳过之前已经升级（回滚）正确的步骤

# 升级流程顺序如下：
# PreUpdate, Mysql, Redis, Grafana, Tengine, OmpWeb, OmpServer, Python, PostUpdate

环境依赖

技术栈

后端技术栈

• Python 3.8.7
• Django 3.1.4
• Saltstack 3002.2
• Uwsgi 2.0.19.1

数据库

• mysql 5.7.37
• redis 6.2.7

前端技术栈

• Tengine 1.22.0
• React 17.0.1

监控技术栈

• Prometheus 2.25.1
• Alertmanager 0.24.0
• Grafana 9.3.8
• Loki 2.4.1
• Promtail 2.2.0

内置组件概览

组件名称	组件作用	端口
tengine	平台访问入口，代理前端页面及后端uwsgi程序	19001
uwsgi	web容器，用于提供 python Django 后端程序访问入口	19003
salt	开源组件，服务器控制程序，提供主机 Agent 通信	19004、19005
worker	异步任务、定时任务执行程序，有进程无端口	-
prometheus	开源组件，提供监控数据	19011
grafana	开源组件，提供监控面板	19014
alertmanager	开源组件，提供日志告警	19013、9094
loki	开源组件，提供日志采集	19012、9095
redis	开源组件，提供缓存，消息队列	6380
mysql	开源组件，数据存储	3307
ntpd	开源组件，提供时间同步功能	123（udp）

关于应用商店

如何制作一个OMP应用商店中的应用

OMP 社区版-应用商店发布说明文档

内含

• 基础组件打包规范
• 应用服务打包规范
• 目录和配置说明
• postgreSql、redis、rocketmq等应用Demo

卸载应用商店中已经发布的应用

已支持界面操作

export LD_LIBRARY_PATH=/data/omp/component/env/lib && /data/omp/component/env/bin/python3.8 /data/omp/scripts/source/uninstall_app_store.py --product 产品名称 --app_name 组件/服务名称 --version 版本

已经部署服务实例的安装包，无法卸载

参数说明：

1. --version 缺省时，卸载所有版本
2. 卸载基础组件 --app_name 基础组件名称
3. 卸载应用/产品 --product 应用/产品名称
4. 卸载应用下指定服务 --product 应用/产品名称 --app_name 服务名称

欢迎加入 获取更多关于OMP的技术资料，或加入OMP开发者交流群，可扫描下方二维码咨询

omp's Issues

重启客户端失败找不到进程bug

在omp_monitor_agent/monitor_agent.sh第23行
ps aux | grep monitor_agent_exporter| grep -v grep | cut -c 9-15 | xargs kill -9 无法获取到正确pid
建议使用
ps aux | grep monitor_agent_exporter| grep -v grep | awk '{print $2}' | xargs kill -9

产品打包的里面 服务yaml配置 是不是里外一样的，见图

部署主机监控agent总是失败

能否给予一个排查方法

安装脚本install.py的执行环境是python2还是python3?

或者是由纳管机器的python环境决定？

报错：Internal Server Error

除了web主页界面可以访问之外，全部功能都报错：Internal Server Error：

服务器是CentOS7，我打包了/data/logs下的日志：
log.tar.zip

点击“监控”，页面无法显示问题。

主机agent和监控agent都部署好了，点击监控想进入监控页面，发现报错了
查看nginx的access.log显示403
10.252.189.252 - - [28/Jun/2023:15:51:53 +0800] "POST /proxy/v1/grafana/api/ds/query HTTP/1.1" 403 19 "http://10.253.115.28:8088/proxy/v1/grafana/d/9CWBz0bik/zhu-ji-xin-xi-mian-ban?var-node=10.253.115.39&kiosk=tv&kiosk&orgId=1" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36"

我部署的8088是omp平台的端口，8090是grafana的端口

http://10.253.115.28:8090/proxy/v1/grafana/d/9CWBz0bik/zhu-ji-xin-xi-mian-ban?var-node=10.253.115.39&kiosk=tv&kiosk&orgId=1
这个链接目前是显示正常的，我想进的链接也是这个，

为什么点击“监控”进的是 http://10.253.115.28:8088/proxy/v1/grafana/d/9CWBz0bik/zhu-ji-xin-xi-mian-ban?var-node=10.253.115.39&kiosk=tv&kiosk&orgId=1 这个链接呢

希望帮忙解答，谢谢。

执行python3 manage.py migrate数据库迁移，报不能识别数据库版本错误

raise Exception('Unable to determine MySQL version from version string %r' % self.mysql_server_info)
Exception: Unable to determine MySQL version from version string '100.100.100-log'

经过对比，发现jpom更胜一筹，准备用jpom了

jpom地址：
https://github.com/dromara/Jpom
https://jpom.top/

是否支持强依赖部署？

比如说前端模块必须要部署到tengine所在的服务器上，可以实现在选择服务器时只能选择部署了tengine模块的服务器吗？

我已经看到配置文件中有affinity的配置项，但是不确定是否是用来实现这个功能的。

建议定时备份功能增加对热备份的支持

定时备份增加对热备份的支持！
线上交易业务较重要，无法锁库，需要热备份支持，不限于MySQL&Postgresql&mongodb；
建议考虑增加,谢谢；

应用程序监控是否可以通过自定义的设置的方式进行扩展监控。

如设置对应程序名称、执行命令（启动、停止、重启）、日志地址、运行目录、备份信息等。

部署完成后无法访问

使用centos8部署完成后，访问公网ip:1900页面返回 503 错误

错误只有Mysql和grafana的

自定义jar包导入应用商店问题

自定义jar包如何导入到应用商店中，有相关导入模块没？

agentd源码下载

请问有agent的源代码吗？

0.9版本安装失败

查看grafana的进程已经有了，初步定位时因为脚本中执行grafana登录操作失败导致的，使用admin/admin登录不成功

# curl -s -H 'Content-Type: application/json' -X POST -d '{"user": "admin", "password": "admin"}' http://127.0.0.1:19014/proxy/v1/grafana/login

# {"message":"Invalid username or password","traceID":""}

基础组件 官方提供过少

是否有多一些基础组件包可以开源，或者让广大开发者参与基础组件的贡献。每个实践者都去搞一套重复的基础组件，很浪费生产力啊

Agent一直提示安装失败，启动失败

Agent一直提示安装失败，启动失败，是用root部署链接的，已经给了文件夹777权限

你们的应用商店不用docker部署的么

感觉路走窄了啊

数据备份功能报错

当前版本：v1.0
操作路径：数据备份-》备份记录-》备份

数据备份 扩展备份的方法方式

是否可以扩展支持自定义的数据备份方式，或者自定义备份命令 Shell 方式。

界面上无法新增账号，应该如何添加账号？

缺少配置档或脚本

修正启动部署中引用路径后 #3
发现依然缺少如下配置档或脚本：

• component/grafana/conf/defaults.ini
• component/tengine/conf/vhost/omp.conf
• component/tengine/conf/nginx.conf
• component/prometheus/conf/prometheus.yml
• component/grafana/scripts/grafana

能否提供arm架构的监控Agent包？

试了下监控arm架构的服务器，有编译不兼容问题。
尝试重新编译了个python环境替换后，主机agent可正常处理。
但发现监控agent中的内容是已编译好的，所以能否提供监控agent的源码？或者提供支持arm架构的编译后文件？

使用现有的grafana

如何使用自己的grafana，不使用内置的？

缺少配置文件

分支：dev
运行安装报错：
[root@OMP omp]# bash scripts/install.sh x.x.x.x
Traceback (most recent call last):
File "/data/omp/scripts/source/update_conf.py", line 17, in
from ruamel.yaml import YAML
ModuleNotFoundError: No module named 'ruamel'
OMP配置更新失败
[root@OMP omp]#

关于卸载

删除文件

$ rm -rf /data/omp
这种比较危险的操作是否可以放在脚本里去执行，不然容易误操作

omp在目标主机启动主机agent失败，安装监控agent失败

omp在目标主机启动主机agent失败，安装监控agent失败。

我看了一下demo，好像OMP不支持给业务代码升级

我看了一下应用商店，看起来像是安装软件包的，是一次性工作。
有没有像jenkins那种，可以支持给业务代码发版升级的功能。

或者像spug这样的发布https://demo.spug.cc/

应用发布文档里说的 “2.5 打包好的应用Demo” 不存在

https://github.com/CloudWise-OpenSource/OMP/blob/main/doc/app_publish.md
应用发布文档里说的 “2.5 打包好的应用Demo” 我看啥也没有呢 omp/package_hub/back_end_verified

扩展指标 是否可以自定义指标获取方式

扩展指标 是否可以 exec 或者 shell 获取相关指标，例如某个进程或者应用的链接数。某个服务的服务状态或者指标监控。

主机实例名

添加主机实例名称首字母大写会提示已存在

SSH连接客户端提示错误

1.添加主机的时候只能使用root用户，别的用户都不行。（已测试）
2.添加主机的时候密码不能超过15位

omp 有Ubuntu部署的文档么？

怎么接入已存在的服务到omp

怎么接入已存在的服务到omp

资源状态

安装包快速安装alertmanager和 grafana-server 状态提示not running，但是实际可以访问到
[root@localhost scripts]# bash omp all status
mysql [running]
redis [running]
tengine [running]
uwsgi [running]
worker [running]
cron [running]
salt [running]
alertmanager [not running]
grafana-server [not running]
loki [running]
prometheus [running]
[root@localhost scripts]#

0.9版本添加主机后node_exporter启动失败

初步排查是因为部署监控Agent后，生成的node_exporter配置错误导致的

0.6版本，修改默认密码报错：“当前密码不正确”

全新安装，admin登录后，修改默认密码，提示“当前密码不正确”

是否支持在应用安装后创建数据库账号的使用场景？

应用会使用自己的数据库账号，但是安装前数据中并没有创建这个账号，这就需要在通过omp安装应用后，能够触发执行一个创建数据库账号的操作
请问现在是否有这样的功能？

建议将使用agent客户端和服务端使用端口列一下

写的啥玩意

你试试install能跑通吗 各种缺文件就能执行个本地ip

页面-产品/服务下线

已经发布的产品或服务是否有下线功能，目前页面上和文档上未找到相关资料。

依然不行无法安装，dev_requirement.txt包都装了，

(env) [root@localhost omp]# sh scripts/install.sh
通过命令获取本机ip如下：
若选择ip: 192.168.57.129 请输入id: 0

请选择本机ip对应的id，如果ip不在上述输出中请输入N > 0
确认当前主机ip为【192.168.57.129】请输入 Y, 重新选择请输入N > y
Start Update Conf!
Finish Update Conf!
Traceback (most recent call last):
File "/data/omp/omp_server/manage.py", line 22, in
main()
File "/data/omp/omp_server/manage.py", line 18, in main
execute_from_command_line(sys.argv)
File "/data/omp/component/env/lib/python3.8/site-packages/django/core/management/init.py", line 401, in execute_from_command_line
utility.execute()
File "/data/omp/component/env/lib/python3.8/site-packages/django/core/management/init.py", line 395, in execute
self.fetch_command(subcommand).run_from_argv(self.argv)
File "/data/omp/component/env/lib/python3.8/site-packages/django/core/management/base.py", line 330, in run_from_argv
self.execute(*args, **cmd_options)
File "/data/omp/component/env/lib/python3.8/site-packages/django/core/management/base.py", line 371, in execute
output = self.handle(*args, **options)
File "/data/omp/component/env/lib/python3.8/site-packages/django/core/management/base.py", line 85, in wrapped
res = handle_func(*args, **kwargs)
File "/data/omp/component/env/lib/python3.8/site-packages/django/core/management/commands/migrate.py", line 75, in handle
self.check(databases=[database])
File "/data/omp/component/env/lib/python3.8/site-packages/django/core/management/base.py", line 392, in check
all_issues = checks.run_checks(
File "/data/omp/component/env/lib/python3.8/site-packages/django/core/checks/registry.py", line 70, in run_checks
new_errors = check(app_configs=app_configs, databases=databases)
File "/data/omp/component/env/lib/python3.8/site-packages/django/core/checks/urls.py", line 13, in check_url_config
return check_resolver(resolver)
File "/data/omp/component/env/lib/python3.8/site-packages/django/core/checks/urls.py", line 23, in check_resolver
return check_method()
File "/data/omp/component/env/lib/python3.8/site-packages/django/urls/resolvers.py", line 408, in check
for pattern in self.url_patterns:
File "/data/omp/component/env/lib/python3.8/site-packages/django/utils/functional.py", line 48, in get
res = instance.dict[self.name] = self.func(instance)
File "/data/omp/component/env/lib/python3.8/site-packages/django/urls/resolvers.py", line 589, in url_patterns
patterns = getattr(self.urlconf_module, "urlpatterns", self.urlconf_module)
File "/data/omp/component/env/lib/python3.8/site-packages/django/utils/functional.py", line 48, in get
res = instance.dict[self.name] = self.func(instance)
File "/data/omp/component/env/lib/python3.8/site-packages/django/urls/resolvers.py", line 582, in urlconf_module
return import_module(self.urlconf_name)
File "/usr/local/python3/lib/python3.8/importlib/init.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1014, in _gcd_import
File "", line 991, in _find_and_load
File "", line 975, in _find_and_load_unlocked
File "", line 671, in _load_unlocked
File "", line 843, in exec_module
File "", line 219, in _call_with_frames_removed
File "/data/omp/omp_server/omp_server/urls.py", line 26, in
from users.urls import router as users_router
File "/data/omp/omp_server/users/urls.py", line 15, in
from users.views import (
File "/data/omp/omp_server/users/views.py", line 30, in
from users.users_serializers import (
File "/data/omp/omp_server/users/users_serializers.py", line 27, in
from utils.plugin.crypto import decrypt_rsa
File "/data/omp/omp_server/utils/plugin/crypto.py", line 3, in
from Crypto.PublicKey import RSA
File "/data/omp/component/env/lib/python3.8/site-packages/Crypto/PublicKey/RSA.py", line 585
except ValueError, IndexError:
^
SyntaxError: invalid syntax
Traceback (most recent call last):
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 84, in _execute
return self.cursor.execute(sql, params)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/mysql/base.py", line 73, in execute
return self.cursor.execute(query, args)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/cursors.py", line 148, in execute
result = self._query(query)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/cursors.py", line 310, in _query
conn.query(q)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 548, in query
self._affected_rows = self._read_query_result(unbuffered=unbuffered)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 775, in _read_query_result
result.read()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 1156, in read
first_packet = self.connection._read_packet()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 725, in _read_packet
packet.raise_for_error()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/protocol.py", line 221, in raise_for_error
err.raise_mysql_exception(self._data)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/err.py", line 143, in raise_mysql_exception
raise errorclass(errno, errval)
pymysql.err.ProgrammingError: (1146, "Table 'omp.omp_user_profile' doesn't exist")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/data/omp/scripts/source/update_data.py", line 458, in
main()
File "/data/omp/scripts/source/update_data.py", line 446, in main
create_default_user()
File "/data/omp/scripts/source/update_data.py", line 40, in create_default_user
if UserProfile.objects.filter(username=username).count() != 0:
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/models/query.py", line 411, in count
return self.query.get_count(using=self.db)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/models/sql/query.py", line 515, in get_count
number = obj.get_aggregation(using, ['__count'])['__count']
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/models/sql/query.py", line 500, in get_aggregation
result = compiler.execute_sql(SINGLE)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1156, in execute_sql
cursor.execute(sql, params)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 98, in execute
return super().execute(sql, params)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 66, in execute
return self._execute_with_wrappers(sql, params, many=False, executor=self._execute)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 75, in _execute_with_wrappers
return executor(sql, params, many, context)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 84, in _execute
return self.cursor.execute(sql, params)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/utils.py", line 90, in exit
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 84, in _execute
return self.cursor.execute(sql, params)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/mysql/base.py", line 73, in execute
return self.cursor.execute(query, args)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/cursors.py", line 148, in execute
result = self._query(query)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/cursors.py", line 310, in _query
conn.query(q)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 548, in query
self._affected_rows = self._read_query_result(unbuffered=unbuffered)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 775, in _read_query_result
result.read()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 1156, in read
first_packet = self.connection._read_packet()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 725, in _read_packet
packet.raise_for_error()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/protocol.py", line 221, in raise_for_error
err.raise_mysql_exception(self._data)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/err.py", line 143, in raise_mysql_exception
raise errorclass(errno, errval)
django.db.utils.ProgrammingError: (1146, "Table 'omp.omp_user_profile' doesn't exist")
mysql [running]
redis [running]
tengine [running]
uwsgi [running]
worker [running]
cron [running]
Traceback (most recent call last):
File "/data/omp/component/env/bin/salt-master", line 8, in
sys.exit(salt_master())
File "/data/omp/component/env/lib/python3.8/site-packages/salt/scripts.py", line 95, in salt_master
import salt.cli.daemons
File "/data/omp/component/env/lib/python3.8/site-packages/salt/cli/daemons.py", line 53, in
import salt.utils.parsers
File "/data/omp/component/env/lib/python3.8/site-packages/salt/utils/parsers.py", line 24, in
import salt.config as config
File "/data/omp/component/env/lib/python3.8/site-packages/salt/config/init.py", line 103, in
_DFLT_IPC_WBUFFER = _gather_buffer_space() * 0.5
File "/data/omp/component/env/lib/python3.8/site-packages/salt/config/init.py", line 91, in _gather_buffer_space
import salt.grains.core
File "/data/omp/component/env/lib/python3.8/site-packages/salt/grains/core.py", line 31, in
import salt.modules.cmdmod
File "/data/omp/component/env/lib/python3.8/site-packages/salt/modules/cmdmod.py", line 31, in
import salt.utils.templates
File "/data/omp/component/env/lib/python3.8/site-packages/salt/utils/templates.py", line 19, in
import salt.utils.jinja
File "/data/omp/component/env/lib/python3.8/site-packages/salt/utils/jinja.py", line 21, in
import salt.fileclient
File "/data/omp/component/env/lib/python3.8/site-packages/salt/fileclient.py", line 14, in
import salt.crypt
File "/data/omp/component/env/lib/python3.8/site-packages/salt/crypt.py", line 27, in
import salt.utils.crypt
File "/data/omp/component/env/lib/python3.8/site-packages/salt/utils/crypt.py", line 22, in
import Crypto.Random
File "/data/omp/component/env/lib/python3.8/site-packages/Crypto/Random/init.py", line 28, in
from Crypto.Random import OSRNG
File "/data/omp/component/env/lib/python3.8/site-packages/Crypto/Random/OSRNG/init.py", line 32, in
from Crypto.Random.OSRNG.posix import new
File "/data/omp/component/env/lib/python3.8/site-packages/Crypto/Random/OSRNG/posix.py", line 66
except IOError, e:
^
SyntaxError: invalid syntax
salt [running]
alertmanager [running]
grafana-server [running]
loki [running]
prometheus [running]
ntpd [running]
grafana-server [running]
{"message":"Logged in"}
Traceback (most recent call last):
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 84, in _execute
return self.cursor.execute(sql, params)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/mysql/base.py", line 73, in execute
return self.cursor.execute(query, args)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/cursors.py", line 148, in execute
result = self._query(query)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/cursors.py", line 310, in _query
conn.query(q)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 548, in query
self._affected_rows = self._read_query_result(unbuffered=unbuffered)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 775, in _read_query_result
result.read()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 1156, in read
first_packet = self.connection._read_packet()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 725, in _read_packet
packet.raise_for_error()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/protocol.py", line 221, in raise_for_error
err.raise_mysql_exception(self._data)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/err.py", line 143, in raise_mysql_exception
raise errorclass(errno, errval)
pymysql.err.ProgrammingError: (1146, "Table 'omp.omp_promemonitor_url' doesn't exist")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/data/omp/scripts/source/update_grafana.py", line 319, in
synch_grafana_info()
File "/data/omp/omp_server/utils/plugin/synch_grafana.py", line 37, in synch_grafana_info
monitor_url = monitor_ip[0].monitor_url if len(
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/models/query.py", line 269, in len
self._fetch_all()
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/models/query.py", line 1308, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/models/query.py", line 53, in iter
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1156, in execute_sql
cursor.execute(sql, params)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 98, in execute
return super().execute(sql, params)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 66, in execute
return self._execute_with_wrappers(sql, params, many=False, executor=self._execute)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 75, in _execute_with_wrappers
return executor(sql, params, many, context)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 84, in _execute
return self.cursor.execute(sql, params)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/utils.py", line 90, in exit
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 84, in _execute
return self.cursor.execute(sql, params)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/mysql/base.py", line 73, in execute
return self.cursor.execute(query, args)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/cursors.py", line 148, in execute
result = self._query(query)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/cursors.py", line 310, in _query
conn.query(q)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 548, in query
self._affected_rows = self._read_query_result(unbuffered=unbuffered)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 775, in _read_query_result
result.read()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 1156, in read
first_packet = self.connection._read_packet()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 725, in _read_packet
packet.raise_for_error()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/protocol.py", line 221, in raise_for_error
err.raise_mysql_exception(self._data)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/err.py", line 143, in raise_mysql_exception
raise errorclass(errno, errval)
django.db.utils.ProgrammingError: (1146, "Table 'omp.omp_promemonitor_url' doesn't exist")
Grafana配置更新失败
(env) [root@localhost omp]# cd omp_server/
(env) [root@localhost omp_server]# ls
app_store db_models dev_requirement.txt inspection omp_server services tests users
backups dev_code.md hosts manage.py promemonitor service_upgrade tool utils
(env) [root@localhost omp_server]# python manage.py shell
Python 3.8.12 (default, Apr 21 2022, 00:27:40)
[GCC 4.8.5 20150623 (Red Hat 4.8.5-44)] on linux
Type "help", "copyright", "credits" or "license" for more information.
(InteractiveConsole)

from utils.plugin.synch_grafana import synch_grafana_info
synch_grafana_info()
Traceback (most recent call last):
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 84, in _execute
return self.cursor.execute(sql, params)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/mysql/base.py", line 73, in execute
return self.cursor.execute(query, args)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/cursors.py", line 148, in execute
result = self._query(query)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/cursors.py", line 310, in _query
conn.query(q)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 548, in query
self._affected_rows = self._read_query_result(unbuffered=unbuffered)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 775, in _read_query_result
result.read()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 1156, in read
first_packet = self.connection._read_packet()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 725, in _read_packet
packet.raise_for_error()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/protocol.py", line 221, in raise_for_error
err.raise_mysql_exception(self._data)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/err.py", line 143, in raise_mysql_exception
raise errorclass(errno, errval)
pymysql.err.ProgrammingError: (1146, "Table 'omp.omp_promemonitor_url' doesn't exist")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "", line 1, in
File "/data/omp/omp_server/utils/plugin/synch_grafana.py", line 37, in synch_grafana_info
monitor_url = monitor_ip[0].monitor_url if len(
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/models/query.py", line 269, in len
self._fetch_all()
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/models/query.py", line 1308, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/models/query.py", line 53, in iter
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1156, in execute_sql
cursor.execute(sql, params)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 98, in execute
return super().execute(sql, params)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 66, in execute
return self._execute_with_wrappers(sql, params, many=False, executor=self._execute)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 75, in _execute_with_wrappers
return executor(sql, params, many, context)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 84, in _execute
return self.cursor.execute(sql, params)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/utils.py", line 90, in exit
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 84, in _execute
return self.cursor.execute(sql, params)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/mysql/base.py", line 73, in execute
return self.cursor.execute(query, args)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/cursors.py", line 148, in execute
result = self._query(query)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/cursors.py", line 310, in _query
conn.query(q)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 548, in query
self._affected_rows = self._read_query_result(unbuffered=unbuffered)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 775, in _read_query_result
result.read()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 1156, in read
first_packet = self.connection._read_packet()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 725, in _read_packet
packet.raise_for_error()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/protocol.py", line 221, in raise_for_error
err.raise_mysql_exception(self._data)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/err.py", line 143, in raise_mysql_exception
raise errorclass(errno, errval)
django.db.utils.ProgrammingError: (1146, "Table 'omp.omp_promemonitor_url' doesn't exist")

exit()

(env) [root@localhost omp_server]# python /data/omp/scripts/source/update_grafana.py 192.168.57.129
Traceback (most recent call last):
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 84, in _execute
return self.cursor.execute(sql, params)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/mysql/base.py", line 73, in execute
return self.cursor.execute(query, args)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/cursors.py", line 148, in execute
result = self._query(query)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/cursors.py", line 310, in _query
conn.query(q)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 548, in query
self._affected_rows = self._read_query_result(unbuffered=unbuffered)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 775, in _read_query_result
result.read()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 1156, in read
first_packet = self.connection._read_packet()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 725, in _read_packet
packet.raise_for_error()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/protocol.py", line 221, in raise_for_error
err.raise_mysql_exception(self._data)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/err.py", line 143, in raise_mysql_exception
raise errorclass(errno, errval)
pymysql.err.ProgrammingError: (1146, "Table 'omp.omp_promemonitor_url' doesn't exist")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/data/omp/scripts/source/update_grafana.py", line 319, in
synch_grafana_info()
File "/data/omp/omp_server/utils/plugin/synch_grafana.py", line 37, in synch_grafana_info
monitor_url = monitor_ip[0].monitor_url if len(
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/models/query.py", line 269, in len
self._fetch_all()
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/models/query.py", line 1308, in _fetch_all
self._result_cache = list(self._iterable_class(self))
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/models/query.py", line 53, in iter
results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1156, in execute_sql
cursor.execute(sql, params)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 98, in execute
return super().execute(sql, params)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 66, in execute
return self._execute_with_wrappers(sql, params, many=False, executor=self._execute)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 75, in _execute_with_wrappers
return executor(sql, params, many, context)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 84, in _execute
return self.cursor.execute(sql, params)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/utils.py", line 90, in exit
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/utils.py", line 84, in _execute
return self.cursor.execute(sql, params)
File "/data/omp/component/env/lib/python3.8/site-packages/django/db/backends/mysql/base.py", line 73, in execute
return self.cursor.execute(query, args)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/cursors.py", line 148, in execute
result = self._query(query)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/cursors.py", line 310, in _query
conn.query(q)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 548, in query
self._affected_rows = self._read_query_result(unbuffered=unbuffered)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 775, in _read_query_result
result.read()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 1156, in read
first_packet = self.connection._read_packet()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/connections.py", line 725, in _read_packet
packet.raise_for_error()
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/protocol.py", line 221, in raise_for_error
err.raise_mysql_exception(self._data)
File "/data/omp/component/env/lib/python3.8/site-packages/pymysql/err.py", line 143, in raise_mysql_exception
raise errorclass(errno, errval)
django.db.utils.ProgrammingError: (1146, "Table 'omp.omp_promemonitor_url' doesn't exist")

请问，是否有加入对docker容器管理的计划

请问，是否有加入对docker容器管理的计划

像jpom的这个docker容器管理功能，非常有用。

tengine无法启动

按照官方文档的方式下载包进行解压执行脚本，完成之后查看19001端口未启用，查询组件状态发现tengine无法启动，日志里面没有发现任何报错，希望能解惑一下，祝好

release 0.8只有ARM版本，没有x86

以后不支持x86了吗？可以用0.7的包替换源码后使用吗？

日志采集是否可以设置自定义采集规则

是否可以增加日志采集规则，对应名称以及文件地址目录。在根据采集规则下发到对应的Host 主机上。

添加主机失败

添加主机提示创建分区失败:
[2022-07-05 17:24:04,053][ERROR] ./utils/exception_handler.py 33 -> ExceptionResponse: {'data_folder': [ErrorDetail(string='创建数据分区操作失败', code='invalid')]}; {'view': <hosts.views.HostListView object at 0x7f4e67fe5c70>, 'args': (), 'kwargs': {}, 'request': <rest_framework.request.Request: POST '/api/hosts/hosts/'>}
[2022-07-05 17:24:04,054][ERROR] ./utils/exception_handler.py 34 -> ExceptionResponse: Traceback (most recent call last):
File "/data/omp/component/env/lib/python3.8/site-packages/rest_framework/views.py", line 506, in dispatch
response = handler(request, *args, **kwargs)
File "/data/omp/component/env/lib/python3.8/site-packages/rest_framework/mixins.py", line 18, in create
serializer.is_valid(raise_exception=True)
File "/data/omp/component/env/lib/python3.8/site-packages/rest_framework/serializers.py", line 228, in is_valid
raise ValidationError(self.errors)
rest_framework.exceptions.ValidationError: {'data_folder': [ErrorDetail(string='创建数据分区操作失败', code='invalid')]}