如何安装和使用A-ops工具?

一、pip配置

1.配置信任域

​
pip3 config set global.trusted-host mirrors.tools.huawei.com2.配置pip源的url地址pip3 config set global.index-url http://mirrors.tools.huawei.com/pypi/simple

二、npm安装及配置

npm -v检测系统有无安装npm,如果没有的话需要配置openEuler源，然后yum install

[root@localhost ~]# npm -v
6.14.16

npm源需要配置国内镜像源，因为默认是国外的。

​
npm config set registry=https://registry.npm.taobao.org

三、安装aops-inside

注意虚拟机运行build.sh需要内存大于4GB，否则报错

[root@localhost ~]# git clone https://gitee.com/sjh2022new/A-Ops.git
[root@localhost ~]# cd A-Ops/aops-inside/
[root@localhost aops-inside]# ll
total 72K
drwxr-xr-x 6 root root 4.0K Feb  1 09:45 aops_inside
drwxr-xr-x 2 root root 4.0K Feb  1 11:03 aops_inside.egg-info
-rw-r--r-- 1 root root  280 Feb  1 10:44 aops-inside.service
-rwxr-xr-x 1 root root 1.7K Feb  1 09:45 build.sh
-rw-r--r-- 1 root root   74 Feb  1 09:45 requirements.txt
[root@localhost aops-inside]# sh build.sh
生成两个rpm包
[root@localhost aops-inside]# ll /root/rpmbuild/RPMS/x86_64/
total 2.9M
-rw-r--r-- 1 root root 2.8M Feb  1 11:03 aops-inside-1.0.0-1.x86_64.rpm
-rw-r--r-- 1 root root  80K Feb  1 11:03 python3-aops-inside-1.0.0-1.x86_64.rpm

四、对脚本生成的rpm进行安装

[root@localhost x86_64]# yum install aops-inside-1.0.0-1.x86_64.rpm python3-aops-inside-1.0.0-1.x86_64.rpm -y
其中python3-aops-inside-1.0.0-1.x86_64.rpm安装时很慢，是在生成一些东西，需要等待一会儿。
安装完成后会生成/etc/aops-inside目录
[root@localhost ~]# ll /etc/aops-inside/conf/
total 8.0K
-rw-r--r-- 1 root root  437 Feb  1 10:42 aops-inside.conf
-rw-r--r-- 1 root root 1.1K Feb  1 09:45 metrics.conf
可编辑aops-inside.conf配置文件
[root@localhost ~]# cat /etc/aops-inside/conf/aops-inside.conf 
[Default]
backend_ip=192.168.137.17
backend_port=8080
fault_interval=259200
time_zone=Asia/Shanghai
​
[ArangoDB]
ip=192.168.137.17
port=8529
topo_db=spider
event_db=event
​
[Prometheus]
ip=192.168.137.17
port=9090
​
[Kafka]
ip=127.0.0.1
port=9092
abnormal_topic=gala_anteater_hybrid_model
root_cause_topic=gala_cause_inference
metadata_topic=gala_gopher_metadata
event_topic=gala_gopher_event
​
[fileserver]
ip=192.168.137.17
port=8123

五、尝试启动aops-inside

配置文件修改完，可试着启动服务，但是会显示服务秒停

[root@localhost ~]# systemctl status aops-inside
× aops-inside.service - Aops-insideLoaded: loaded (/usr/lib/systemd/system/aops-inside.service; enabled; vendor preset: disabled)Active: failed (Result: exit-code) since Wed 2023-02-01 13:56:42 CST; 44min agoProcess: 9448 ExecStart=/usr/bin/aops-inside runserver ${backend_ip}:${backend_port} (code=exited, status=1/FAILURE)Main PID: 9448 (code=exited, status=1/FAILURE)
​
Feb 01 13:56:40 localhost.localdomain systemd[1]: aops-inside.service: Main process exited, code=exited, status=1/FAILURE
Feb 01 13:56:40 localhost.localdomain systemd[1]: aops-inside.service: Failed with result 'exit-code'.
Feb 01 13:56:42 localhost.localdomain systemd[1]: aops-inside.service: Scheduled restart job, restart counter is at 5.
Feb 01 13:56:42 localhost.localdomain systemd[1]: Stopped Aops-inside.
Feb 01 13:56:42 localhost.localdomain systemd[1]: aops-inside.service: Start request repeated too quickly.
Feb 01 13:56:42 localhost.localdomain systemd[1]: aops-inside.service: Failed with result 'exit-code'.
Feb 01 13:56:42 localhost.localdomain systemd[1]: Failed to start Aops-inside.

把启动命令但拿出来运行会提示具体的报错信息：

[root@localhost ~]# /usr/bin/aops-inside runserver 192.168.137.17:8080
Traceback (most recent call last):File "/usr/bin/aops-inside", line 11, in mainfrom django.core.management import execute_from_command_line
ModuleNotFoundError: No module named 'django'
没有django

解决方法：

[root@localhost ~]#  pip install django
WARNING: Running pip install with root privileges is generally not a good idea. Try `pip install --user` instead.
Looking in indexes: http://mirrors.tools.huawei.com/pypi/simple
Collecting djangoDownloading http://mirrors.tools.huawei.com/pypi/packages/2d/ac/9f013a51e6008ba94a282c15778a3ea51a0953f6711a77f9baa471fd1b1d/Django-4.1.5-py3-none-any.whl (8.1 MB)|████████████████████████████████| 8.1 MB 3.1 MB/s            
Collecting asgiref<4,>=3.5.2Downloading http://mirrors.tools.huawei.com/pypi/packages/8f/29/38d10a47b322a77b2d12c2b79c789f52956f733cb701d4d5157c76b5f238/asgiref-3.6.0-py3-none-any.whl (23 kB)
Collecting sqlparse>=0.2.2Downloading http://mirrors.tools.huawei.com/pypi/packages/97/d3/31dd2c3e48fc2060819f4acb0686248250a0f2326356306b38a42e059144/sqlparse-0.4.3-py3-none-any.whl (42 kB)|████████████████████████████████| 42 kB 1.9 MB/s              
Installing collected packages: sqlparse, asgiref, django

再次运行启动命令，又提示缺少kafka,所以应该是要将配置文件中提到的插件全部安装才能启动服务

[root@localhost ~]# /usr/bin/aops-inside runserver 192.168.137.17:8080
Watching for file changes with StatReloader
Exception in thread django-main-thread:
Traceback (most recent call last):File "/usr/lib64/python3.10/threading.py", line 1009, in _bootstrap_innerself.run()File "/usr/lib64/python3.10/threading.py", line 946, in runself._target(*self._args, **self._kwargs)File "/usr/local/lib/python3.10/site-packages/django/utils/autoreload.py", line 64, in wrapperfn(*args, **kwargs)。。。。。。。。。。。。File "/usr/lib/python3.10/site-packages/aops_inside/data_collection/observe_entity.py", line 2, in <module>from data_collection.kafka_adpter import KafkaCollectorFile "/usr/lib/python3.10/site-packages/aops_inside/data_collection/kafka_adpter.py", line 1, in <module>from kafka import KafkaConsumer
ModuleNotFoundError: No module named 'kafka'

六、安装kafka

1.安装kafka需要先安装java

在openEuler22.03上可直接安装[root@localhost local]# yum install java-17-openjdk.x86_64 java-17-openjdk-devel.x86_64 -y
配置环境变量
[root@localhost ~]# tail -5 /etc/profile
JAVA_HOME=/usr/lib/jvm/java-17-openjdk-17.0.4.8-3.oe2209.x86_64/
JRE_HOME=$JAVA_HOME/jre
CLASS_PATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar:$JRE_HOME/lib
PATH=$PATH:$JAVA_HOME/bin:$JRE_HOME/bin
export JAVA_HOME JRE_HOME CLASS_PATH PATH
[root@localhost ~]# source /etc/profile
[root@localhost ~]# java --version
openjdk 17.0.4 2022-07-19
OpenJDK Runtime Environment 21.9 (build 17.0.4+8)
OpenJDK 64-Bit Server VM 21.9 (build 17.0.4+8, mixed mode, sharing)

2.安装zookeeper

[root@localhost ~]# wget https://dlcdn.apache.org/zookeeper/zookeeper-3.8.1/apache-zookeeper-3.8.1-bin.tar.gz
[root@localhost ~]# tar xf apache-zookeeper-3.8.1-bin.tar.gz -C /usr/local/
[root@localhost ~]# cd /usr/local/
[root@localhost local]# ll
total 44K
drwxr-xr-x  6 root root 4.0K Feb  1 16:21 apache-zookeeper-3.8.1-bin
drwxr-xr-x. 2 root root 4.0K Feb  1 14:22 bin
drwxr-xr-x. 2 root root 4.0K Mar 13  2022 etc
drwxr-xr-x. 2 root root 4.0K Mar 13  2022 games
drwxr-xr-x. 2 root root 4.0K Mar 13  2022 include
drwxr-xr-x. 4 root root 4.0K Feb  1 14:22 lib
drwxr-xr-x. 3 root root 4.0K Mar 13  2022 lib64
drwxr-xr-x. 2 root root 4.0K Mar 13  2022 libexec
drwxr-xr-x. 2 root root 4.0K Mar 13  2022 sbin
drwxr-xr-x. 5 root root 4.0K Mar 13  2022 share
drwxr-xr-x. 2 root root 4.0K Mar 13  2022 src
[root@localhost local]# mv apache-zookeeper-3.8.1-bin/ zookeeper

3.配置zookeeper环境变量

[root@localhost local]# vim /etc/profile
export ZOOKEEPER_HOME=/usr/local/zookeeper
export PATH=$PATH:${ZOOKEEPER_HOME}/bin
[root@localhost local]# source /etc/profile

4.修改zookeeper配置文件

[root@localhost local]# cd /usr/local/zookeeper/conf/
[root@localhost conf]# ll
total 16K
-rw-r--r-- 1 501 games  535 Jan 26 00:31 configuration.xsl
-rw-r--r-- 1 501 games 4.5K Jan 26 00:31 logback.xml
-rw-r--r-- 1 501 games 1.2K Jan 26 00:31 zoo_sample.cfg
[root@localhost conf]# cp zoo_sample.cfg zoo.cfg
[root@localhost conf]# vim zoo.cfg
#存放数据文件夹
dataDir=/usr/local/zookeeper/data
# the port at which the clients will connect
#添加日志存放文件夹
dataLogDir=/usr/local/zookeeper/datalog

5.启动zookeeper

[root@localhost bin]# zkServer.sh start
ZooKeeper JMX enabled by default
Using config: /usr/local/zookeeper/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
[root@localhost bin]# netstat -lntup|grep 2181
tcp6       0      0 :::2181                 :::*                    LISTEN      10269/java          

6.安装kafka

[root@localhost ~]# wget http://archive.apache.org/dist/kafka/3.3.2/kafka_2.12-3.3.2.tgz
[root@localhost ~]# tar xf kafka_2.12-3.3.2.tgz -C /usr/local/
[root@localhost ~]# cd /usr/local/
[root@localhost local]# mv kafka_2.12-3.3.2/ kafka
[root@localhost kafka]# ll
total 64K
drwxr-xr-x 3 root root 4.0K Dec 22 05:18 bin
drwxr-xr-x 3 root root 4.0K Dec 22 05:18 config
drwxr-xr-x 2 root root 4.0K Feb  1 17:42 libs
-rw-r--r-- 1 root root  15K Dec 22 05:14 LICENSE
drwxr-xr-x 2 root root 4.0K Dec 22 05:18 licenses
-rw-r--r-- 1 root root  28K Dec 22 05:14 NOTICE
drwxr-xr-x 2 root root 4.0K Dec 22 05:18 site-docs
[root@localhost kafka]# cd config/
[root@localhost config]# vim server.properties
broker.id=0
listeners=PLAINTEXT://192.168.137.17:9092
log.dirs=/usr/local/kafka-logs
zookeeper.connect=192.168.137.17:2181
保存退出

7.启动kafka

[root@localhost kafka]# bin/kafka-server-start.sh config/server.properties &
[root@localhost kafka]# netstat -lntup|grep 9092
tcp6       0      0 192.168.137.17:9092     :::*                    LISTEN      10395/java

8.安装和启动Prometheus

[root@localhost kafka]# yum search prometheus
Last metadata expiration check: 17:07:53 ago on Wed 01 Feb 2023 03:33:00 PM CST.
========================================================== Name & Summary Matched: prometheus ==========================================================
ceph-prometheus-alerts.noarch : Prometheus alerts for a Ceph deployment
collectd-write_prometheus.x86_64 : Prometheus output plugin for collectd
prometheus2.x86_64 : The Prometheus 2.x monitoring system and time series database.
[root@localhost kafka]# yum install prometheus2
[root@localhost prometheus]# systemctl start prometheus
[root@localhost prometheus]# systemctl enable prometheus
Created symlink /etc/systemd/system/multi-user.target.wants/prometheus.service → /usr/lib/systemd/system/prometheus.service.

9.安装Arangodb

[root@localhost ~]# cd /etc/yum.repos.d/
[root@localhost ~]# curl -OL https://download.arangodb.com/arangodb37/RPM/arangodb.repo
[root@localhost ~]# yum -y install arangodb3-3.7.11-1.0
[root@localhost ~]# arango-secure-installation #设置密码
[root@localhost ~]# systemctl start arangodb3.service
[root@localhost ~]# systemctl enable arangodb3.service
再次启动aops-inside,服务可以启动，但是日志提示No module named kafka解决方法：[root@localhost aops-inside]# pip install -r requirements.txt
[root@localhost aops-inside]# python3 setup.py install

10.启动aops-inside

[root@localhost conf]# systemctl restart aops-inside
[root@localhost conf]# systemctl status aops-inside
● aops-inside.service - Aops-insideLoaded: loaded (/usr/lib/systemd/system/aops-inside.service; enabled; vendor preset: disabled)Active: active (running) since Thu 2023-02-02 10:03:50 CST; 116ms agoMain PID: 13209 (python3)Tasks: 1 (limit: 2304)Memory: 17.9MCGroup: /system.slice/aops-inside.service└─13209 python3 /usr/bin/aops-inside runserver 192.168.137.17:8080
​
Feb 02 10:03:50 localhost.localdomain systemd[1]: aops-inside.service: Scheduled restart job, restart counter is at 3.
Feb 02 10:03:50 localhost.localdomain systemd[1]: Stopped Aops-inside.
Feb 02 10:03:50 localhost.localdomain systemd[1]: Started Aops-inside.