搭建grafana+loki+promtail日志收集系统

准备工作

下载地址

https://github.com/grafana/loki/releases

安装包放在服务器目录：/opt

wget https://github.com/grafana/loki/releases/download/v2.4.2/loki-linux-amd64.zip
wget https://github.com/grafana/loki/releases/download/v2.4.2/promtail-linux-amd64.zip

1、启动loki

1）解压loki-linux-amd64.zip

unzip loki-linux-amd64.zip 

2）授权

chmod a+x loki-linux-amd64

3）配置文件loki.yaml

vi loki.yamlauth_enabled: falseserver:http_listen_port: 3100grpc_listen_port: 3110grpc_server_max_recv_msg_size: 1073741824  #grpc最大接收消息值，默认4mgrpc_server_max_send_msg_size: 1073741824  #grpc最大发送消息值，默认4mingester:lifecycler:address: 127.0.0.1ring:kvstore:store: inmemoryreplication_factor: 1final_sleep: 0schunk_idle_period: 5mchunk_retain_period: 30smax_transfer_retries: 0max_chunk_age: 20m  #一个timeseries块在内存中的最大持续时间。如果timeseries运行的时间超过此时间，则当前块将刷新到存储并创建一个新块schema_config:configs:- from: 2021-01-01store: boltdbobject_store: filesystemschema: v11index:prefix: index_period: 168hstorage_config:boltdb:directory: /opt/loki/index #存储索引地址filesystem:directory: /opt/loki/chunkslimits_config:enforce_metric_name: falsereject_old_samples: truereject_old_samples_max_age: 168hingestion_rate_mb: 30  #修改每用户摄入速率限制，即每秒样本量，默认值为4Mingestion_burst_size_mb: 15  #修改每用户摄入速率限制，即每秒样本量，默认值为6Mchunk_store_config:#max_look_back_period: 168h   #回看日志行的最大时间，只适用于即时日志max_look_back_period: 0stable_manager:retention_deletes_enabled: false #日志保留周期开关，默认为falseretention_period: 0s  #日志保留周期

4）启动进程

nohup /opt/loki/loki-linux-amd64 -config.file=/opt/loki/loki.yaml >loki.out 2>&1 &

2、启动promtail

1）解压loki-linux-amd64.zip

unzip promtail-linux-amd64.zip

2）授权

chmod a+x promtail-linux-amd64

3）配置文件promtail.yaml

vi promtail.yamlserver:http_listen_port: 9080grpc_listen_port: 0grpc_server_max_recv_msg_size: 15728640grpc_server_max_send_msg_size: 15728640positions:filename: /opt/loki/positions.yaml # This location needs to be writeable by promtail.client:url: http://xx.xx.xx.xx:3100/loki/api/v1/push#https://grafana.com/docs/loki/latest/clients/promtail/configuration/
scrape_configs:
- job_name: systemstatic_configs:- targets:- localhostlabels:job: messages__path__: /var/log/messages
- job_name: systemstatic_configs:- targets:- localhostlabels:job: varlogs__path__: /var/log/*log
- job_name: systemstatic_configs:- targets:- localhostlabels:job: secure__path__: /var/log/secure
#lastlog
- job_name: systemstatic_configs:- targets:- localhostlabels:job: lastlog__path__: /var/log/lastlog
#cron
- job_name: systemstatic_configs:- targets:- localhostlabels:job: cron__path__: /var/log/cron

4）启动进程

nohup /opt/loki/promtail-linux-amd64 -config.file=/opt/loki/promtail.yaml >promtail.out 2>&1 &

3、启动grafana

1）安装

官网安装教程地址：Download Grafana | Grafana Labs

wget https://dl.grafana.com/oss/release/grafana-7.4.3-1.x86_64.rpm 
sudo yum install grafana-7.4.3-1.x86_64.rpm 

2）启动

systemctl start grafana-server

3）查看状态

systemctl status grafana-server

4、logcli

1）下载

wget https://github.com/grafana/loki/releases/download/v2.4.2/logcli-linux-amd64.zip

2）解压logcli-linux-amd64.zip

unzip logcli-linux-amd64.zip

3）授权

chmod a+x logcli-linux-amd64.zip

4）查看

{job="cron"} |~ "ERROR"!= "(python3)"