linux之centos 7 安装搭建grafana+loki+promtail日志收集系统

前言

介绍：grafana+loki+promtail

1.下载安装包

下载地址

https://github.com/grafana/loki/releases 看自己需要下载版本 把安装包放在服务器目录：/opt

2.启动loki

1）解压loki-linux-amd64.zip

unzip loki-linux-amd64.zip

2）授权

chmod a+x loki-linux-amd64

3）配置文件loki.yaml

auth_enabled: false

server:
  http_listen_port: 3100
  grpc_listen_port: 3110
  grpc_server_max_recv_msg_size: 1073741824  #grpc最大接收消息值，默认4m
  grpc_server_max_send_msg_size: 1073741824  #grpc最大发送消息值，默认4m

ingester:
  lifecycler:
    address: 127.0.0.1
    ring:
      kvstore:
        store: inmemory
      replication_factor: 1
    final_sleep: 0s
  chunk_idle_period: 5m
  chunk_retain_period: 30s
  max_transfer_retries: 0
  max_chunk_age: 20m  #一个timeseries块在内存中的最大持续时间。如果timeseries运行的时间超过此时间，则当前块将刷新到存储并创建一个新块

schema_config:
  configs:
    - from: 2021-01-01
      store: boltdb
      object_store: filesystem
      schema: v11
      index:
        prefix: index_
        period: 168h

storage_config:
  boltdb:
    directory: /opt/loki/index #存储索引地址
  filesystem:
    directory: /opt/loki/chunks

limits_config:
  enforce_metric_name: false
  reject_old_samples: true
  reject_old_samples_max_age: 168h
  ingestion_rate_mb: 30  #修改每用户摄入速率限制，即每秒样本量，默认值为4M
  ingestion_burst_size_mb: 15  #修改每用户摄入速率限制，即每秒样本量，默认值为6M

chunk_store_config:
        #max_look_back_period: 168h   #回看日志行的最大时间，只适用于即时日志
  max_look_back_period: 0s

table_manager:
  retention_deletes_enabled: false #日志保留周期开关，默认为false
  retention_period: 0s  #日志保留周期

4）启动进程

nohup /opt/loki/loki-linux-amd64 -config.file=/opt/loki/loki.yaml >loki.out 2>&1 &

3.启动promtail

1）解压loki-linux-amd64.zip

unzip promtail-linux-amd64.zip

2）授权

chmod a+x promtail-linux-amd64

3）配置文件promtail.yaml

server:
  http_listen_port: 9080
  grpc_listen_port: 0
  grpc_server_max_recv_msg_size: 15728640
  grpc_server_max_send_msg_size: 15728640

positions:
  filename: /opt/loki/positions.yaml # This location needs to be writeable by promtail.

client:
  url: http://127.0.0.1:3100/loki/api/v1/push

#https://grafana.com/docs/loki/latest/clients/promtail/configuration/
scrape_configs:
 - job_name: test-1
   pipeline_stages:
   static_configs:
   - targets:
      - localhost
     labels:
      job: test-1
      host: node-2
      __path__: /var/log/yuntu/gateserver*.log
 - job_name: test-2
   pipeline_stages:
   static_configs:
   - targets:
      - localhost
     labels:
      job: test-2
      host: node-1
      __path__: /var/log/yuntu/graphicsserver*.log

4）启动进程

nohup /opt/loki/promtail-linux-amd64 -config.file=/opt/loki/promtail.yaml >promtail.out 2>&1 &

4.启动grafana

1）安装 官网安装教程地址：https://grafana.com/grafana/download

wget https://dl.grafana.com/oss/release/grafana-7.4.3-1.x86_64.rpm 
sudo yum install grafana-7.4.3-1.x86_64.rpm

2）启动

systemctl start grafana-server

3）查看状态：systemctl status grafana-server

● grafana-server.service - Grafana instance
   Loaded: loaded (/usr/lib/systemd/system/grafana-server.service; disabled; vendor preset: disabled)
   Active: active (running) since 五 2021-03-05 10:42:18 CST; 2s ago
     Docs: http://docs.grafana.org
 Main PID: 15307 (grafana-server)
    Tasks: 8
   Memory: 18.7M
   CGroup: /system.slice/grafana-server.service
           └─15307 /usr/sbin/grafana-server --config=/etc/grafana/grafana.ini --pidfile=/var/run/grafana/grafana-server.pid --packaging=rpm cfg:default.paths.logs=/var/log/grafana cfg:...

5）访问界面

完成搭建