Skip to content

Latest commit

 

History

History
46 lines (32 loc) · 1.12 KB

File metadata and controls

46 lines (32 loc) · 1.12 KB

timeseries_database_utils

time series databases

Time Series databases:

  1. InfluxDB
  2. Prometheus
  3. ElasticSearch
  4. OpenTSDB
  5. Postgress
  6. BigTable

Why InfluxDB:

  1. Lighweight
  2. Schemaless
  3. Allow indexing via specific filed in the data
  4. Fast data ingestion (Write) and aggregation(read0)
  5. High Avaibility
  6. InfluxData Stack(Kapacitor,Chronograf,Telegraf)

High Level Design Flow

  1. Kafka --> LogStash/Telegraf (Data Ingestion) ---> InfluxDB --->Kapacitor(Alerting) ---> InfluxDB ---> Grafana/Chronograf(UI)
  2. Faust APP (Anomaly Detection)

InfluxDB Stack

  1. UI: Chronograf
  2. Ingestion: Telegraf
  3. Alerting: Kapacitor

Telegraf Flow

image

Prometheus

  1. Pulls metrics data from instrumented targets with the Prometheus server
  2. Visulizes metrics with the Prometheus UI
  3. Send alert with the Prometheus Alert Manager
  4. Receives metrics data from the Prometheus Push gateway

image