feat(chstorage): implement metrics storage#229

Merged

ernado merged 112 commits intomainfrom feat/metrics-chstorage

Dec 1, 2023

+50,314-1,959

Commits on Dec 1, 2023

feat(chstorage): implement metrics storage

tdakkota
authored and
ernado
committed
feat(dev): privision prometheus and node-exporter
ernado
committed
feat(dev): setup otelcol
ernado
committed
fix(dev): fix clickhouse-data dashboard query
ernado
committed
refactor(chstorage): use JSON to store attributes

tdakkota
authored and
ernado
committed
chore(chstorage): trace Prometheus querier

tdakkota
authored and
ernado
committed
feat(dev): add jaeger
ernado
committed
feat(dev): add otelcol dashboard
ernado
committed
feat(dev): add clickhouse trace exporter
ernado
committed
feat(chstorage): implement basic inserter

tdakkota
authored and
ernado
committed
feat(oteldb): properly setup Clickhouse storage

tdakkota
authored and
ernado
committed
fix(chstorage.querier): use tracer provider
ernado
committed
feat(chstorage): insert labels too

tdakkota
authored and
ernado
committed
chore: fix lint issues
ernado
committed
feat(chstorage): label querier

tdakkota
authored and
ernado
committed
fix(tempoe2e): set Clickhouse table names

tdakkota
authored and
ernado
committed
fix(chstorage): validate table name before creation

tdakkota
authored and
ernado
committed
fix(chstorage): use right column name

tdakkota
authored and
ernado
committed
ci(lint): fix issues

tdakkota
authored and
ernado
committed
fix(chstorage): handle empty value type

tdakkota
authored and
ernado
committed
fix(chstorage): use right column type

tdakkota
authored and
ernado
committed
test(prome2e): add basic Prometheus API test

tdakkota
authored and
ernado
committed
chore(prome2e): add metrics testdata

tdakkota
authored and
ernado
committed
fix(metricsharding): handle empty value type

tdakkota
authored and
ernado
committed
fix(chstorage): series query building

tdakkota
authored and
ernado
committed
fix(chstorage): add name as label to series result

tdakkota
authored and
ernado
committed
chore(chstorage): make field name match column name

tdakkota
authored and
ernado
committed
test(prome2e): add series query test

tdakkota
authored and
ernado
committed
fix(chstorage): use constructor for series set

tdakkota
authored and
ernado
committed
test(prome2e): add more series endpoint tests

tdakkota
authored and
ernado
committed
fix(otedlb): set timeout for engine

tdakkota
authored and
ernado
committed
fix(otedlb): set samples limit for engine

tdakkota
authored and
ernado
committed
test(prome2e): set engine limits properly

tdakkota
authored and
ernado
committed
fix(chstorage): handle seek to the first point properly

tdakkota
authored and
ernado
committed
test(prome2e): make a simple PromQL query

tdakkota
authored and
ernado
committed
feat(dev.local.ch): more compatibility testing
ernado
committed
feat(chstorage): insert all received metrics data

tdakkota
authored and
ernado
committed
chore(integration): update tests due to chstorage changes

tdakkota
authored and
ernado
committed
fix(prome2e): collect labels from all metrics

tdakkota
authored and
ernado
committed
feat(chstorage): draft log inserter
ernado
committed
fix: setup all table names
ernado
committed
chore(lint): wrap err
ernado
committed
fix: use DefaultTables
ernado
committed
feat(dev): add otelfaker
ernado
committed
fix(chstorage): fix log schema
ernado
committed
chore(dev): rename faker service
ernado
committed
feat: improve clickhouse client logging
ernado
committed
feat(otelschema): add semconv schema parser
ernado
committed
feat(otelschema): add golden test
ernado
committed
fix(otelschema): make examples array
ernado
committed
fix(otelschema): make examples raw back
ernado
committed
feat(otelschema): improve examples schema
ernado
committed
test(otelschema): improve all attributes golden file
ernado
committed
feat(otelschema): add clickhouse column types
ernado
committed
feat(otelschema): handle deprecation
ernado
committed
feat(otelschema): handle ISO 8601
ernado
committed
ci: submodules
ernado
committed
feat(otelschema): use underscores
ernado
committed
feat(otelschema): generate DDL
ernado
committed
feat(otelschema): add table generator
ernado
committed
fix(otelschema): proper json encoding
ernado
committed
feat(chstorage): optimize schema
ernado
committed
feat(chstorage): draft logs impl
ernado
committed
test(lokie2e): change json to jsonl
ernado
committed
test(lokie2e): always send time range
ernado
committed
fix(chstorage.querier.logs): fix iterator
ernado
committed
feat(chstorage.querier.logs): support REGEXP
ernado
committed
feat(chstorage): save metric flags too

tdakkota
authored and
ernado
committed
feat(chstorage): query exponential histograms too

tdakkota
authored and
ernado
committed
feat(chstorage): query histograms too

tdakkota
authored and
ernado
committed
feat(chstorage.logs): undot
ernado
committed
chore: rm print
ernado
committed
test(lokie2e): undot
ernado
committed
feat(oteldb.dev.local): add loki push
ernado
committed
fix(oteldb.dev.local): httpMethod: GET
ernado
committed
feat(lokiapi): add indexStats endpoint
ernado
committed
feat(chstorage): query summaries too

tdakkota
authored and
ernado
committed
fix(chstorage): call the right function

tdakkota
authored and
ernado
committed
feat(otelfaker): improve
ernado
committed
docs(logs): init
ernado
committed
feat(dev.local.ch): add tempo
ernado
committed
feat(chotel): set span kind
ernado
committed
feat(otelfaker): add multiple levels
ernado
committed
docs(logs): upd
ernado
committed
docs: upd
ernado
committed
docs(logs): don't search in all attrs
ernado
committed
docs(logs): describe extracted labels
ernado
committed
docs(logs): typo
ernado
committed
fix(chstorage): dedup labels before inserting

tdakkota
authored and
ernado
committed
refactor(chstorage): map histograms and summaries into points

tdakkota
authored and
ernado
committed
test(prome2e): query histograms and summaries

tdakkota
authored and
ernado
committed
test(lokie2e): rework
ernado
committed
chore: rm
ernado
committed
chore(git): upd submodule
ernado
committed
test(lokie2e): also test with dots
ernado
committed
fix(chstorage.querier.logs): correctly return label values
ernado
committed
feat(logqlengine): add msg to labels
ernado
committed
docs(readme): upd
ernado
committed
feat(logql): improve loki schema mapping
ernado
committed
feat(logqlengine): move trace_id, span_id to the tail of json
ernado
committed
fix(logqlengine): fix NPE
ernado
committed
feat(zapotel): init zap to otel
ernado
committed
feat: enable zapotel
ernado
committed
chore: pass ch.Query.Logger
ernado
committed
chore: pass ch.Query.Logger
ernado
committed
chore: rm printf
ernado
committed
fix(chstorage): order by timestamp
ernado
committed
chore: use lg from zctx
ernado
committed
feat(chstorage.querier.logs): optimize external table select
ernado
committed
fix(chstorage.logs): use exact match for materialized service. labels

tdakkota
authored and
ernado
committed
fix(chstorage.q.logs): fix body tag matcher
ernado
committed
fix(logqlengine): adapt to OTEL
ernado
committed