Grafana Loki 2.2.1 → 3.7.9
107 releases · 20 breaking changes · 16 security fixes · 0 advisories fixed
16security20breaking4deprecated413feature288fix
Breaking changes
- breaking operator: switch default for OpenShift stream labels () in 3.7.3
- breaking engine: Make scheduler aware of total compute capacity () in 3.7.0
- breaking parsed labels should not override structured metadata () in 3.7.0
- breaking engine: Share worker threads across all scheduler connections () in 3.7.0
- breaking operator: consolidate image build workflows and improve documentation () in 3.6.12
- breaking move the Loki UI to a Grafana Plugin () in 3.6.12
- breaking operator: CI publishing image strategy () in 3.6.12
- breaking operator: Add configuration option for dropping OTLP attributes () in 3.5.0
- breaking ksonnet: clean-up deprecated configs () in 3.5.0
- breaking Remove wget from Promtail docker image () in 3.4.0
- breaking Remove wget from Promtail docker image () (2eea546) in 3.4.0
- breaking promtail: Remove wget from Promtail docker image (backport release-3.3.x) () in 3.3.1
- breaking blooms: Introduce a new block schema (V3) () in 3.3.0
- breaking blooms: Index structured metadata into blooms () in 3.3.0
- breaking promtail: Remove wget from Promtail docker image (backport release-3.2.x) () in 3.2.2
- breaking api: Fail log queries when executed on instant query endpoint () in 3.2.0
- breaking jsonnet: convert read statefulset into deployment for loki-simple-scalable () in 3.2.0
- breaking blooms: Remove bloom compactor component () in 3.2.0
- breaking blooms: Remove bloom compactor component () (b75eacc) in 3.2.0
- breaking update helm chart to support distributed mode and 3.0 () in 3.1.0
Security changes
- security security/HIGH/: Bump Go to 1.26.5 to address CVE-2026-39822 and CVE-2026-42505 [SECURITY] () (b318f28) in 3.7.4
- security security/HIGH/: Bump Go to 1.26.5 to address CVE-2026-39822 and CVE-2026-42505 [SECURITY] () (fc478e1) in 3.6.13
- security deps: remove CVE GHSA-2464-8j7c-4cjm () (f2a304a) in 3.5.6
- security promtail: Switch Promtail base image from Debian to Ubuntu to fix critical security issues (https://github.com/grafana/loki/issues/15195). in 3.3.1
- security promtail: Switch Promtail base image from Debian to Ubuntu to fix critical security issues (). in 3.2.2
- security Upgrade otelhttp from 0.40.0 -> 0.44.0 and base alpine image from 3.18.3 -> 3.18.5 to fix a few CVES (CVE-2023-45142, CVE-2022-21698, CVE-2023-5363). in 2.9.3
- security Patches CVE-2023-39325 / CVE-2023-44487 by upgrading go to v1.21.3, golang.org/x/net to v0.17.0 and grpc-go to v1.56.3. in 2.9.2
- security Updated all Docker base images to Alpine 3.18.3 to mitigate CVE-2022-48174 (#10573 ) in 2.9.1
- security Patches CVE-2023-39325 / CVE-2023-44487 by upgrading go to v1.20.10, golang.org/x/net to v0.17.0 and grpc-go to v1.56.3 in 2.8.6
- security Updated all Docker base images to Alpine 3.18.3 to mitigate CVE-2022-48174 (#10573 ) in 2.8.5
- security Fix CVE-2023-1255, CVE-2023-2650, CVE-2023-2975, CVE-2023-3446, and CVE-2023-3817 in 2.8.4
- security Upgrade to go 1.20.4 to address security vulnerabilities in the previous go version. in 2.8.2
- security Update go to 1.20.3 to address security vulnerabilities in the previous go version. in 2.8.1
- security Update alpine image to 3.16.5 to address security vulnerabilities in the previous version. in 2.8.1
- security Fix CVE-2023-1255, CVE-2023-2650, CVE-2023-2975, CVE-2023-3446, CVE-2023-3817, and CVE-2022-41721 in 2.7.7
- security 4020 simonswine: Restrict path segments in TenantIDs (CVE-2021-36156 CVE-2021-36157). in 2.3.0
Deprecations
- deprecated ksonnet: clean-up deprecated configs () (76183fa) in 3.5.0
- deprecated Deprecated storage options including the deprecation of the BoltDB store. in 3.0.0
- deprecated Deprecated configuration options. in 3.0.0
- deprecated API endpoint deprecations. in 3.0.0
Every release in between
fixdeps: Update github.com/thanos-io/objstore digest to 72d3b9f (release-3.7.x) () (e7d6809)
fixdeps: Update go4.org/netipx digest to 3075585 (release-3.7.x) () (24be2f4)
fixdeps: Update k8s.io/utils digest to cf1189d (release-3.7.x) () (a5218df)
fixingester: Concurrent WAL Append() calls could lead to inconsitent record order and irrecoverable WAL state () (72aa93e)
fixLimit request body size for ruler "CreateRuleGroup" API and LogQLAnalyzer API [release-3.7.x] () (6c6e9dc)
fixlogql: Keep entries while stream accumulator has free room [release-3.7.x] () (4390fb1)
fixsecurity/LOW/: Update module go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc to v1.45.0 [SECURITY] (release-3.7.x) () (bab6de2)
fixsecurity/LOW/: Update module go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracehttp to v1.45.0 [SECURITY] (release-3.7.x) () (7aee5f1)
fixsecurity/LOW/: Update module go.opentelemetry.io/otel/sdk to v1.45.0 [SECURITY] (release-3.7.x) () (b787d9a)
fixsecurity/MEDIUM/: Update module github.com/containerd/containerd/v2 to v2.2.9 [SECURITY] (release-3.7.x) () (bafb1b8)
fixsecurity: Bump Go to 1.26.10 [SECURITY] (release-3.7.x) () (d3b4a2f)
fixsecurity/HIGH/pkg/push: Update module google.golang.org/grpc to v1.83.2 [SECURITY] (release-3.7.x) () (4d5dc2b)
fixsecurity/HIGH/: Update module google.golang.org/grpc to v1.83.1 [SECURITY] (release-3.7.x) () (0a01797)
fixsecurity/HIGH/: Update module google.golang.org/grpc to v1.83.2 [SECURITY] (release-3.7.x) () (14b5da8)
fixsecurity/MEDIUM/: Update module github.com/containerd/containerd/v2 to v2.2.8 [SECURITY] (release-3.7.x) () (3e917f2)
fixsecurity/UNKNOWN/pkg/push: Update module golang.org/x/net to v0.56.0 [SECURITY] (release-3.7.x) () (41064da)
fixsecurity/UNKNOWN/pkg/push: Update module google.golang.org/grpc to v1.83.1 [SECURITY] (release-3.7.x) () (cd8e76d)
fixsecurity/UNKNOWN/: Update module golang.org/x/crypto to v0.56.0 [SECURITY] (release-3.7.x) () (47149cb)
featureAdd flag to ignore missing chunks during deletion of logs with line filter [release-3.7.x] () (7a40404)
fixsecurity/UNKNOWN/: Update module github.com/containerd/containerd/v2 to v2.2.5 [SECURITY] (release-3.7.x) () (07cd1f0)
fixsecurity/UNKNOWN/: Update module go.etcd.io/etcd/client/pkg/v3 to v3.6.14 [SECURITY] (release-3.7.x) () (9d1c9ee)
fixsecurity/UNKNOWN/: Update module golang.org/x/mod to v0.40.0 [SECURITY] (release-3.7.x) () (1d5e027)
fixstorage: Pre-compute SHA-256 to avoid aws-chunked on PutObject [release-3.7.x] () (3d6f245)
fixqueryrange: Preserve sketch in MergeLabels [release-3.7.x] () (d48329d)
fixBuild deb/rpm packages again in the release workflow () (6f49272)
fixci: Disable docker plugin publishing on release-3.7.x () (6095f71)
fixingester: Fix flush race in ingester [release-3.7.x] () (ff152dc)
fixsecurity/UNKNOWN/cmd/chunks-inspect: Update module github.com/klauspost/compress to v1.18.7 [SECURITY] (release-3.7.x) () (11c4b29)
fixsecurity/UNKNOWN/cmd/dataobj-inspect: Update module github.com/klauspost/compress to v1.18.7 [SECURITY] (release-3.7.x) () (1e3108e)
fixsecurity/UNKNOWN/cmd/dataobj-inspect: Update module go.opentelemetry.io/otel to v1.42.0 [SECURITY] (release-3.7.x) () (28917d3)
fixsecurity/UNKNOWN/cmd/dataobj-inspect: Update module golang.org/x/text to v0.39.0 [SECURITY] (release-3.7.x) () (5d2b9d4)
fixsecurity/UNKNOWN/operator: Update module github.com/klauspost/compress to v1.18.7 [SECURITY] (release-3.7.x) () (8d71c59)
fixsecurity/UNKNOWN/: Update module github.com/klauspost/compress to v1.18.7 [SECURITY] (release-3.7.x) () (941b557)
fixsecurity/UNKNOWN/: Update module golang.org/x/text to v0.39.0 [SECURITY] (release-3.7.x) () (2347a9a)
fixsecurity/UNKNOWN/: Update module google.golang.org/grpc to v1.82.1 [SECURITY] (release-3.7.x) () (f290af0)
fixci: Fix zizmor findings for operator-images in Loki 3.7 () (abc1186)
fixci: Helm CI warning fix () (7389428)
fixci: Re-enable docker plugin publishing () (28f44a8)
fixcompactor: Fix delete request when using Thanos objstore client with filesystem backend [release-3.7.x] () (dd6fdb5)
fixdeps: Update module charm.land/bubbletea/v2 to v2.0.7 (release-3.7.x) () (e11f935)
fixdeps: Update module charm.land/lipgloss/v2 to v2.0.4 (release-3.7.x) () (10213c2)
fixdeps: Update module github.com/aws/aws-sdk-go-v2/credentials to v1.19.24 (release-3.7.x) () (3daf198)
fixdeps: Update module github.com/aws/smithy-go to v1.27.3 (release-3.7.x) () (1f6a191)
fixdeps: Update module github.com/baidubce/bce-sdk-go to v0.9.270 (release-3.7.x) () (103ccd8)
fixdeps: Update module github.com/coder/quartz to v0.3.1 (release-3.7.x) () (3509e31)
fixdeps: Update module github.com/IBM/ibm-cos-sdk-go to v1.14.1 (release-3.7.x) () (d0abe72)
fixdeps: Update module github.com/klauspost/compress to v1.18.6 (release-3.7.x) () (327da7c)
fixdeps: Update module github.com/pierrec/lz4/v4 to v4.1.27 (release-3.7.x) () (6b3297f)
fixdeps: Update module github.com/shirou/gopsutil/v4 to v4.26.5 (release-3.7.x) () (cb7f17d)
fixsecurity/CRITICAL/clients/cmd/fluentd/docker: Update dependency fluentd to v1.19.3 [SECURITY] (release-3.7.x) () (6d8f1b5)
securitysecurity/HIGH/: Bump Go to 1.26.5 to address CVE-2026-39822 and CVE-2026-42505 [SECURITY] () (b318f28)
fixsecurity/HIGH/: Update module github.com/apache/thrift to v0.24.0 [SECURITY] (release-3.7.x) () (36eb5f7)
fixsecurity/UNKNOWN/pkg/push: Update module golang.org/x/net to v0.55.0 [SECURITY] (release-3.7.x) () (dd7a124)
fixsecurity/UNKNOWN/: Update module github.com/containerd/containerd/v2 to v2.0.10 [SECURITY] (release-3.7.x) () (6fa6165)
fixstorage: Fix index filename issue with legacy S3 client and chunk_delimiter () (0eca83c)
breakingoperator: switch default for OpenShift stream labels ()
featureadd bloom filter to cache known streams for ExceedsLimits requests () (f5440a3)
featureadd builder pool to logsobj package () (8a68101)
featureadd case-insensitive regex optimization () (f6a6a4f)
featureAdd config to delegate stream limits check to limits-service only () (ba119f6)
featureadd flush manager to control data object flush lifecycle () (c169ce3)
featureadd GroupConsumer to kafkav2 package () (5ad60ee)
featureAdd results cache to thor query engine () (6ef3827)
featureAdd SubstringInsensitive compute fn () (9c03192)
featureAlign start time when the query is received () (8e18f10)
featureallow the initial offset to be set in the starting phase () (93f4bdf)
featureBatch records before writing to sinks () (f083618)
featurebench: add simulated object storage latency to LogQL benchmarks () (5102ed0)
featurebuild: Move to Go 1.26 () (4fb960c)
featureclose the records chan when consumer terminates () (c3d0de9)
featuredataobj-compactor: add a planner for compaction of data objects () (7f1450d)
featuredon't shuffle shard if shard factor is 1 () (7ac1d16)
featureearly goldfish correlation ID generation with X-Loki-Goldfish-ID header () (e90e4a6)
featureengine: Dedupe entries when building final result () (e95137a)
featureenginev2: Implement IsMember compute function () (a28d8b4)
featureenginev2: Implement regexp compute function () (7b8d51b)
featureenginev2: Implement substr compute function () (9740619)
featurehelm: Add common labels to all resources () (dc21099)
featurehelm: allow customization of write, read and backend PDB () (9f653b1)
featurehelm: finalize chart fork () (33f7a1b)
featurehelm: Memcached: allow to override CPU in the auto-computed resource mode () (3886548)
featureIntroduce a rate batcher to batch rate updates () (b9a0a15)
featurelimits: Add emptiness check to prepare for multiAZ () (4eeb70c)
featureloki-query-engine: instrument query-engine with runtime/trace () (a7c75a6)
featureloki: allow disabling cache for query_range requests () (1242aa5)
featureoperator: add option to customize gateway server cert () (3c8b9e8)
featureoperator: switch default for OpenShift stream labels () (61ec040)
featureoperator: Update Loki operand to v3.6.5 () (d81e977)
featureoperator: update metrics authentication to remove dependency on kube-rbac-proxy () (2de6e79)
featureput kotel behind a flag () (f8e2d64)
featurequery-engine: Omit labels with empty values () (5c17103)
featurerefactor frontend cache, add metrics, filter out cached streams () (a63f0c3)
featurerelease 3.7 () (21d5b59)
featureRemove Promtail support (backport k299) () (939d15f)
featurereset the consumption lag gauge after 1 minute of idle period () (f1d0cdf)
+195 more items in the release notesfixCVEs in release 3.7.x () (bb4c5d8)
fixdeps: update module github.com/aws/aws-sdk-go-v2/service/s3 to v1.97.3 [security] (release-3.7.x) () (7bc9450)
fixFix ruler panic related to unset validation scheme (backport release-3.7.x) () (cf65729)
fixstorage: attach SHA-256 checksum on PutObject for Object Lock buckets () (7df13d9)
fixUpgrade Go and gRPC versions on 3.7.x () (2c8fff2)
breakingengine: Make scheduler aware of total compute capacity ()
breakingparsed labels should not override structured metadata ()
breakingengine: Share worker threads across all scheduler connections ()
featureability to send query context for limit enforcement () (1a66d2d)
featureadd downscalePermittedFunc to check downscale is permitted () (c0c27b3)
featureadd gauge to track in-flight bytes () (23ef8ec)
featureadd histogram loki_dataobj_consumer_flush_duration_seconds () (5a5e90e)
featureadd loki health command () (ef69cfd)
featureadd metric to track flush failures () (ed4f27e)
featureAdd new dataobj builder flush criteria () (498656b)
featureAdd partition state to consumption lag metric () (91d4eb6)
featureadd prepare downscale handler () (677b2ec)
featureadd processed records metric () (333da73)
featureadd race tolerance to query-tee () (014520a)
featureAdd resolved policy to blocked and enforced label error () (48d13d1)
featureadd segmentation keys and resolver () (c853f2c)
featureadd support for cancelation to copy and sort () (6a8b879)
featureAdd support for storing chunk deletion markers in object storage instead of local disk () (856c11d)
featureadd support for UpdateRates RPC to distributors () (9018886)
featureAdd UpdateRates RPC, update rates from the frontend, return no-op in the service () (e173cf4)
featurecanary: Support passing arbitrary set of labels to use for the query () (993b3ae)
featurecheck partition state in parallel () (b8536aa)
featureClient side index gateway shuffle sharding () (326c7d1)
featuredataobj-consumer add processed bytes metric () (fba0c5d)
featuredecouple dataobj consumers from the reader service () (c3e909d)
featuredisambiguate metadata for better scans () (66fd9d8)
featuredon't tee unsampled queries () (b975e48)
featureenable racing in the querytee () (23948c4)
featureEnable support for max, min, max_over_time, min_over_time for new engine () (b9a51f0)
featureengine: add regexp parser support for log queries () (5663f9c)
featureengine: delegate metastore queries to engine () (3a74fe7)
featureengine: implement strict and keepEmpty logfmt parsing () (01cab53)
featuregoldfish: add endpoints for serving stored results () (e17ae2d)
featuregoldfish: mv comparison_status to db, add stats endpoint () (c22e05c)
featureHandle state change lock in prepare downscale () (de092da)
featurehelm: nameOverride now passed through helm tpl function. () (7f56fd2)
featurehelm: Add ability to toggle grpclb port for query frontend service () (9c4f022)
featurehelm: Add startupProbe to distributor () (5b76589)
featurehelm: allow configuration of service trafficDistribution parameter () (55f95e3)
featurehelm: allow set topologySpreadConstraints on singleBinary () (265601f)
+226 more items in the release notesfixsecurity: Bump Go to 1.26.10 [SECURITY] (release-3.6.x) () (de41836)
fixdeps: Update dependencies related to otel for 3.6 () (603de5a)
fixsecurity/LOW/: Update module go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc to v1.45.0 [SECURITY] (release-3.6.x) () (3e7c0ed)
fixsecurity/LOW/: Update module go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracehttp to v1.45.0 [SECURITY] (release-3.6.x) () (ad5a87c)
fixsecurity: Bump Go to 1.26.9 [SECURITY] (release-3.6.x) () (c969f5c)
fixsecurity/HIGH/pkg/push: Update module google.golang.org/grpc to v1.83.1 [SECURITY] (release-3.6.x) () (d8d78f6)
fixsecurity/HIGH/pkg/push: Update module google.golang.org/grpc to v1.83.2 [SECURITY] (release-3.6.x) () (6d21d6b)
fixsecurity/HIGH/: Update module google.golang.org/grpc to v1.83.1 [SECURITY] (release-3.6.x) () (ed9df58)
fixsecurity/HIGH/: Update module google.golang.org/grpc to v1.83.2 [SECURITY] (release-3.6.x) () (ee0ef56)
fixsecurity/MEDIUM/: Update module github.com/containerd/containerd/v2 to v2.0.12 [SECURITY] (release-3.6.x) () (7fa1224)
fixsecurity/UNKNOWN/: Update module golang.org/x/crypto to v0.55.0 [SECURITY] (release-3.6.x) () (85b2d4f)
fixsecurity/UNKNOWN/: Update module golang.org/x/crypto to v0.56.0 [SECURITY] (release-3.6.x) () (57bc922)
fixsecurity/UNKNOWN/: Update module golang.org/x/mod to v0.40.0 [SECURITY] (release-3.6.x) () (c08bf30)
featureAdd flag to ignore missing chunks during deletion of logs with line filter [release-3.6.x] () (b87159f)
fixsecurity/UNKNOWN/: Update module go.etcd.io/etcd/client/pkg/v3 to v3.5.33 [SECURITY] (release-3.6.x) () (bf4b367)
fixstorage: Pre-compute SHA-256 to avoid aws-chunked on PutObject [release-3.6.x] () (0a29895)
fixqueryrange: Preserve sketch in MergeLabels [release-3.6.x] () (20087cd)
fixBackport WAL replay hang fix to release-3.6.x () () (355e2f3)
fixci: Backport deb/rpm packaging fix to release-3.6.x () () (d7ee4de)
fixsecurity/UNKNOWN/cmd/chunks-inspect: Update module github.com/klauspost/compress to v1.18.7 [SECURITY] (release-3.6.x) () (a6cc2e5)
fixsecurity/UNKNOWN/cmd/dataobj-inspect: Update module github.com/klauspost/compress to v1.18.7 [SECURITY] (release-3.6.x) () (a71c910)
fixsecurity/UNKNOWN/operator: Update module github.com/klauspost/compress to v1.18.7 [SECURITY] (release-3.6.x) () (59970a9)
fixsecurity/UNKNOWN/: Update module github.com/klauspost/compress to v1.18.7 [SECURITY] (release-3.6.x) () (8308a12)
fixci: Fix zizmor findings for operator-images in Loki 3.6 () (050f742)
fixci: Helm CI warning fix () (4bc2586)
fixsecurity/CRITICAL/clients/cmd/fluentd/docker: Update dependency fluentd to v1.19.3 [SECURITY] (release-3.6.x) () (692f2b1)
securitysecurity/HIGH/: Bump Go to 1.26.5 to address CVE-2026-39822 and CVE-2026-42505 [SECURITY] () (fc478e1)
fixsecurity/HIGH/pkg/push: Update module google.golang.org/grpc to v1.82.1 [SECURITY] (70f75b7)
fixsecurity/HIGH/: Update golang.org/x/net, golang.org/x/text and google.golang.org/grpc [SECURITY] (70f75b7)
fixsecurity/UNKNOWN/cmd/chunks-inspect: Update go toolchain directive to v1.25.12 [SECURITY] (release-3.6.x) () (b327439)
fixsecurity/UNKNOWN/pkg/push: Update module golang.org/x/net to v0.56.0 [SECURITY] (70f75b7)
fixsecurity/UNKNOWN/pkg/push: Update module golang.org/x/text to v0.39.0 [SECURITY] (70f75b7)
fixsecurity/UNKNOWN/: Update module github.com/containerd/containerd/v2 to v2.0.10 [SECURITY] (release-3.6.x) () (697bd83)
fixsecurity: Backport security updates to release-3.6.x () (70f75b7)
fixUpdate objstore to include fix for GCS Exists () (87383d8)
breakingoperator: consolidate image build workflows and improve documentation ()
breakingmove the Loki UI to a Grafana Plugin ()
breakingoperator: CI publishing image strategy ()
featureadd json parsing stage to v2 engine () (aec34ed)
featureadd logfmt parse support to the v2 query engine () (ccb4549)
featureadd loki health command (backport release-3.6.x) () (dfdbe2a)
featureadd p50, p95 and p99 section sizes per tenant () (cb3b74a)
featureadd p50, p95 and p99 sections per tenant to stats () (d256df4)
featureadd rules check for namespace and group () () (7733ab1)
featurebuild multi-tenant data objects () (f60f818)
featurecapture logs drilldown flag in query samples () (cb3f2ad)
featureChange how analytics proxy works () (82d25df)
featurecompactor-hs: add a metric to track the number of jobs left to conclude ongoing unit of work () (9e0f50c)
featuredeletion: return request ID in response header () (6e6e8a9)
featuredrilldown config endpoint () (52b5d95)
featureengine: More aggregations for the new query engine () (1474ede)
featureengine: Prefetch inputs of Merge pipeline concurrently () (f50c87f)
featurefluentd: Add 'compress gzip' setting to fluentd plugin () (1cda925)
featuregoldfish: improve query performance with indexes and paritions () (89509de)
featurehelm: Add startupProbe to memcached () (f799e9b)
featurehelm: Add startupProbe to memcached exporter () (901e574)
featurehelm: add configurable livenessProbe to single binary StatefulSet () (18b8995)
featurehelm: add dnsconfig to all missing resources () (ed68531)
featurehelm: Add health probes to gateway component () (82aa322)
featurehelm: Add health probes to loki in backend () (10441c8)
featurehelm: add more specificity to affinity and topology spread constraints () () (0819e48)
featurehelm: add replicas to loki-canary deployment () (c9d7d76)
featurehelm: add support for custom alert rule annotations () (2df5197)
featurehelm: allow extraObjects as dict () (6a953bb)
featurehelm: Only delete PVC on statefulset deletion, not scaling () (0cead58)
featurehelm: use named ports for memcached services targetports () (6a5be7e)
featureimplement unwrap as a projection () (3ce6fa2)
featureimplement volume-based pattern filtering () (71e2e01)
featurelogcli: add --log.level parameter () (77c18d9)
featureloki-mixin: allow disabling thanos dashboard and fix dashboard's file name () (cadc824)
featuremove the Loki UI to a Grafana Plugin () (3a1e5ad)
featureoperator: Add alert LokiIngesterFlushFailureRateCritical () (66ebc5a)
featureoperator: Add warning alert for when LokiStack is not getting ready () (c47fe46)
featureoperator: deploy network policies with LokiStack () (6e6f61f)
featureoperator: s3 validation reject endpoints that contain a URL path () (f6ef4d8)
+130 more items in the release notesfixCVEs in release 3.6.x () (1fe3b6d)
fixdeps: update module github.com/aws/aws-sdk-go-v2/service/s3 to v1.97.3 [security] (release-3.6.x) () (11c1d07)
fixdeps: update module go.opentelemetry.io/otel/sdk to v1.43.0 [security] (release-3.6.x) () (47fb29e)
fixstorage: attach SHA-256 checksum on PutObject for Object Lock buckets () (2a7c34c)
fixBackporting 19989 into 3.6 () (0f56890)
featureUpgrade go.opentelemetry.io/otel/sdk from v1.38.0 to v1.40.0 () (d1ab148)
featureUpgrade Go to 1.25.8 (release-3.6.x) () (10d2666)
featureUpgrade Go used by querytee/promtail to 3.6 () (41a4e0c)
featureUse different debian version for fluent-bit () (138c391)
fixdeps: update module github.com/buger/jsonparser to v1.1.2 [security] (release-3.6.x) () (3185466)
fixdeps: update module go.opentelemetry.io/otel/sdk to v1.40.0 [security] (release-3.6.x) () (d267ad3)
fixdeps: update module google.golang.org/grpc to v1.79.3 [security] (release-3.6.x) () (87dff41)
fixalloc: set a limit on preallocations (backport release-3.6.x) () (7e1daf3)
fixdeps: update alpine docker tag to v3.23.3 (main) () () (fb20246)
featureadd loki health command (backport release-3.6.x) () (dfdbe2a)
featureUpdate to go 1.25.7 () () (1967a6a)
fixbump go version for 3.6.x () (b06b508)
fixLineFilterLabelFilter.String() regexp correct delimiters (backport release-3.6.x) () (9d5fb5f)
featureadd rules check for namespace and group () () (7733ab1)
fixBackport gzip fix release 3.6.x () (d805266)
fixdeps: [Release 3.6.x] Update dskit to resolve Otel conflict () (fb05a36)
fixDo not override S3 region if already specified in configuration chain (backport release-3.6.x) () (38582ac)
fixFix regression in S3 client configuration (backport release-3.6.x) () (7d8176f)
fixdeps: Loki 3.6.1 CVE updates () (2f85998)
fixdocker: missing permissions to start docker (backport release-3.6.x) () (48b507f)
fixdocker: set WORKDIR to root in loki Dockerfiles () (6040a09)
featureAdd method to get zone-aware partition consumers () (4a733fc)
featureanalytics: Change how analytics proxy works ()
featureAPI: Add endpoint returning tenant configured limits () (6818c90)
featureAPI: Loki Improvement Document (LID) for query splitting () (66f0f0b)
featureci: Add workflow_dispatch for querytee-images workflow ()
featurecompactor: Compactor deletion manifest builder () (47961f8)
featurecompactor HS: Add a dashboard for monitoring deletion with horizontally scalable compactor () (10db8ab)
featurecompactor HS: Add a job runner for processing of deletion jobs ()
featurecompactor HS: Add job queue and deletion job builder () (#17843)
featurecompactor HS: Add jsonnet for deploying horizontally scalable compactor () (5e28950)
featurecompactor HS: Add support for applying storage updates after finishing processing of deletion manifest () (ba3c670)
featurecompactor HS: Add support for worker for processing of jobs from the compactor's job queue () (d05c4bc)
featurecompactor HS: Fixes and changes for getting horizontally scalable compactor to work well () (000f90d)
featurecompactor HS: Refactor interfaces and build a link between delete requests manager and compactor for HS of compactor () (3646607)
featurecompactor HS: Store index updates per processed segment in the manifest to the object storage () (8007e22)
featurecompactor HS: tune compactor worker config and add experimental feature warning to the docs () (5bf3f74)
featurecompactor HS: Use streaming RPCs for interacting with job queue over grpc () (385e317)
featurecompactor HS: Wire things up and add some metrics () (bd29320)
featurecompactor HS: Add a metric to track the number of jobs left to conclude ongoing unit of work ()
featuredataobj executor: project node () (395030b)
featuredataobj, executor: filter node execution () (cf54d50)
featuredata-objects: Add query stats collection to the dataobj readers () (9e68fb0)
featuredata-objects: Add p50, p95 and p99 section sizes per tenant ()
featuredata-objects: Add p50, p95 and p99 sections per tenant to stats ()
featuredata-objects: Add tenant to section builders ()
featuredata-objects: Add tenant to section metadata ()
featuredata-objects: build multi-tenant data objects ()
featuredata-objects: decode tenant when reading streams and logs sections ()
featuredata-objects: print the tenant in the dump and stats sub-commands ()
featuredata-objects: improve dataobj-inspect command () (238e0b7)
featuredata-objects: Initial index-builder implementation () (1f0edcd)
featuredistributor: Add MaxRecvMsgSize config for uncompressed message size limits () (1d99f4d)
featuredistributor: log ingestion policy when log_push_request is set () (0ec787f)
featuredistributor: Mark truncated log lines with identifier () (0ee8e76)
featuredistributor: stop pushing to the metadata topic from distributors () (e0f015c)
featuredistributor: remove tenant topic tee ()
featuredistributor: check for failed reason in distributors () (104c457)
featuredistributor: Add agent IPs to distributor log () (7fc9026)
featuredistributor: Add enforceLimits to ingest_limits.go () (d197cda)
featuredistributor: Add metric to track ingest limits failures in distributor () (7f1a1c7)
+251 more items in the release notesfeatureUpgrade go to 1.25.8 () (3b305e3)
fixalloc: set a limit on preallocations (backport release-3.5.x) () (1906dc2)
featureUpdate to go 1.25.7 () () (dd71399)
fixbuild UI deps () (6d1e9ea)
featureChange how analytics proxy works (backport release-3.5.x) () (5a9d3fd)
fixdeps: Bump x/crypto module () (b21123b)
fixdeps: Update go version to 1.24.11 () (79d8922)
fixlogger: correct log level verbosity in rule evaluation () (backport release-3.5.x) () (562d87d)
fixbump go version () (cf33543)
fixbuild: rpm signature config () () (d5b382b)
fixbuild: update loki build image () () (c70476a)
securitydeps: remove CVE GHSA-2464-8j7c-4cjm () (f2a304a)
fixdeps: update module github.com/twmb/franz-go/plugin/kprom to v1.2.1 (release-3.5.x) () (bb7356c)
fixrelease-3.5.x: bump Go version to 1.24.8 () () (1b8b5dd)
fixrelease-3.5.x: backport fix to correctly calculate entry metadata size () (5aa8bd2)
fixdocs: added instructions for how to upgrade zone-aware ingesters… () (e0de7da)
fixUpgrade go version 1.24.6 in release-3.5.x () (ce8d705)
fixdeps: Move to Go 1.24.5 () (2aa4680)
fixHandle WAL corruption properly on startup (backport release-3.5.x) () (5b8ee9a)
fixci: Update release code 3.5 () (b1b28b0)
fixdeps: Move to Go 1.24.2 (backport release-3.5.x) () (d0fbad0)
fixfrontend: allow resolution of v6 addresses. (backport release-3.5.x) () (aed4610)
fixHandle WAL corruption properly on startup (backport release-3.5.x) () (5b8ee9a)
fixjsonparser: Fix possible JSON log line corruption caused by json parser on query path (backport release-3.5.x) () (546d456)
fixmemberlist: allow resolution of advertise address from v6 interf… (backport release-3.5.x) () (6f878ad)
featureprepare Loki 3.5 release (22a5221)
fixbuild: Bump loki-build-image for docker-driver (backport release-3.5.x) () (d4e637c)
breakingoperator: Add configuration option for dropping OTLP attributes ()
breakingksonnet: clean-up deprecated configs ()
featureAccount for policy when reporting seen resource and metadata labels () (9a356a1)
featureadd a config option for custom GCS endpoints () (f1ebd97)
featureadd dry-run mode for checking limits in distributors () (d6c499b)
featureadd limits package () (127b609)
featureadd limits/frontend pkg () (0cbaa46)
featureAdd PartitionManager and move this out of ingest_limits.go () (8a0cc0f)
featureadd S3 chunk delimiter config to support MinIO running on Windows () (8429b0f)
featureAdd support for blocking a policy to be ingested () (69089ef)
featureadd support for using sqlite for storing delete requests () (5b33e65)
featureAssert for bad max_query_lookback config () (073c94c)
featuredataob: Implement SelectSamples () (13a6c33)
featuredataobj-explorer: Add stream distribution info to dataobj explorer UI () (4befd22)
featuredataobj-querier: Fixes streams section sharding & instrumentation () (543ad8e)
featuredataobj/querier: Add logging and improve stream processing metrics () (49bcaf4)
featuredataobj: Add methods for querying data objects metadata () (4bc95c0)
featuredataobj: cardinality estimation () (66889ec)
featuredataobj: Ensure constant sharding for the dataobj querier () (78a141c)
featuredataobj: expose cardinality estimations in UI () (7d9414d)
featuredataobj: Implement SelectLogs using a topk min-heap () (8f69f0d)
featuredataobj: tenant partition consumer () (4399775)
featureDistributed Operational UI () (dbf2bef)
featuredistributor: Add simulated latency () (7119f6e)
featureDo not enforce labels vs agg metric stream () (25c0620)
featureenforce limits in distributors () (bc2111e)
featurehelm global values updates () (e5f31b3)
featureHelm: Add extraContainers to backend pods () (528a1c6), closes
featurehelm: Add tpl() support back to read, write and backend pods () (af05c38)
featurehelm: Allow provisioner to be namespaced () (af85ecf)
featurehelm: Optionally add the operational UI () (197265b)
featureingest-limits: Implement global tenant rate limiting () (3a3df62)
featureIntroduce policy to received_bytes () (affedaf)
featureIntroduce policy stream mapping () (5c8e832)
featurekafka: tenant topics () (c258419)
featureksonnet: Add no_schedule_constraints option to distributors () (9e9a09d)
featurelambda-promtail: Improve relabel configuration parsing and testing () (2587f34)
featurelogical planning: Planner playground () (89f0ed7)
featurelogql: Add LogQL Benchmark Suite () (1b57297)
deprecatedksonnet: clean-up deprecated configs () (76183fa)
+232 more items in the release notesfixrelease-3.4.x: upgrade go minor version () (2b7b94f)
featureadd a config option for custom GCS endpoints () () (b2c87ba)
fixfrontend: allow resolution of v6 addresses. (backport release-3.4.x) () (93e0880)
fixHandle WAL corruption properly on startup (backport release-3.4.x) () (1ecc9e4)
fixmemberlist: allow resolution of advertise address from v6 interf… (backport release-3.4.x) () (640cd33)
featureLID for query splitting (backport release-3.4.x) () (2cb5ad7)
fixci: Update release code 3.4 () (4108c5d)
fixdeps: Move to Go 1.23.8 () (2e18686)
fixdeps: update module golang.org/x/net to v0.38.0 [security] (release-3.4.x) () (57cd6ce)
fixdocs: Update configuration.md (backport release-3.4.x) () (cc8db57)
fixdeps: Move to Go 1.23.7 () (5de86f1)
fixdeps: update jwt, oauth and go-redis dependencies () (e038d0f)
fixdeps: update module golang.org/x/crypto to v0.35.0 [security] (release-3.4.x) () (184fe1a)
fixdeps: update module golang.org/x/oauth2 to v0.27.0 [security] (release-3.4.x) () (bead91e)
fixdocs: add a note on docker configuration.md doc to explain accep… (backport release-3.4.x) () (c39780d)
fixblooms: Initialize bloom gateway client only once (backport release-3.4.x) () (1b9829b)
fixci: do not disable CGO in Makefile (backport release-3.4.x) () (4fa045d)
fixbuild info in docker images () (4484080)
breakingRemove wget from Promtail docker image ()
featureAdd a metric ingestion time SM sanitization () (e9d0c3e)
featureadd kafka development environment () (226e9f1)
featureadd lines skipped metric to pattern ingesters () (dea5d78)
featureAdd objstore support for Swift using thanos.io/objstore () (44523e0)
featureadd opt-in support for ProxyFroomEnvironment in logcli () () (c56b95d)
featureAdd otlp attribute deployment.environment.name to list of default labels () (2d407bd)
featureadd per-tenant time sharding for long out-of-order ingestion () (0d6d68d)
featureadd phase to log lines in kafka_consumer.go () (0a12cab)
featureAdd Rule Name and Type to Query Tags () (b272573)
featureAdd TLS config to the analytics client () (2c5eabd)
featureadded support for overrides exporter () (db72164)
featureapi: Support Parquet as a query response format. () (d0c11a6)
featureBlock scheduler scaffolding () (a10140d)
featureblock-scheduler: adds service and basic planner support for scheduler () (ad322c0)
featureblock-scheduler: introduce job lease and requeue expired jobs () (558080c)
featureblock-scheduler: job tracking & offset commits () (f2bff77)
featureblock-scheduler: status page shows completed jobs () (10194f7)
featureblockbuilder component () (cbdd36a)
featureblockbuilder: consolidate on record counting planner () (532bdbc)
featureblockbuilder: grpc transport () (339ba1a)
featureblockbuilder: priority queue for job dispatching () (0981273)
featureblooms: Add task timining and sizing metrics () (79cccfd)
featureblooms: Apply task timeout in bloom builder () (f92dde0)
featureblooms: disk-backed queue for the bloom-planner () (b646861)
featureblooms: Prefetch bloom blocks as soon as they are built () (b406015)
featurebuild the Docker Driver for arm64 () (e950251)
featureDetect fields based on per-tenant configuration and put them into structured metadata at ingest time () (7033091)
featureexpose topologySpreadConstraints for admin-api pods () (1b93086)
featureexpose topologySpreadConstraints for distributed deployment () (d075107)
featurehelm: Compute ConfigMap/Secret checksum only over .data content () (990f71c)
featurehelm: Do not explicitly template managed-by, as it should be set at install time by the installation manager. () (10b7478)
featureIntroduce shardable probabilistic topk for instant queries. () (7b53f20)
featurelambda-promtail: add relabeling support for log entries () (c41a8b4)
featurelambda-promtail: Add terraform variable for s3 bucket notification filter prefix () (3dd8d7d)
featureline_format bypass template execution if possible () (2150fbc)
featurelogcli: Include common labels () (639ac74)
featureloki/docker compose: enable feature toggle () (8f243ee)
featureoperator: Add support for managed GCP WorkloadIdentity () (7635a5c)
breakingRemove wget from Promtail docker image () (2eea546)
+225 more items in the release notesfixdeps: Move to Go 1.23.7 () (f6c6474)
fixdeps: update jwt and oauth2 dependencies for 3.3.x () (241f5aa)
fixdeps: update module golang.org/x/crypto to v0.35.0 [security] (release-3.3.x) () (454cad2)
fixdeps: update module golang.org/x/oauth2 to v0.27.0 [security] (release-3.3.x) () (7b35a41)
fixdocs: add a note on docker configuration.md doc to explain accep… () (0102107)
fixbuild: update build info 3 3 x () (4672625)
fixci: Provide correct build info for release builds () () (e5f80d3)
fixci: Revert "fixed Publish Rendered Helm Chart Diff workflow" () (09d1085)
fixcorrect typo in architecture name (amr64 -> arm64) (backport release-3.3.x) () (9acdc33)
fixdeps: CVE updates for Loki 3.3.2 () (01a7a0d)
featurepresent DF bytes values in queryable format (backport release-3.3.x) () (218ecbb)
fixdeps: backport update module golang.org/x/crypto to v0.31.0 () (57a7a2c)
fixenable metric aggregation in loki-local-config.yaml (backport release-3.3.x) () (635f04d)
fixfix the docker driver build (backport release-3.3.x) () (23b5fc2)
breakingpromtail: Remove wget from Promtail docker image (backport release-3.3.x) ()
securitypromtail: Switch Promtail base image from Debian to Ubuntu to fix critical security issues (https://github.com/grafana/loki/issues/15195).
otherdocker: Move from base-nossl to static. This PR removes the inclusion of glibc into most of the Docker images created by the Loki build system. ().
breakingblooms: Introduce a new block schema (V3) ()
breakingblooms: Index structured metadata into blooms ()
featureability to log stream selectors before service name detection () (d7ff426)
featureadd app_name as a service label () (f2a16f4)
featureadd backoff mechanism to the retention process () (3136880)
featureadd functions to common.libsonnet for warpstream () (2bde071)
featureadd gauge loki_ingest_storage_reader_phase () (f5b0fb6)
featureadd gauge to track the partition_id () (a142b3d)
featureadd missing cluster label to mixins () (547ca70)
featureadd query user and query source to "executing query" log lines () (4d69929)
featureadd retries for s3 ObjectExists calls () (73cbbb0)
featureadd structured metadata to the promtail push API () (66cffcb)
featureAdd support for partition ingester in dashboards () (70deebf)
featureAllows to configure client_max_body_size () (809a024)
featureApply patterns line length limit to json message key () (41fafd8)
featureblooms: Add bloom planner and bloom builder to backend target () (bf60455)
featureblooms: disk-backed queue for the bloom-planner (backport k227) () (1f6828b)
featureblooms: Index structured metadata into blooms () (a2fbaa8)
featureblooms: Only write key and key=value to blooms () (3af0004)
featureConfigurable list of json fields to mine patterns () (7050897)
featuredetected field values () (7983f94)
featuredistributors: Use a pool of worker to push to ingesters. () (f80d68a)
featureDo not add empty blooms to offsets () (51c42e8)
featureExtract task computing into a strategy interface () (ab5e6ea)
featurefluentd-plugin-datadog-loki: support custom http headers () (e59035e)
featurehelm: :sparkles: add additional service annotations for components in distributed mode () (5978f13)
featurehelm: add configurable extraEnvFrom to admin-api and enterprisegw () (5d78a3a)
featurehelm: Add kubeVersionOverride for Helm chart () (0935d77)
featurehelm: Add persistence option to memcached on Helm chart () (ef1df0e)
featurehelm: add tolerations to pattern-ingester statefulset () (09530c0)
featurehelm: Allow setting node attributes to tokengen and provisioner () (c708ae6)
featurehelm: Replace bloom compactor with bloom planner and builder () (08e61ca)
featurehelm: update chart with loki version 3.2.0 () (11b92ee)
featureHelm: Update Loki Helm chart for restricted environments () (adc7538)
featureimplement IsRetryableErr for S3ObjectClient () (fc90a63)
featureImplement owned streams calculation using Partition Ring () (3c36ba9)
featureImplement WAL segment ingestion via Kafka with partition ring () (d178f4c)
featureImprove pattern ingester tracing () (80aec25)
featureingester: implement partition shuffle sharding for ingester () (1a4436c)
featureIntroduce new ObjectExistsWithSize API to () (ac422b3)
+147 more items in the release notesbreakingpromtail: Remove wget from Promtail docker image (backport release-3.2.x) ()
fixlogql: Updated JSONExpressionParser not to unescape extracted values if it is JSON object. ().
fixstorage: Have GetObject check for canceled context. S3ObjectClient.GetObject incorrectly returned nil, 0, nil when the provided context is already canceled ().
securitypromtail: Switch Promtail base image from Debian to Ubuntu to fix critical security issues ().
otherdocker: Move from base-nossl to static. This PR removes the inclusion of glibc into most of the Docker images created by the Loki build system. ().
fixconfig: Copy Alibaba and IBM object storage configuration from common () (32a9bc0)
fixlogql: updated JSONExpressionParser not to unescape extracted values if it is JSON object. (backport release-3.2.x) () (e9bbaf3)
fixRevert build image to Debian Bullseye to fix libc version issue in Promtail () (1e913df)
fixstorage/chunk/client/aws: have GetObject check for canceled context (backport release-3.2.x) () (1b7dd95)
breakingapi: Fail log queries when executed on instant query endpoint ()
breakingjsonnet: convert read statefulset into deployment for loki-simple-scalable ()
breakingblooms: Remove bloom compactor component ()
featureability to ignore cache for volume queries () (b1dc076)
featureadd _extracted suffix to detected fields conflicts () (ab1caea)
featureAdd baseline rf1 querier implementation () (3a99b69)
featureAdd CLI to inspect RF=1 WAL segments () (150e653)
featureAdd initial support for a kafka-based ingest path () (33c26f4)
featureadd loki_ingester_rf1_segment_age_seconds metric () (2dfc13b)
featureAdd metrics for Ingester RF-1 () (d4179aa)
featureAdd metrics to WAL Manager () (bfe97d7)
featureAdd settings for cpu/mutex/block profiling options () (f06eabb)
featureadd structured metadata to the promtail push API () () (c118fc6)
featureAdded getting started video for ingesting Otel logs () (5e560f9)
featureaggregate byte and count metrics () (913e9f9)
featureapi: Fail log queries when executed on instant query endpoint () (ce71f1c)
featureblooms: Add series & chunks per block metrics () (55c6499)
featureBootstrap metastore for wal segments () (0b47498)
featureCalculate the age of a WAL segment () (4abb5a4)
featurechunks-inspect: support structured metadata () (1834065)
featurecollect and serve pre-aggregated bytes and counts () (467eb1b)
featureCollect duplicate log line metrics () (40ee766)
featureconvert WalSegmentWriter to io.ReadSeeker () (19c0509)
featuredetected-labels: remove cardinality filter () (4f534d7)
featuredownsample aggregated metrics () (2c053ee)
featureDrain uses different tokenizer based on log format () (bc01e6f)
featureexclude and from creating new tokens in patterns () (8c8454b)
featureexclude in pattern tokens () (e612dd3)
featureexporter: include boolean values in limit exporter () (4220737)
featureflush not owned streams () (2ca1ac6)
featurehelm: Make gateway container port configurable. () (05176e4)
featurehelm: Support alibabacloud oss in helm chart () (3ebab6f)
featureIgnore empty streams in distributor if all entries fail validation () (6c4b062)
featureImplement GetObjectRange for all storage providers () (d9c441e)
featureimprove Owned Streams feature observability () (ce86459)
featureimprove placeholder replacement of byte sizes () (ac284ca)
featureIngester RF-1 () (7f35179)
featureIngester Stream Limit Improvements () (ec34aaa)
featureingester: Smooth out chunk flush operations () (82fbb2f)
breakingblooms: Remove bloom compactor component () (b75eacc)
+167 more items in the release notesfixconfig: Copy Alibaba and IBM object storage configuration from common () (7184d45)
fixlogql: updated JSONExpressionParser not to unescape extracted values if it is JSON object. (backport release-3.1.x) () (759f9c8)
fixloki/production/docker-compose: upgrade loki and grafana production image tags to 3.1.1 () (36fe29e)
fixRevert build image to Debian Bullseye to fix libc version issue in Promtail () (05b6a65)
fixstorage/chunk/client/aws: have GetObject check for canceled context (backport release-3.1.x) () (f3d69ff)
featureloki: add ability to disable AWS S3 dual stack endpoints usage () (464ac73)
fixdeps: bumped dependencies versions to resolve CVEs () (34206cd)
breakingupdate helm chart to support distributed mode and 3.0 ()
featureAdd a version of the mixin dashboards for meta monitoring () (ec1a057)
featureAdd backoff to flush op () (9767807)
featureadd detected-fields command to logcli () (210ea93)
featureAdd ingester_chunks_flush_failures_total () (cc3694e)
featureadd lokitool () (7b7d3d4)
featureAdd metrics for number of patterns detected & evicted () (bc53b33)
featureAdd new Drain tokenizer that splits on most punctuation () (6a0fdd0)
featureAdd pattern ingester support in SSD mode () (19bfef4)
featureadd profile tagging to ingester () (00d3c7a)
featureadd recalculateOwnedStreams to check stream ownership if the ring is changed () (e7689b2)
featureAdd step param to Patterns Query API () (7b8533e)
featureAdd tokenizer interface for Drain Training () (797bb64)
featureadd toleration for bloom components () (fcb2b0a)
featureAdd utf8 support to Pattern Lexer to support utf8 chars () (f6f8bab)
featureadd warnings to metadata context directly () (c4ac8cc)
featureAdded getting started video () (8442dca)
featureAdded Interactive Sandbox to Quickstart tutorial () (97212ea)
featureAdded video and updated Grafana Agent -> Alloy () (1432a3e)
featureAPI: Expose optional label matcher for label names API () (8084259)
featurearea/promtail: Added support to install wget on promtail docker image to support docker healthcheck () (ffe684c)
featureblooms: Add counter metric for blocks that are not available at query time () (d6374bc)
featureblooms: Add in-memory LRU cache for meta files () (fcd544c)
featureblooms: Blooms/v2 encoding multipart series () (fbe7c55)
featureblooms: compute chunks once () (bc78d13)
featureblooms: ignore individual bloom-gw failures () (4c9b22f)
featureblooms: ingester aware bounded impl () (7bbd8b5)
featurebloom: Skip attempts to filter chunks for which blooms have not been built () (a1b1eeb)
featureblooms: limit bloom size during creation () (eac5622)
featureblooms: record time spent resolving shards () (9c25985)
featureblooms: Separate page buffer pools for series pages and bloom pages () (75ccf21)
featureBoilerplate for new bloom build planner and worker components. () (8978ecf)
featurecache: Add Cache-Control: no-cache support for Loki instant queries. () (88e545f)
featurecanary: Add test to check query results with and without cache. () (71507a2)
featureDetected labels from store () (587a6d2)
featuredetected-labels: include labels with cardinality > 1 () (8be8364)
featuredetectedFields: add parser to response () (2b3ae48)
featuredetectedFields: Support multiple parsers to be returned for a single field () (19fef93)
featureEnable log volume endpoint by default () (397aa56)
featureEnable log volume endpoint by default in helm () (e39677f)
+129 more items in the release notesfixdeps: bumped dependencies versions to resolve CVEs () (e13011d)
fixFix nil pointer dereference in bloomstore initialisation () (167b468), closes
featureQuery acceleration with Bloom filters (experimental): This is designed to speed up filter queries, with best results for queries that are looking for a specific text string like an error message or UUID.
featureNative OTel Support: A simplified ingestion pipeline (Loki Exporter no longer needed) and a more intuitive query experience for OTel logs.
featureHelm charts: A major upgrade to the Loki helm chart introduces support for Distributed mode (microservices), includes memcached by default, and includes several updates to configurations to improve Loki operations.
featureLambda/Promtail: support dropping labels () (ec54c72).
featureDocs improvements: All the Getting Started topics have been revised, including a new Quickstart to help new users get up and running with Loki faster.The Storage, Configuration Reference, and API documentation have been updated to reflect deprecated and removed code, configuration options, and API…
deprecatedDeprecated storage options including the deprecation of the BoltDB store.
deprecatedDeprecated configuration options.
deprecatedAPI endpoint deprecations.
fixAll lifecycler cfgs ref a valid IPv6 addr and port combination () (6385b19)
fixdeps: update github.com/c2h5oh/datasize digest to 859f65c (main) () (c66ffd1)
fixdeps: update github.com/docker/go-plugins-helpers digest to 6eecb7b (main) () (fb9c496)
fixdeps: update github.com/grafana/gomemcache digest to 6947259 (main) () (2327789)
fixdeps: update github.com/grafana/loki/pkg/push digest to 583aa28 (main) () (02d9418)
fixdeps: update github.com/grafana/loki/pkg/push digest to cfc4f0e (main) () (d27c4d2)
fixdeps: update github.com/grafana/loki/pkg/push digest to e523809 (main) () (09cb9ae)
fixdeps: update github.com/joncrlsn/dque digest to c2ef48c (main) () (1fe4885)
fixdeps: update module google.golang.org/grpc [security] (main) () (0695424)
fixhelm: bump nginx-unprivilege to fix CVE () (dbf7dd4)
fixParse JSON String arrays properly so string elements can be retrieved: PR #11921]
fixpromtail: correctly parse list of drop stage sources from YAML () (f51ee84)
fixpromtail: prevent panic due to duplicate metric registration after reloaded () (47e2c58)
fixrespect query matcher in ingester when getting label values () (85e2e52)
fixSidecar configuration for Backend () (c29ba97)
fixtools/lambda-promtail: Do not evaluate empty string for drop_labels () (94169a0)
fixbump alpine version () (ffcd570)
fixbackport wal corruption fix to 2.9.x () (77fc888)
fixupgrade go and alpine versions () (be0ac95)
fixci: Pull in latest 2.9-specific release code () (7b805ba)
fixdeps: update module golang.org/x/net to v0.38.0 [security] (release-2.9.x) () (6297508)
featureUpgrade golang.org/x/oauth2 to 0.27.0 () (fb70d03)
fixFix Loki CVEs for 2.9 () (5faccce)
fixRemove remaining replaces to fix CVEs for 2.9.x () (26fcedb)
fixUpgrade docker/docker used by 2.9.x () (914adec)
fixUpgrade k8s.io/api used by Loki 2.9.x () (0da39f4)
fixUpgrade packages used by docker/docker for 2.9.x () (2c8da3d)
fixdeps: Loki 2.9.x Bump Alpine and Go versions () (f2deeb7)
fixdeps: CVE updates for Loki 2.9.11 () (8447402)
fixstorage: Fix bug in cache of the index object client().
otherpromtail switch promtails base image from debian to ubuntu (backport release-2.9.x) () (ae1fb5a)
otherdocker: Update Docker to 23.0.15 (#).
otherlamba-promtail: Lamba-promtail updates, some of which address CVEs().
fixUpdate dependencies versions to remove CVE () (567bef2)
featureIngester: Add ingester_chunks_flush_failures_total 12925
featureIngester: Add backoff to flush op 13140
fixdeps: update module golang.org/x/net to v0.23.0 [security] (release-2.9.x) () (94e0029)
fixTrigger release-please for 2.9.7 () (55b747c)
fixBump go to 1.21.9 and build image to 0.33.1 () (efc4d2f)
fixpromtail failures connecting to local loki installation [release-2.9.x] () (8585e35)
fixrelease-2.9.x: frontend: Use net.JoinHostPort to support IPv6 addresses () () (7def3b4)
fixupdate google.golang.org/protobuf to v1.33.0 () () (3186520)
featureadd release please config () () (e628f5d), closes
fixaction repo reference () (fb02797)
fixbump base images and go deps to address CVEs () (eee3598)
fixFixed a couple of data races that can cause panics due to concurrent read-write access of tenant configs.
fixFixed a bug in the log results cache.
fixFixed the cache to atomically check background cache size limit correctly.
fixFixed the discrepancy between the semantics of logs and metrics queries.
fixFixed promtail default scrape config causing CPU and memory load
otherUpdate golang.org/x/crypto to v0.18.0
securityUpgrade otelhttp from 0.40.0 -> 0.44.0 and base alpine image from 3.18.3 -> 3.18.5 to fix a few CVES (CVE-2023-45142, CVE-2022-21698, CVE-2023-5363).
fixFix querying ingester for label values with a matcher (previously didn't respect the matcher).
otherEnsure all lifecycler cfgs ref a valid IPv6 addr and port combination
securityPatches CVE-2023-39325 / CVE-2023-44487 by upgrading go to v1.21.3, golang.org/x/net to v0.17.0 and grpc-go to v1.56.3.
securityUpdated all Docker base images to Alpine 3.18.3 to mitigate CVE-2022-48174 (#10573 )
fixFix a race condition in the table cache of the indexshipper (#10586 )
fixFix a bug in the cache of the object storage client of the indexshipper that could manifest in missing results when querying logs older than what is kept on the ingester. (#10585 )
otherQuery Language Improvements: Several improvements to the query language that speed up line parsing and regex matching.
otherRemote rule evaluation: Rule evaluation can now be handled by queriers to improve speed.
otherMulti-store Index support: Loki now supports reading/writing indexes to multiple object stores which enables the use of different storage buckets across periods for storing index.
featureNew volume and volume_range endpoints: Two new endoints, index/volume and index/volume_range, have been added to Loki. They return aggregate volume information from the TSDB index for all streams matching a provided stream selector.
featureNew Storage Client: Add support for IBM cloud object storage as storage client.
otherBlock queries by hash: Queries can now be blocked by a query hash.
otherlogfmt stage improvements: logfmt parser now performs non-strict parsing by default which helps scan semi-structured log lines
fixupdate google.golang.org/protobuf to v1.33.0 () (3c05724)
fiximage tag from env and pin release to v1.11.5 () (8e11cd7)
fixbump alpine base image and go to fix CVEs () (196650e)
fixFixed a couple of data races that can cause panics due to concurrent read-write access of tenant configs.
fixFixed a bug in the log results cache.
fixFixed the cache to atomically check background cache size limit correctly.
otherUpdate golang.org/x/crypto to v0.18.0
securityPatches CVE-2023-39325 / CVE-2023-44487 by upgrading go to v1.20.10, golang.org/x/net to v0.17.0 and grpc-go to v1.56.3
securityUpdated all Docker base images to Alpine 3.18.3 to mitigate CVE-2022-48174 (#10573 )
securityFix CVE-2023-1255, CVE-2023-2650, CVE-2023-2975, CVE-2023-3446, and CVE-2023-3817
otherUpgrade base alpine image used in loki image to 3.18.2
otherUpgrade go version to 1.20.6
otherQuerier: configurable chunk cache writeback queue bytes size
fixQuery-scheduler: fix query distribution in SSD mode
fixFix duplicate label values from ingester streams.
otherBreak on iterate journal failure
otherPrevent logging errors on normal shutdown
securityUpgrade to go 1.20.4 to address security vulnerabilities in the previous go version.
featurePromtail: Add new decompression configuration to customize the decompressor behavior.
fixFix bug that was dropping index if period is a zero value.
fixFix redis client to prevent it from incorrectly choosing cluster mode with local address.
securityUpdate go to 1.20.3 to address security vulnerabilities in the previous go version.
securityUpdate alpine image to 3.16.5 to address security vulnerabilities in the previous version.
fixPromtail: Fix journald support in amd64 binary build.
featureTSDB index no longer experimental After extensive testing of the new TSDB index in our Grafana Cloud Logs offering, we can safely announce that it is no longer experimental and encourage all Loki deployments to use it!
otherQuery blocker Queries can now be blocked in the Querier/Ruler via a per-tenant runtime configuration.
featureNew backend target A new, third target was added to Loki's scalable configuration, which is the default configuration used in the Loki helm chart. This allows Loki to be run as 3 targets (read, write, and backend) and makes the read target stateless and therefore able to be run as a Kubernetes…
securityFix CVE-2023-1255, CVE-2023-2650, CVE-2023-2975, CVE-2023-3446, CVE-2023-3817, and CVE-2022-41721
otherUpgrade base alpine image used in loki image to 3.18.2
otherUpgrade go version to 1.20.6
otherPrevent redis client from incorrectly choosing cluster mode with local address
otherExpose optional label matcher for label values handler
fixFlush buffered logger on exit: this makes sure logs are printed if Loki crashes on startup.
otherGo version upgraded to 1.20.1
fixFixed different streams for cri tags ending on the same stream.
fixFixed the userdata field (from Windows Event Log) being scraped incorrectly.
fixFixed vector() function producing wrong timestamp.
fixFixed behavior for overlapping chunks with multiple stores.
fixFixed logs results caching causing query-frontend to return logs outside of query window.
fixFixed panics when:
other/scheduler/ring endpoint is requested with scheduler ring disabled.
otherLogQL clones a specific query.
otherPromtail deals with invalid calls to Details().
fixFixed a bug in compactor that caused divide-by-zero panics when startTime and endTime of a delete request were equal.
fixFixed the output of the --version command that showed an incorrect version information.
fixFixed bug in validation of pattern and regexp parsers where missing or empty parameters for these parsers caused panics.
fixFixed bugs in processing delete requests with line filters:
fixWhole chunks covered by delete requests with a line filter were incorrectly skipped.
fixChunks partially covered by delete requests with a line filter were not properly processed. The part that was not covered by the delete request was rewritten with a line filter, while the part that was covered by the delete request was completely deleted.
fixFixed bug in multi-tenant querying that caused HTTP 400 responses when multiple tenants where used in X-Scope-OrgID header like so tenant-a|tenant-b.
fixUpgraded Go build version and Docker container base images to 1.19.5 to mitigate GO-2022-1144 vulnerability.
fixAdd single compactor http client for delete and gennumber clients. This fixes a bug caused by the accidental introduction of different HTTP clients for compactor and gennumber operations that resulted in 404s when only the gennumber middlewares were enabled: ■ Unordered list style [Expected: dash;…
fixChange default deletion mode to filter-only on account of the bug (see below).
otherDelete can now be performed over GRPC.
featureNew Internal Server and TLS TLS can now be configured everywhere and there is an internal server to allow ring, memberlist, and readiness handlers to continue to work without TLS.
featureBetter Support for Azure Blob Storage thanks to the ability to use Azure's Service Principal Credentials.
otherLogs can now be pushed from the Loki canary so you don't have to rely on a scraping service to use the canary.
otherAdditional label_format fields timestamp and line.
featureNew embedded cache which is an in-process cache system that runs loki without the need for an external cache (like memcached, redis, etc).
featureNew HTTP endpoint for Ingester shutdown that will also delete the ring token.
featureFaster label queries thanks to new parallization.
featureIntroducing Stream Sharding an experimental new feature to help deal with very large streams.
featuresupport for max stream limit
otherconfig reload endpoint / signal
othercompressed file support
otherlambda-promtail now supports Kinesis data stream events
othermatches for the journal reader
otherbasic tracing support
featurePR 6658 JordanRushing: Updated the versions of dskit and memberlist to allow configuring cluster labels for memberlist. Cluster labels prevent mixing the members between two consistent hash rings of separate applications that are run on the same Kubernetes cluster.
fixPR 6681 MasslessParticle Fixed an HTTP connection leak between the querier and the compactor when the log entry deletion feature is enabled.
otherPR 6583 MasslessParticle Fixed noisy error messages when the log entry deletion feature is disabled for a tenant
featureQuery multiple tenants at once. We've introduced cross-tenant query federation, which allows you to issue one query to multiple tenants and get a single, consolidated result. This is great for scenarios where you need a global view of logs within your multi-tenant cluster. For more information on…
featureFilter out and delete certain log lines from query results. This is particularly useful in cases where users may accidentally write sensitive information to Loki that they do not want exposed. Users craft a LogQL query that selects the specific lines they're interested in, and then can choose to…
featureImproved query performance on instant queries. Loki now splits instant queries with a large time range (for example, sum(rate({app="foo"}[6h]))) into several smaller sub-queries and executes them in parallel. Users don't need to take any action to enjoy this performance improvement; however, they…
featureSupport Baidu AI Cloud as a storage backend. Loki users can now use Baidu Object Storage (BOS) as their storage backend. See bos_storage_config for details.
fixPR 6152 Fixed a scenario where live tailing of logs could cause unbounded ingester memory growth.
fixPR 5685 Fixed a bug in Loki's push request parser that allowed users to send arbitrary non-string data as a log line. We now test that the pushed values are valid strings and return an error if values are not valid strings.
fixPR 5799 Fixed incorrect deduplication logic for cases where multiple log entries with the same timestamp exist.
fixPR 5888 Fixed a bug in the common configuration where the instance_interface_names setting was getting overwritten by the default ring configuration.
featureThanks to @bboreham for taking a deep dive on the Go regexp library, and for creating a fork which greatly improves the performance of common regex uses cases in Loki.
featureBinary operations are now significantly faster, taking full advantage of Loki's parallelism.
featureA new schema is available, which uses more path prefixes to avoid rate limits on S3.
featureThat same schema change was also added to the filesystem store, which avoids using one directory to store every chunk.
featureA new capability for hedging requests to storage improves performance on highly parallelized queries. Refer to the hedging configuration block for more information.
featurePromtail has several new ways to ingest logs:
featureThe ability to do service discovery and tailing directly from the Docker daemon.
featureFetching logs directly from Cloudflare.
featureReceiving logs directly in Graylog Extended Log Format (GELF).
featurePromtail permits client-side global rate limiting and pipeline-configurable rate limiting.
fixQuery correctness:
fixPR 5474 cyriltovena: Disable sharding of count/avg when labels are mutated
fixPR 5444 cyriltovena: Do not insert missing point when sharding
fixPR 5423 cyriltovena: Correctly sets hash value for headblock iterator
fixPR 5289 cyriltovena: Fixes log deduplication when mutating Labels using LogQL
fixPR 5006 sandeepsukhani: Fix splitting of queries when step is larger than split interval
fixPR 5413 owen-d: A deadlock in the Azure blob client
fixPR 5334 kavirajk: A fix in live tailing that could lead to exploding memory usage
fixPR 5144 owen-d: A fix for the ruler when trying to use Basic Auth for remote write
fixQuery cancellation:
fixPR 5113 kavirajk: Fix cancel issue between query-frontend and query scheduler
fixPR 5080 kavirajk: Handle context cancellation in some of the querier downstream requests
fixPR 5075 cyriltovena: Fixes a possible cancellation issue in the frontend
fixPR 4741 sandeepsukhani: An issue where retention didn't cleanup the index completely
fixPR 4968 trevorwhitney: Fixes a bug in which querying ingesters wrongly returns a ruler, causing the internal server error code = Unimplemented.
fixPR 4875 trevorwhitney: Honor the replication factor specified in the common configuration block when memberlist is the consistent hash ring store.
fixPR 4792 AndreZiviani: Corrects the default values of configuration options in the documentation for:
fixscheduler_dns_lookup_period
fixmin_ready_duration
fixfinal_sleep
fixmax_transfer_retries
fixchunk_retain_period
fixchunk_target_size
fixbatch_size
fixtimeout (for Redis requests)
fixPR 4687 owen-d: Fixes a compactor panic when not using a tenant overrides file.
fixPR 4681 slim-bean: Fixes an incorrect initialization of the read target resulting in query gaps after a chunk is flushed and before the querier would download new index tables.
otherMaking it easier than ever to get your logs into Loki.
otherMaking it easier to run and operate, anyone not using Kubernetes or allergic to microservices should pay close attention, this release has a lot for you.
featureLoki no longer requires logs to be sent in perfect chronological order. Support for out of order logs is one of the most highly requested features for Loki and in 2.4 the strict ordering constraint has been removed.
featureScaling Loki is now much easier with a hybrid mode between a single binary and microservices we are calling the Simple Scalable Deployment. It’s now possible to scale Loki with new read and write targets. Where previously you would have needed Kubernetes and the microservices approach to start…
featureWe introduced a common config section and updated and updated a lot of defaults. This results in a 70% smaller Loki config and comes out of the box with more appropriate defaults and limits. Check out the example local config as the new reference for running Loki.
featureRecording rules are no longer marked experimental and have a much more resilient implementation which leverages the existing write ahead log code in Prometheus.
featureDo you use Kafka for your logs? You should check out the new Promtail Kafka Consumer which can easily get your logs out of Kafka and into Loki.
featureLogQL has received some nice enhancements thanks to the amazing Loki community in the form of group_left and group_right as well as the label_format and line_formatfunctions now support working with dates and times
featureAnother great community contribution to Promtail allows it to accept ndjson and plaintext log files over HTTP.
fix4598 kavirajk: Fix ip matcher lexer to differentiate filter from identifier
fix4563 cyriltovena: Fixes the Series function to handle properly sharding.
fix4518 slim-bean: Loki: Fix bug where items are returned to a sync.Pool incorrectly
fix4411 slim-bean: Loki: Bug: frontend waiting on results which would never come
fix4238 liguozhong: [fix] distributor: fix goroutine leak
featureLoki now has the ability to apply custom retention based on stream selectors! This will allow much finer control over log retention all of which is now handled by Loki, no longer requiring the use of object store configs for retention.
featureComing along hand in hand with storing logs for longer durations is the ability to delete log streams. The initial implementation lets you submit delete request jobs which will be processed after 24 hours.
featureA very exciting new LogQL parser has been introduced: the pattern parser. Much simpler and faster than regexp for log lines that have a little bit of structure to them such as the Common Log Format. This is now Loki's fastest parser so try it out on any of your log lines!
featureExtending on the work of Alerting Rules, Loki now accepts recording rules. This lets you turn your logs into metrics and push them to Prometheus or any Prometheus compatible remote_write endpoint.
featureLogQL can understand IP addresses! This enables filtering on IP addresses and subnet ranges.
featureWe created an index gateway which takes on the task of downloading the boltdb-shipper index files allowing you to run your queriers without any local disk requirements, this is really helpful in Kubernetes environments where you can return your queriers from Statefulsets back to Deployments and…
featureIngester queriers are now shardable, this is a significant performance boost for high volume log streams when querying recent data.
featureInstant queries can now be split and sharded making them just as fast as range queries.
feature3919 github-vincent-miszczak: Add ingester.autoforget-unhealthy-timeout opt-in feature
featureMore text/template functions are included for label_format and line_format with PR 3515, please check out the documentation for template functions.
featureAlso support for math functions withing label_format and line_format was included with 3434.
featureTwo additional metric functions with some interesting use cases first_over_time and last_over_time were added in PR 3050. These can be useful for some down sampling approaches where instead of taking an average, max, or min of samples over a range in a metrics query, you can select the first or…
other3216 sandeepsukhani: check for stream selectors to have at least one equality matcher.
security4020 simonswine: Restrict path segments in TenantIDs (CVE-2021-36156 CVE-2021-36157).
fixAn important fix for leaking resources was patched with 3733, when queries were canceled a goroutine was left running which would hold memory resources creating a memory leak.
fix3686 fixes a panic with the frontend when use with downstream URL. Note we recommend using the GRPC Pull Model, better performance and fair scheduling between tenants can be obtained with the GPRC Pull Model.