Network export failures (DNS errors, connection timeouts) produce ERROR logs — one per failed batch. With up to 16 in-flight batches, a brief network outage generates a rapid wall of ERROR lines that obscures real problems.
These failures are transient and self-healing (durable buffer re-delivers NACKed batches). Dedicated metrics (failed.batches, laclient.network.errors) already cover alerting.
Proposal: Downgrade export.failed from otel_error! to otel_warn!. Other otel_error! sites (gzip failures, invalid auth headers) remain ERROR as they indicate actual bugs.
Network export failures (DNS errors, connection timeouts) produce ERROR logs — one per failed batch. With up to 16 in-flight batches, a brief network outage generates a rapid wall of ERROR lines that obscures real problems.
These failures are transient and self-healing (durable buffer re-delivers NACKed batches). Dedicated metrics (
failed.batches,laclient.network.errors) already cover alerting.Proposal: Downgrade
export.failedfromotel_error!tootel_warn!. Otherotel_error!sites (gzip failures, invalid auth headers) remain ERROR as they indicate actual bugs.