[litianningdatadog]

What does this PR do?

• AggregatorHandle::insert_serialized_batch(Vec<String>): queues already-serialized JSON objects as-is, in the same queue as normal entries.
• OversizePolicy on the aggregator and its service: Drop (default, today's behavior: entries over 1 MiB are dropped) or SendWithWarning (keep them with one warning, unless an entry is too big for any payload, len + 2 > 5 MiB, which is still dropped).
• Also moves the flusher tests unchanged into src/flusher/tests.rs and a small test-only helper for counting log lines (flusher.rs was ~1,500 lines, mostly tests).

Motivation

Part of SVLS-8713: bottlecap (the Datadog Lambda Extension) is replacing its own logs aggregator and flusher with this crate. Two rules for the whole stack:

• Nothing changes for existing users of this crate (for example serverless-compat): every new behavior is opt-in, defaults and public API stay the same (additions only), no new environment variables, no new dependencies.
• Nothing changes for Lambda users: the options let bottlecap reproduce its current behavior exactly.

bottlecap builds its own nested per-log JSON (message, Lambda context, tags) that IntakeEntry can't express; passing strings keeps the wire format byte-for-byte and avoids serializing twice. bottlecap also sends logs over 1 MiB with a warning instead of dropping them.

Additional Notes

Both are opt-in; defaults unchanged. The large diff is mostly the test-file move (the moved tests are unchanged). Squashed from two commits (the move, then the feature).

Describe how to test/QA your changes

91 tests pass (11 new: serialized inserts, mixed batching, both oversize policies and their warning counts, the too-big-for-any-payload cap). All sc-0 tests unchanged.

Stack

Each PR is nested under the PR it builds on (and targets). Review and merge from the top down.

serverless-components (datadog-logs-agent options; merge first)

• main
  • [SVLS-8713] test(logs-agent): pin current default behavior with characterization tests #189 characterization tests (pin today's defaults)
    • [SVLS-8713] build(logs-agent): let users choose the FIPS TLS backend #190 default / fips features
      • 👉 [SVLS-8713] feat(logs-agent): accept pre-serialized logs and an oversize policy #191 pre-serialized logs + oversize policy ← this PR
        • [SVLS-8713] feat(logs-agent): optional API key resolver and Datadog intake URL override #192 API key resolver + intake URL override
          • [SVLS-8713] feat(logs-agent): add a retry-only method and an optional flush policy #193 retry() + FlushPolicy
            • [SVLS-8713] perf(logs-agent): compress each log batch only once #194 compress each batch once
              • [SVLS-8713] perf(logs-agent): compress log batches before waiting for the API key #195 compress before waiting for the API key

datadog-lambda-extension (bottlecap)

• main
  • [SVLS-8713] test(logs): contract tests, fake logs intake and benchmark for the logs pipeline datadog-lambda-extension#1448 contract tests, fake intake, benchmark
    • [SVLS-8713] fix(logs): send additional endpoints the Datadog intake format when OPW is on datadog-lambda-extension#1449 fix: OPW applies only to the primary endpoint
      • [SVLS-8713] fix(logs): drop a log too large for any payload instead of blocking the queue datadog-lambda-extension#1450 fix: drop a log too large for any payload
        • [SVLS-8713] test(logs): pin that a reloaded API key is used on the next flush datadog-lambda-extension#1451 pin: reloaded API key is used
          • bc-1: use the shared aggregator (opens after the serverless-components PRs merge)
            • bc-2: use the shared flusher (opens after the serverless-components PRs merge)

🤖 Generated with Claude Code