Log Analytics
cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

How to direct logs to right bucket via openpipeline

JannickDT_CM
Visitor

What is the best approach to direct my logs to the right bucket, making use of a openpipeline?

Can anybody provide me more info/details how to do this?

Thanks a lot

1 REPLY 1

thomas_billi
Dynatrace Pro
Dynatrace Pro

There are two ways to control which Grail bucket your logs land in:

Option 1 — Bucket assignment processor in a pipeline (recommended)

In OpenPipeline, each pipeline has a dedicated Storage stage that runs after all processing. You configure a bucket assignment processor there:

  1. Go to OpenPipeline → Logs and open (or create) the pipeline that matches your log source.
  2. In the Storage stage, add a bucket assignment rule.
  3. Set a match condition (e.g., matchesPhrase(content, "my-app") or check an attribute like k8s.namespace.name == "prod") to select which records go where.
  4. Set the target bucket for records that match.
  5. Add a fallback rule at the bottom (no condition) to catch everything else.

Rules are evaluated top-to-bottom — first match wins.

Option 2 — Send dt.system.bucket at ingest time

If you control the sending side (e.g., a custom log shipper or the Logs Ingest API), you can set the dt.system.bucket attribute directly on each log record before sending. OpenPipeline will honour it.

 

Documentation for OpenPipeline is here:
https://docs.dynatrace.com/docs/platform/openpipeline 

Featured Posts