16 Jan 2025 09:49 AM
Hi all,
In an organization that has many "general/common" parsing rules for its logs but also some unique ones per log type/business process, How would you build your openPipeline architecture to make sure you only maintain one copy of the general rules and not copy them to each pipeline?
Gil.
16 Jan 2025 10:30 AM
Great question, we hear it quite often. Currently there's no great way to solve this problem, but we are working on a feature that will allow to combine pipelines and add their ingest functionality onto another one.
This way it's going to be possible to combine functionality that comes Out-of-the-box by Dynatrace with custom processors and it's possible to create global (or widely applicable) pipelines (e.g. for global bucket and security context assignment; or for common technology parsing that is identical across many pipelines) and combine those. In combination with our upcoming fine-grained permissions this will also allow for access and edit control of stages, so that e.g. teams cannot interfere with a global bucket assignment scheme.