What are the main benefits of OpenPipeline?

[GosiaMurawska]

From a user's perspective, why is it worth to use OpenPipeline? 

[thomas_billi · Accepted solution]

• Unified ingest: high scalable stream processing and a unified app to manage all data ingested into Dynatrace 

• Contextualization, enrichment and transformation:   
  • Enrich data and improve its value and quality by adding supplemental attributes (such as geolocation derived from an IP address).  
  • Normalize data without losing context.  
  • Transform plain text content into well-defined fields, convert raw data to time series, or create business events from log lines.  
  • Converge heterogeneous data sources with ease and combine with the powerful schema-on-read from Grail.   
  • Prioritize business data for a desired quality of service (QoS). Dynatrace provides unmatched accuracy by treating relevant business data (for example, real-time consumption or revenue dashboarding and analytics) with a higher priority and ensuring that data is not only in context but also not dropped or sampled.  

That said: OpenPipeline optimizes data for Dynatrace analytics and AI.  

[StrangerThing]

My favorite part is just the organizational simplicity. You go from having giant, tenant-wide rulesets for processing, metric/event extraction, bucket assignments, etc. to having simple, segregated routes for any way you'd like to split each log/event/bizevent. 

Second favorite part is I can build a parser or something of that nature directly in a Notebook in DQL and copy that parse command over to my processing rule. One language to rule them all!

[PacoPorro]

OpenPipeline is an effective tool for organizing logs because it allows you to categorize log entries into different “buckets” based on specific criteria. Each bucket can have its own retention policy, ensuring that logs are stored for the appropriate amount of time based on their importance or relevance.