Dynatrace User session streaming to elastic search

[abhinav_vuddagi]

We are exporting user session data from dynatrace to elastic search. I would like to know if Elastic goes for maintenance, does dynatrace stream old data that was accumulated during the maintenance window along with new data when elastic comes back up

[dominik_stadler]

Currently it is a continuous stream of documents with only a few retries before the exported document is discarded.

So for a short interruption documents will be retried after a short while and sent when it is available again, but if Elasticsearch a offline for a longer time, documents are discarded at some point with a admin-visible notification in the WebUI.

The new REST API for querying data can be used to fetch documents in the same format for a given timeframe in the past, see User session query language

[abhinav_vuddagi]

Thanks for the reply. What is the maximum retry attempts/period of retry attempts before documents are discarded?

Using UQL, can we export the accumulated data in the maintenance timeframe to elastic search ?

[dominik_stadler · Accepted solution]

It will currently retry 3 times with a delay of up to 30 seconds.

Not sure if I read the question about USQL correctly, the query language allows to query any timeframe and also allows to aggregate data in various ways, so likely it is possible with some limits on number of rows fetched per REST call and some rate-limit on the number of REST calls.

So you might need to take a look at the documentation to see what it can do. But it might even be possible to replace the export to Elasticsearch and aggregating there completely.