topic Re: Cron like schedule for 2.0 Extensions? in Extensions

Cron like schedule for 2.0 Extensions?

sivart_89 — Tue, 21 Nov 2023 08:33:32 GMT

The EF 1.0 custom db queries extension allows for use of a cron like schedule for when the queries will be executed. I have only seen the ability to specific how often (every 5 minutes, 10 minutes, etc) to run the query for EF 2.0 extensions.

Does 2.0 have the ability to specify a cron like schedule? We use that pretty heavily today with the 1.0 extension. With the sunset of EF 1.0 in Oct next year I've started looking at replacing the one we use today with 2.0.

Re: Cron like schedule for 2.0 Extensions?

Julius_Loman — Mon, 20 Nov 2023 13:01:37 GMT

Please see this thread. Although documention does not (yet) reflect the availability. It's just not possible to have this configured as configurable variable of the extension configuration and must be "hardcoded" in the extension yaml.

Re: Cron like schedule for 2.0 Extensions?

sivart_89 — Mon, 20 Nov 2023 13:09:38 GMT

What is referenced here is a standard interval such as every 5 minutes. I am aware of being able to change that to something else (10, 30, whatever) but that is not what I am referring to. As an example we have the 1.0 extension running a query on a cron schedule such as the below to run at a very specific time Monday - Friday. I don't see that being possible yet in the 2.0 framework.

0-5 12 * * MON-FRI

Re: Cron like schedule for 2.0 Extensions?

Mike_L — Mon, 20 Nov 2023 13:15:27 GMT

This is scheduled to be added to the SQL datasource somewhere in the first half of 2024 to bridge the most important gap with the Custom DB Query extension.

Re: Cron like schedule for 2.0 Extensions?

Julius_Loman — Mon, 20 Nov 2023 13:15:28 GMT

Yes, my fault. You can right now enable/disable extensions configuration using API. So, this can be accomplished for example by calling it from a workflow (if you are on SaaS and you have the new Dynatrace platform available) or triggering the API call remotely - for example from a cron scheduler.

Re: Cron like schedule for 2.0 Extensions?

sivart_89 — Mon, 20 Nov 2023 13:20:58 GMT

Thanks for the information @Julius_Loman but I could see this still being a huge headache. If I recall correctly the query does not show up in a 'separate config object', or something you can individually manipulate. This means we would have to have a new extension for each query that has a unique schedule that cannot be put into the standard interval format.

While yes API calls are great, it just doesn't make much sense to not have this ability added to the new framework as it causes a lot more maintenance, unless I am missing something.

@Mike_L glad to see this is being brought in, thank you! 🙂

Re: Cron like schedule for 2.0 Extensions?

itamarmesa — Mon, 22 Apr 2024 12:56:16 GMT

Hi Mike_L!

Are there any news on this? Thanks!

Re: Cron like schedule for 2.0 Extensions?

Mike_L — Mon, 22 Apr 2024 13:06:02 GMT

It has been postponed for now. It might be that this functionality is not present before the removal of extension framework 1.0.

Re: Cron like schedule for 2.0 Extensions?

sivart_89 — Mon, 22 Apr 2024 14:24:24 GMT

I'm sad to hear this but I do appreciate the update here. I'm not quite ready to start moving everything over to the 2.0 extension I've developed but when ready I will work with the app team to adjust the scheduling.

Re: Cron like schedule for 2.0 Extensions?

itamarmesa — Tue, 23 Apr 2024 12:44:50 GMT

Is there any way to leave the admins some time between you adding the cron functionality to the 2.0 extensions in case that it is not ready in time before the framework 1.0 removal and the framework 1.0 extensions removal?

It will make our monitoring unavailable only dued to this.

Re: Cron like schedule for 2.0 Extensions?

Mike_L — Tue, 23 Apr 2024 10:14:16 GMT

I'm working on the priority of this. I'll point the product manager to your comment about unavailable monitoring.

Re: Cron like schedule for 2.0 Extensions?

sivart_89 — Fri, 28 Jun 2024 14:55:41 GMT

@Mike_L just checking in on this being it has been 2 months. Is there any more definitive timeframe of when cron like scheduling will be available for this?

Re: Cron like schedule for 2.0 Extensions?

Mike_L — Fri, 28 Jun 2024 16:06:04 GMT

It's currently in active development for the SQL data source and we expect it to be there before the removal of EF1 🙂

Re: Cron like schedule for 2.0 Extensions?

ASE — Fri, 28 Jun 2024 16:44:56 GMT

When will EF1 be removed, @Mike_L?

We need to know exactly when our custom DB query extension 1.0 will stop working.

Re: Cron like schedule for 2.0 Extensions?

Mike_L — Fri, 28 Jun 2024 16:51:01 GMT

Python extensions built in EF1 will be removed in October. More precisely ActiveGate and OneAgent 1.301.

JMX will keep working until March.

Re: Cron like schedule for 2.0 Extensions?

sivart_89 — Fri, 28 Jun 2024 21:14:48 GMT

Just to make sure I am clear here, we are using the sqlOracle datasource to query Oracle databases. This upcoming feature applies to this right? Not sure if there is a separate datasource for something like MSSQL but just wanted to be clear on what we are hoping for (this new feature to work for queries we are running against Oracle databases)

Re: Cron like schedule for 2.0 Extensions?

Mike_L — Fri, 28 Jun 2024 22:28:23 GMT

It is indeed planned to work with all the SQL data sources, including Oracle.

Re: Cron like schedule for 2.0 Extensions?

Mike_L — Fri, 26 Jul 2024 10:36:30 GMT

This will be added to all SQL data sources in AG 1.299. Example YAML:

Re: Cron like schedule for 2.0 Extensions?

sivart_89 — Fri, 26 Jul 2024 12:23:06 GMT

Great news here Mike. Thank you to all involved with this effort!

Re: Cron like schedule for 2.0 Extensions?

Mike_L — Wed, 14 Aug 2024 13:14:00 GMT

EDIT: cron support for the SQL data sources have been delayed to AG 1.301.