Allocate compute resources dynamically

🔄 Tasks

1. Collect metrics:
   1. Collect usage metrics — e.g. business intelligence outputs (dashboards, reports), including peak access times.
   2. Collect runtime metrics from data processing engines, including when and for how long data processing occurs.
2. Recommend when to scale up (or down) the data processing resources.
3. Auto-scale: Automatically apply the recommended parameters to the data processing environment.

For example, imagine that 90% of users log in to the business intelligence tool during the last week of a financial quarter. With active metadata, the system can automatically scale up resources just before those weeks and automatically scale down the resources again afterwards.

🎉 Outcome

Improve resource utilization and reduce processing delays.

Related