VantageCloud Lake requires significantly less workload management techniques as compared to other Vantage offerings. There are several reasons for this:
- Compute clusters offer a natural boundary between different types of work that are active at the same time. Because of this, workloads from specific departments or certain applications can be isolated on their own set of compute clusters. This many-cluster architecture removes the need to rely on complex workload management rules to protect high priority work from less important work as would be the case when they are both contending for the same platform resources.
- Compute groups give departments the opportunity to control their own resource consumption and cost, decentralizing control over work in a way that is not possible on a single platform shared by all departments. Within a given department or application, there may be no need for priority differentiation. When prioritization is required, it is likely to be satisfied by a modest number of simple priority assignments within each compute group.
- Compute groups come with their own internally created throttle rules, which limit the number of queries that are allowed to run on the compute clusters belonging to that compute group. For this reason, sophisticated workload management such as placing hard limits on resource usage or reserving certain types of resource for just the high priority work is not needed.
- Auto-scale capabilities within compute groups unleash additional resource on demand, and the degree of elasticity can be automatically increased or decreased by time of day to match changing patterns in the workflow of a department. Because of the flexibility of auto-scale, there is no need for workload management rules that keep track of resource usage in real time and tighten workload rules when times of high utilization are reached.
- The emphasis of workload management on VantageCloud Lake is simplicity and ease of use, relying as much as possible on the natural boundaries created by distinct primary clusters and compute clusters. The initial default workload management settings are expected to satisfy the needs of the majority of VantageCloud Lake users.