Oracle has recently announced the availability of MySQL Autopilot — a new component of MySQL HeatWave service, the in-memory query acceleration engine for MySQL Database Service in Oracle Cloud Infrastructure (OCI).
According to Oracle’s official release, MySQL Autopilot uses advanced machine learning techniques to automate HeatWave, making it easier to use and further improving performance and scalability. No other cloud vendor provides such advanced automation capabilities for their database offerings.
Autopilot is available at no additional charge for MySQL HeatWave customers.
MySQL Autopilot automates many of the most important and often challenging aspects of achieving high query performance at scale—including provisioning, data loading, query execution and failure handling. It uses advanced techniques to sample data, collect statistics on data and queries, and build machine learning models using Oracle AutoML to model memory usage, network load and execution time. These machine learning models are then used by MySQL Autopilot to execute its core capabilities.
MySQL Autopilot makes the HeatWave query optimizer increasingly intelligent as more queries are executed, resulting in continually improving system performance over time—a capability not available on Amazon Aurora, Amazon Redshift, Snowflake, or other MySQL-based database services.
MySQL Autopilot includes the following capabilities:
- Auto-provisioning predicts the number of HeatWave nodes required for running a workload by an adaptive sampling of table data on which analytics is required. This means that customers no longer need to manually estimate the optimal size of their cluster. No other database service provides this capability.
- Auto parallel load can optimize the load time and memory usage by predicting the optimal degree of parallelism for each table being loaded into HeatWave. No other cloud vendor offers this capability.
- Auto data placement predicts the column on which tables should be partitioned in memory to help achieve the best performance for queries. It also predicts the expected gain in query performance with the new column recommendation. This minimizes data movement across nodes due to suboptimal choices that can be made by operators when manually selecting the column. No other database service provides this capability.
- Auto encoding can determine the optimal representation of columns being loaded into HeatWave, considering the queries. This optimal representation provides the best query performance and minimizes the size of the cluster to minimize costs.
- Auto query plan improvement learns various statistics from the execution of queries and can improve the execution plan of future queries. This improves the performance of the system as more queries are run. No other database service provides this capability.
- Auto query time estimation can estimate the execution time of a query prior to executing the query. This provides a prediction of how long a query will take, enabling customers to decide if the duration of the query is too long and instead run a different query.
- Auto change propagation intelligently determines the optimal time when changes in MySQL Database should be propagated to the HeatWave Scale-out Data Management layer. This helps ensure that changes are being propagated at the right optimal cadence. No other cloud vendor offers this capability.
- Auto scheduling can determine which queries in the queue are short running and prioritize them over long-running queries in an intelligent way to reduce overall wait time. Most other databases use the First In, First Out (FIFO) mechanism for scheduling.
- Auto error recovery provisions new nodes and reloads necessary data if one or more HeatWave nodes is unresponsive due to software or hardware failure.
“Oracle’s MySQL Database Service with HeatWave is the only MySQL database that efficiently supports both OLTP and OLAP, enabling users to run mixed workloads or real-time analytics against their MySQL database with 10 to 1,000 times better performance and less than half the cost compared to other analytical or MySQL-based databases,” said Edward Screven, Chief Corporate Architect, Oracle.
He further added, “MySQL HeatWave is one of the fastest-growing cloud services on OCI, and an increasing number of customers are moving their MySQL workloads to HeatWave. Today, we are announcing a number of innovations thatresulting from years of research and advanced development at Oracle. The combination of these innovations delivers massive improvements in automation, performance and cost — further distancing HeatWave from other database cloud services.”
As part of this announcement, Oracle is also introducing MySQL Scale-out Data Management, which can improve the performance of reloading data into HeatWave by up to 100 times. HeatWave now supports a cluster size of 64 nodes—up from 24 nodes—and is capable of processing up to 32 TB of data—up from 12 TB. These new enhancements further strengthen the price/performance advantages of HeatWave relative to its primary competitors.
HeatWave can offer better performance at a lower price for analytics and mixed workloads compared to all other competitive database and analytics cloud services. Specifically, in tests HeatWave has seen:
- 13 times better price/performance than Amazon Redshift with AQUA—6.5 times faster at half the cost (TPC-H 10TB)
- 35 times better price/performance than Snowflake—7 times faster at 1/5 the cost (TPC-H 10TB)
- 36 times better price/performance than Google Big Query—9 times faster at 1/4 the cost (TPC-H 30TB)
- 15 times better price/performance than Azure Synapse—3 times faster at 1/5 the cost (TPC-H 30TB)
- 42 times better price/performance than Amazon Aurora for mixed workloads—18 times lower latency, and 110 times higher throughput at 42 per cent the cost (CH-benCHmark 100G)
Oracle is making the benchmarking code publicly available, enabling customers to run the benchmarks themselves by visiting here. Oracle also announced that the industry-standard TPC-DS benchmark can now be accelerated using HeatWave.
Customers who have migrated from Amazon to MySQL HeatWave on OCI thus far have seen a substantial reduction in their costs and a significant improvement in the performance of their cloud workloads.
VP and Principal Analyst at Constellation Research, Holger Mueller, stated, “The evolution of MySQL continues as Oracle accelerates developer velocity. Oracle previously provided a single unified platform for both OLTP and OLAP, eliminating the need for multiple databases and tools to ETL across databases.”
He further said, “Now Oracle brings out new innovations which are set to likely disrupt the market, significantly lifting the expectations for what open source cloud databases should be. With machine learning-based automation in Autopilot and scaling in memory, nodes, and storage, Oracle sets developers free to develop next-generation applications running on the much faster and cheaper MySQL HeatWave compared to any platform they may try.”
According to Carl Olofson, Research Vice President, Data Management Software, IDC, “Some cloud database providers continue to offer specialized databases for specific workloads, and assume, especially in the open-source space, that developers like to manually tinker with parameters to optimize performance.”
“Oracle is on a different track, looking to combine database functionality in a single system. It provides database convergence and automation in the open-source cloud database service MySQL HeatWave. Oracle introduced MySQL HeatWave late in 2020, bringing full native cloud support and unifying OLTP and OLAP in one database, which eliminated the need for ETL. In this newly announced version, Oracle has added machine learning-based automation, which takes away the guesswork and manual labour involved in provisioning, data loading, query execution, and failure handling. These automations are also a major factor in HeatWave’s performance and price/performance results as reported in the company’s publicly accessible and repeatable benchmarks, providing metrics that should compare favourably with those of other cloud database service providers,” said Carl.
“For organizations using MySQL, Oracle has given yet another reason to invest in its HeatWave offering by delivering seven times the performance at 1/5 the cost of solutions such as Snowflake,” said Matt Kimball, Senior Analyst, Data Center Compute, Moor Insights & Strategy. “Oracle continues to align its innovation and resources to the needs of its customers and the market. So for those looking to extract the most out of their MySQL environments, HeatWave should be given a hard look.”
“Open source developers who have not yet moved to MySQL Database Service with HeatWave are running out of reasons not to give it a try,” said Marc Staimer, Founder and President of DS Consulting and Wikibon Analyst. “Not only has Oracle simplified their lives with a unified OLTP and OLAP MySQL service, but it has also eliminated the need for a separate analytical database or data warehouse and ETLs between them. Plus, now it has delivered unparalleled performance and cost/performance. The latest additions include MySQL Autopilot, which has automated many onerous manual tasks from provisioning to data loading and query execution. Together with massive scale-out capabilities, this combination makes MySQL HeatWave meltdown Snowflake and vaporize Amazon Redshift with AQUA.”
MySQL HeatWave is also incorporated into the Oracle lake house. OCI Data Catalog is the single catalogue for the lake house, including data from MySQL Database Service as well as Oracle Autonomous Database and OCI Object Storage. Lakehouse users can discover MySQL data through the catalogue and move it or analyze it as needed. Several other OCI services, such as Oracle Analytics Cloud and Oracle Cloud Data Integration service, are also integrated with MySQL HeatWave.
The new features introduced in the latest MySQL HeatWave release are available now on OCI across all 30 Oracle Cloud Regions.