An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
Hyperspace is not supported with Azure Synapse Runtime for Apache Spark 3.5.
The Hyperspace documentation explicitly states that:
- Hyperspace is supported in Azure Synapse Runtime for Apache Spark 3.1 and 3.2.
- Hyperspace is not supported in Azure Synapse Runtime for Apache Spark 3.3 (GA).
There is no mention of Hyperspace support for newer runtimes such as 3.4 or 3.5, and the only supported versions listed are 3.1 and 3.2. Therefore, Hyperspace is not supported on the current GA runtime, Azure Synapse Runtime for Apache Spark 3.5.
For new or upgraded workloads, the recommended path is to move to the latest GA runtime (3.5) for general Spark improvements, but without Hyperspace.
References:
- Hyperspace: An indexing subsystem for Apache Spark (programming-language-python)
- Hyperspace: An indexing subsystem for Apache Spark (programming-language-csharp)
- Hyperspace: An indexing subsystem for Apache Spark (programming-language-scala)
- Azure Synapse Runtime for Apache Spark 3.5 (GA)
- Azure Synapse runtimes