3,013 questions with Azure Databricks tags

Sort by: Updated
1 answer

Question 2: Legacy Hive Metastore Support Timeline

Starting September 30, 2026, new Databricks workspaces will be provisioned with Unity Catalog and without certain legacy features. For existing workspaces, what is the official Databricks support timeline/end-of-support date for the legacy Hive…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

3,013 questions
asked 2026-08-26T13:15:06.3933333+00:00
Mahale, Saurav 0 Reputation points
commented 2026-08-27T17:33:15.0533333+00:00
SIVASANKAR YEDDULA 125 Reputation points Microsoft External Staff Moderator
1 answer

Question 1: Using Legacy Hive Metastore as a Production Fallback

Our current Production Databricks environment is using the legacy Hive Metastore, and we are planning to migrate it to Unity Catalog in the currently active Production environment. If we migrate the active Production environment to Unity Catalog and…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

3,013 questions
asked 2026-08-26T13:12:36.1466667+00:00
Mahale, Saurav 0 Reputation points
commented 2026-08-27T15:44:20.84+00:00
Himaja Y 270 Reputation points Microsoft External Staff Moderator
4 answers

Unable to enable datatbricks admin role to have access to the system.serving catalog

This looks like a strange situation that i am facing here i have created a databricks with existing user in my personal account the user already have global administrator privilege however after i signed into datbricks, this user(personal id) appeared as…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

3,013 questions
asked 2026-08-20T06:57:53.2133333+00:00
Hari 0 Reputation points
commented 2026-08-27T11:43:37.48+00:00
SIVASANKAR YEDDULA 125 Reputation points Microsoft External Staff Moderator
0 answers

Not Able to play video on Microsoft learn course.

Not Able to play video on Microsoft learn course. Course name: Implement data engineering solutions using Azure Databricks Module 1

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

3,013 questions
asked 2026-08-26T01:18:59.1966667+00:00
Ajay Velu 0 Reputation points
commented 2026-08-27T11:42:43.4066667+00:00
SIVASANKAR YEDDULA 125 Reputation points Microsoft External Staff Moderator
1 answer

Databricks: IP whitelisting issue — 403 Forbidden error during SCIM API calls

I don't need help white listing IPs. I need to know which IP ranges to white list so that we don't get these failures in future.

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

3,013 questions
asked 2026-08-25T08:55:38.94+00:00
Mark Tyson 1 Reputation point
answered 2026-08-27T02:34:15.16+00:00
Ravi Kiran Pagidi 170 Reputation points
0 answers

Join: Microsoft Azure Q&A Champions Program

The Microsoft Azure Q&A Champions Program recognizes and empowers a global community of internal and external Azure experts who help customers succeed by providing high-quality, trusted answers on Microsoft Q&A. The program scales expert led…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

3,013 questions
asked 2026-05-25T20:54:40.23+00:00
Ashley Swearingen 0 Reputation points Microsoft External Staff Moderator
edited the question 2026-08-26T19:01:25.11+00:00
Ashley Swearingen 0 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Databricks: Foundation Model API premium models blocked by workspace rate limit of 0

Problem description I am experiencing an issue where calls to the Foundation Model API premium hosted endpoints (Claude Fable 5 and Claude Sonnet 5) via the AI Playground are returning a 403 PERMISSION_DENIED error, stating that "The endpoint is…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

3,013 questions
asked 2026-08-24T19:19:37.11+00:00
Branko Culo 20 Reputation points
accepted 2026-08-26T18:40:06.5566667+00:00
Branko Culo 20 Reputation points
0 answers

Is Azure Databricks down? Getting: "The service at /explore/data?o={Id} is temporarily unavailable. Please try again later. [TraceId: -]"

Experiencing intermittent access failures in an Azure Databricks workspace hosted in Australia East. When opening the Explore Data page, the workspace returns: { "error_code": "TEMPORARILY_UNAVAILABLE", "message":…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

3,013 questions
asked 2026-08-25T04:07:52.3166667+00:00
Yohjit Chopra 5 Reputation points
commented 2026-08-26T09:24:43.19+00:00
Himaja Y 270 Reputation points Microsoft External Staff Moderator
1 answer

Microsoft GraphRAG com fonte de dados RDF externa em determinar.ia.br é viável usar um grafo curado em vez de extrair de documentos?

Estou experimentando o Microsoft GraphRAG Library (do Microsoft Research) para um projeto de grounding de agente de IA, e bateu uma dúvida que talvez alguém aqui já tenha enfrentado. O GraphRAG library faz algo impressionante: ele pega um conjunto de…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

3,013 questions
asked 2026-08-06T23:51:34.8266667+00:00
Paulo C P Santos 0 Reputation points
commented 2026-08-25T16:07:38.6366667+00:00
Vinodh247-1375 43,996 Reputation points Volunteer Moderator
0 answers

Databricks: After metastore storage root location removal cannot change default storage root for new __databricks_internal catalog

Dear team, We decided to remove default storage root location for metastore in databricks (via accounts level plane) since all of our catalogs have their own root location anyways. After doing so new __databricks_internal catalog was created and is…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

3,013 questions
asked 2026-08-05T11:24:13.5133333+00:00
Jurijs Ņemcevs 0 Reputation points
commented 2026-08-25T15:08:44.1566667+00:00
Jurijs Ņemcevs 0 Reputation points
2 answers

How do I connect to my AKS from Azure databricks Serverless workspace?

How do I connect to my AKS from Azure databricks Serverless workspace? My Serverless workspace is private endpoint enabled. Is it possible to connect via NCC? If not, what options we have? Connection should be all private without any public.

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

3,013 questions
asked 2026-08-10T16:30:29.54+00:00
Akash S 6 Reputation points
answered 2026-08-24T15:50:12.7533333+00:00
Himaja Y 270 Reputation points Microsoft External Staff Moderator
2 answers

Not able to create metastore in azure databricks premium 14 day free trail from manage account

Hello, I am not able to create a metastore in Azure Databricks Premium 14-day free trial from the Manage account I have tried both the UI and databrick cli and getting contously the below error. UI error: Azure Managed Identity Credential with Access…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

3,013 questions
asked 2026-08-21T12:07:28.0133333+00:00
data engineerlin 0 Reputation points
answered 2026-08-24T11:22:55.9366667+00:00
Himaja Y 270 Reputation points Microsoft External Staff Moderator
2 answers

Not able to create any resources this morning in Azure portal

I have permissions, but seems portal is acting weird today. Status shows everything is fine with Azure, but I am unable to create any resource. Create button is disabled. I have permissions to create resource in Azure as I already created few and that…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

3,013 questions
asked 2025-07-19T09:52:27.3266667+00:00
answered 2026-08-24T11:12:19.1966667+00:00
Suraj Verma 0 Reputation points
1 answer One of the answers was accepted by the question author.

How to get the public IP range of my Azure Databricks cluster? I Need to whitelist this IP range with a host that I want to connect and get data from.

How to get the public IP range of my Azure Databricks cluster? I Need to whitelist this IP range with a host that I want to connect to and get data from.

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

3,013 questions
asked 2024-06-13T08:19:20.98+00:00
Makarand Nidhalkar 20 Reputation points
edited a comment 2026-08-24T08:59:20.2533333+00:00
JuliaMarvin 21,425 Reputation points Volunteer Moderator
1 answer

Different SQL result between Databricks SQL warehouse and Databricks runtime 18

Hello, I have an issue with the latest version of the Databricks Runtime 18. The following query (sorry for the screenshot, but if I use markdown I was blocked by your site with the message "You are not authorized to make this response. If you…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

3,013 questions
asked 2026-07-01T13:39:02.01+00:00
Nathan Eckert 0 Reputation points
commented 2026-08-22T15:17:20.8533333+00:00
Manoj Kumar Boyini 19,510 Reputation points Microsoft External Staff Moderator
2 answers

How RBAC works with data bricks its confusing with Microsoft document, please elaborate on this topic

How RBAC works with data bricks its confusing with Microsoft document, please elaborate on this topic

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

3,013 questions
asked 2026-08-19T12:30:06.7966667+00:00
Nasir SM 0 Reputation points
commented 2026-08-20T04:47:28.68+00:00
Senthil kumar 2,080 Reputation points
1 answer

Databricks workspace inside a locked (ReadOnly) managed application never finalizes — is this supported?

We are an ISV packaging an Azure Databricks workspace as a Service Catalog managed application with lockLevel: ReadOnly. The workspace never reaches provisioningState: Succeeded: every Azure resource is created successfully — including Databricks' own…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

3,013 questions
asked 2026-08-17T04:26:37.1233333+00:00
Walid 0 Reputation points
answered 2026-08-19T05:07:43.2666667+00:00
Peram Venkateswara Reddy 260 Reputation points Microsoft External Staff Moderator
3 answers

How to fix issue regarding creation of metastore

I am trying to enable the unity catalog. for that I create databricks access connector and give access to adls and pass ADLS path and resource id to databricks admin console but showing below error. Azure Managed Identity Credential with Access Connector…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

3,013 questions
asked 2026-08-11T11:53:11.7566667+00:00
Shubham 0 Reputation points
commented 2026-08-18T23:16:02.7466667+00:00
Jose Benjamin Solis Nolasco 11,786 Reputation points Volunteer Moderator
3 answers One of the answers was accepted by the question author.

Data Reading issues from EVENTHub to Databricks using DLT.

Hi Team, Am building Solution in Databricks to Read Data from Event Hub through DLT. While Running the Code , I am facing a challenge with the cluster configuration.   For streaming workloads, we need to use a Single User Access cluster. However, by…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

3,013 questions
asked 2026-08-18T04:39:05.7866667+00:00
Damodara, K 40 Reputation points
answered 2026-08-18T13:06:24.7733333+00:00
Himaja Y 270 Reputation points Microsoft External Staff Moderator
2 answers

Unity Catalog metastore creation fails - Managed Identity could not be found

I am trying to create a Unity Catalog metastore in Azure Databricks. Error: Azure Managed Identity Credential with Access Connector…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

3,013 questions
asked 2026-08-04T01:14:04.4033333+00:00
Zubaer Shaik 0 Reputation points
edited the question 2026-08-17T10:58:03.2033333+00:00
Alexandra T 0 Reputation points Microsoft External Staff Moderator