An Azure service for ingesting, preparing, and transforming data at scale.
Azure Data Factory Data Flow CDC Source Not Refreshing When Using Dynamic Table Names
Environment Azure Data Factory running in a Visual Studio subscription SQL Server source using CDC-enabled tables AdventureWorks sample database used for testing Mapping Data Flow with: Source (SQL CDC) Sink (Parquet or JSON) Pipeline…
Azure Data Factory
@microsoft/azure-data-factory-utilities fails with downloaded main.js
Hi, I've found a similar problem here: https://learn.microsoft.com/en-us/answers/questions/1483654/@microsoft-azure-data-factory-utilities-fails-to-d. My company's network is highly restricted, so the pipeline is not able to download the main.js…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
How to copy image from sqlserver in varbinary to Azure Blob storage using azure data factory
Hi all, “We are looking for a sample Copy Activity in Azure Data Factory to copy image data from Oracle/SQL databases into Azure Blob Storage as image files. The challenge we face is that when copying from relational databases, we are unable to perform a…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
In-place upgrade Windows Server 2022 → 2025 on Azure VM hosting Self-Hosted Integration Runtime (ADF) — impact on SHIR configuration/credentials?
We're planning an in-place OS upgrade of an Azure VM from Windows Server 2022 Datacenter to Windows Server 2025 Datacenter, following the documented procedure at learn.microsoft.com/en-us/azure/virtual-machines/windows-in-place-upgrade. Environment…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Join: Microsoft Azure Q&A Champions Program
The Microsoft Azure Q&A Champions Program recognizes and empowers a global community of internal and external Azure experts who help customers succeed by providing high-quality, trusted answers on Microsoft Q&A. The program scales expert led…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
@microsoft/azure-data-factory-utilities fails to download script from internet in securized private build agent
In this link (https://www.npmjs.com/package/@microsoft/azure-data-factory-utilities?activeTab=readme) it has been mentioned that the package @microsoft/azure-data-factory-utilities downloads a JavaScript (https://adf.azure.com/assets/cmd-api/main.js)…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
ADF Power Query cannot evaluate Azure SQL source with system-assigned managed identity
Issue In Azure Data Factory Power Query (Data Wrangling), an Azure SQL Database dataset cannot be evaluated in the Power Query Online editor. The following error is displayed: Credentials are invalid or missing, so this query could not be…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Example for Fabric Data Pipeline CICD with variable substitution.
Hi All, I am hoping someone can help me figure out how to implement CICD with connection substitution for a Fabric Data Factory pipeline. An example would be awesome - All I want to do is to promote a Data Factory pipeline to another environment and…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Trying to filter csv file based on content
I have an existing ADF pipeline that is creating an error due to some bad (or not acceptable data) displayed on the csv file. Basically, instead of having proper header on the first row with certain amount columns (with data), csv file displays data like…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Azure Data Factory Data Flow Trigger Runs Successfully but Source File Is Not Updated (Debug Works Fine)
We are currently experiencing an issue with Azure ADF data flows. While the data flow functions as expected in debug mode and correctly updates the storage file in sink, it fails to update the storage file when triggered, even though the logs indicate…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
ADF ODBC Linked Service Snowflake JWT key-pair connection string exceeds 1024-char limit secure workaround needed
Environment Azure Data Factory with Self-Hosted Integration Runtime Snowflake Reader Account owned by an external team (no CREATE STAGE permission available) Must use ODBC connector Snowflake V2 connector not viable because it requires COPY INTO and…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Azure Data Factory - self-hosted integration runtime - missing metrics in Data Factory (v2) overview
We just noticed, that the metrics from the self hosted integration runtime, like Integration Runtime CPU or Integration Runtime Memory are missing. The last metrics, we have are from Apr. 29 of this year (around 6:00 CEST) - before this time, we have…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
The specified network name is no longer available - error code - 22852
Hello Team, Today I faced an error, when i am trying to do test connection. Please resolved as soon as possible. I need to resolve please help me to resolve. 
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Vulnerable libcurl.dll detected in Microsoft Integration Runtime 5.0 bundled ODBC drivers - supported remediation?
Hello, Our security vulnerability scanner has identified vulnerable versions of libcurl.dll within the Microsoft Integration Runtime 5.0 installation directory: C:\Program Files\Microsoft Integration Runtime\5.0\Shared\ODBC Drivers\ We verified that the…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Azure Data Factory Private endpoint for Portal Endpoint
Hi Team, We are looking for recommendations and best practices around configuring the portal private endpoint for Azure Data Factory in a multi-VNET environment. Current setup: We have multiple ADF instances owned by separate teams. Each ADF has its…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Does Azure Data Factory support Federated Identity Credential / Workload Identity Federation for ADLS Gen2 linked services?
I am trying to validate whether Azure Data Factory supports a secretless cross-tenant authentication pattern using Federated Identity Credential / Workload Identity Federation. Scenario: We have an Azure Data Factory pipeline / Copy Activity that needs…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Can't reach Azure Data Factory
Hi I can't reach adf.azure.com. Clearing cache and cookies or changing to a different browser (Firefox, Chrome, Edge) on the same laptop doesn't work. I can still open the browser on my phone and access just fine. What am I missing?
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Certain Decimal values from Parquet file are returned as NULL in Data Flow
Hi, when reading a Parquet file in Data Flow, decimal values that exceed a certain size/precision are being returned as NULL instead of being correctly parsed. Example 72232493.28310600000000. The issue is not related to the sink or any downstream…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
ADF pipeline is failing while updating the single field COSMOS document
We have similar ADF pipelines in lower & Prod environments! But the pipeline is failing in PROD environment while updating the data to COSMOS document! Below is the error message it uses Dataflow to update: Operation on target…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
CLOUD_PROVIDER_RESOURCE_STOCKOUT (CLOUD_FAILURE)
I run a pipeline every hour, 24/7. Lately I have been receiving the CLOUD_PROVIDER_RESOURCE_STOCKOUT frequently during business hours.
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.