Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,150 questions
2 answers
Azure Data Factory many activities timeout
My ADF instances pipelines is on Queued status for a long time, and then timed out on the Script, Web and Azure Function activities. Is there some issues with ADF service?
Azure Data Factory
asked 2026-05-06T05:34:35.63+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(230.39999999999998, 85%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBT%3C/text%3E%3C/svg%3E)
Brian Toan
45
Reputation points
answered 2026-05-06T08:04:47.0966667+00:00
Brian Toan
45
Reputation points
1 answer
ADF Data Flow - toTimestamp() returning NULL on blob source filter
I am trying to read files from Azure Blob Storage using a Data Flow, and only read files modified since a date stored in a database. I am trying to use the following setting "Filter by last modified" to limit the time range: The source data…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,150 questions
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(176, 56.00000000000001%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECJ%3C/text%3E%3C/svg%3E)
1 answer
Timestamp being logged incorrectly some of the time.
I have an ADF pipeline that starts by writing utcnow to a string pipeline variable, then performs operations with assorted casts to different form factors with formatdatetime, including several script blocks that log to a snowflake log table, all based…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,150 questions
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(144, 96%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGR%3C/text%3E%3C/svg%3E)
0 answers
How to fix "Status code 400, "{"error":{"code":"InvalidSubscriptionId","message":"The provided subscription identifier 'resourceGroups' is malformed or invalid."}}""
While testing connectivity in Azure Data Factory (ADF), the dataset test connection succeeds, but the data flow test connection fails with the following error: Status code: 400 { "error": { "code":…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,150 questions
asked 2026-05-05T21:23:42.77+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(51.2, 5%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJV%3C/text%3E%3C/svg%3E)
Jaya Vardhani Mamidala
0
Reputation points Microsoft Employee
commented 2026-05-05T22:26:46.5066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(208, 49%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESJ%3C/text%3E%3C/svg%3E)
SAI JAGADEESH KUDIPUDI
2,625
Reputation points Microsoft External Staff
Moderator
1 answer
How to break ForEach loop in ADF
Hi everyone, I have a ForEach activity containing a Copy Data task. The Problem: By default, if one iteration fails, the ForEach continues to trigger all other iterations. In my case, if the first one fails, the following ones are guaranteed to fail as…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,150 questions
asked 2026-05-05T15:10:56.3066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(28.799999999999997, 41%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EF%3C/text%3E%3C/svg%3E)
Fasd
0
Reputation points
commented 2026-05-05T15:48:24.77+00:00
SAI JAGADEESH KUDIPUDI
2,625
Reputation points Microsoft External Staff
Moderator
3 answers
I could not connect to ADF. it is asking me to pay-as-you-go. previously with *******@gmail.com
Hi, I could not connect to ADF. it is asking me to pay-as-you-go. previously with ****@gmail.com , connected with other user . How could I use free . It is showing my one subscription and all. Even I closed that subscription also. I can not open other…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,150 questions
asked 2026-04-28T12:03:18.78+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(240, 33%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EUP%3C/text%3E%3C/svg%3E)
udaya P
0
Reputation points
answered 2026-05-04T15:57:24.7633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
35,045
Reputation points Microsoft External Staff
Moderator
2 answers
ADF pipeline succeeds but data is wrong - common patterns and how to catch them
Wanted to start a discussion around a category of ADF issues that I see repeatedly in production but rarely documented well. These are cases where the pipeline runs successfully with no errors, but the data loaded is incorrect. Examples include column…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,150 questions
asked 2026-04-28T18:07:17.42+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(48, 72%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECK%3C/text%3E%3C/svg%3E)
chandramouli kondamudi
0
Reputation points
answered 2026-05-04T15:56:01.7+00:00
Smaran Thoomu
35,045
Reputation points Microsoft External Staff
Moderator
3 answers
Why an activity was not triggered on the Failure of previous Web activity in ADF
My web activity, Get ChangeOrderRequest, is in a sequential ForEach Prime Contract activity and can fail with the message, "Item not found". I have a Set exit message variable activity to be executed upon failure of the Get ChangeOrderRequest…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,150 questions
asked 2026-04-27T15:00:54.9466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(38.4, 59%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDC%3C/text%3E%3C/svg%3E)
Deirdre Clark
30
Reputation points
commented 2026-05-03T10:05:10.21+00:00
SAI JAGADEESH KUDIPUDI
2,625
Reputation points Microsoft External Staff
Moderator
3 answers
how connect to a source system - SAP database?
how connect to a source SAP database?This project involves the migration of the existing data warehouse environment from Qlik to Microsoft Azure. The initiative aims to modernize the analytics platform by leveraging Azure’s scalable storage, compute, and…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,150 questions
asked 2026-04-15T09:42:26.0466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 63%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMA%3C/text%3E%3C/svg%3E)
Makama, ANTHEA (404)
0
Reputation points
commented 2026-05-03T09:25:55.75+00:00
SAI JAGADEESH KUDIPUDI
2,625
Reputation points Microsoft External Staff
Moderator
2 answers
Xero 2.0 ADF connector not supporting the same tables as Xero 1.0 connector
The Xero 2.0 connector in ADF no longer supports the ProjectTasks and Time tables while the Xero 1.0 connector does. This is also mentioned in the documentation: …
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,150 questions
asked 2026-03-25T12:25:27.0333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(48, 79%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMV%3C/text%3E%3C/svg%3E)
Michael van Leent
0
Reputation points
commented 2026-05-01T18:35:47.85+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 2%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMK%3C/text%3E%3C/svg%3E)
Manoj Kumar Boyini
13,930
Reputation points Microsoft External Staff
Moderator
2 answers
One of the answers was accepted by the question author.
Deleted DataFactory Trigger still executing daily for months after being disabled and deleted
We used to execute an SSIS package 2x daily on a Data Factory trigger that started an Integration Runtime, ran the package, and stopped the runtime. This was all supposedly disabled over a year ago. Today I accidentally found from the logs that the…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,150 questions
asked 2026-04-29T22:38:09.0666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(60.8, 6%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGR%3C/text%3E%3C/svg%3E)
Garrison Roberts
20
Reputation points
answered 2026-04-30T17:42:38.5133333+00:00
Garrison Roberts
20
Reputation points
0 answers
Join: Microsoft Azure Q&A Champions Program
The Microsoft Azure Q&A Champions Program recognizes and empowers a global community of internal and external Azure experts who help customers succeed by providing high-quality, trusted answers on Microsoft Q&A. The program scales expert led…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,150 questions
asked 2026-04-30T17:40:28.5+00:00
Ashley Swearingen
0
Reputation points Microsoft External Staff
Moderator
answered 2026-04-30T17:40:52.0933333+00:00
Q&A Assist
2 answers
Azure Data Factory: Managed Identity Authentication Support for Cosmos DB for MongoDB
We need to copy data from Azure Cosmos DB (for MongoDB) to Azure Data Explorer via Azure Data Factory using managed identity authentication for security compliance. Currently, it appears only connection string authentication is supported for Cosmos DB…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,150 questions
asked 2026-04-30T10:26:14.5166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(217.60000000000002, 28.999999999999996%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYE%3C/text%3E%3C/svg%3E)
Yakov Epelbaum
0
Reputation points Microsoft Employee
answered 2026-04-30T10:53:20.1766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 24%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPP%3C/text%3E%3C/svg%3E)
Pilladi Padma Sai Manisha
7,710
Reputation points Microsoft External Staff
Moderator
3 answers
One of the answers was accepted by the question author.
Azure Datafactory to Fabric Lakehouse Migration
We used to see a popup in Azure Data Factory about migration to Fabric Lakehouse, but that notification is no longer appearing. Could you let us know if the migration is still required? If so, is there a timeline for it? Attaching the screenshot of how…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,150 questions
asked 2026-04-22T09:57:27.6466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(236.8, 60%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EUS%3C/text%3E%3C/svg%3E)
USHA SREE GENJI (NON EA SC ALT)
20
Reputation points Microsoft Employee
accepted 2026-04-30T10:13:20.54+00:00
USHA SREE GENJI (NON EA SC ALT)
20
Reputation points Microsoft Employee
2 answers
SFTP Linked service using Public & Private Keys
Hello, Trying to create a SFTP linked service using " SSH Public key Authentication "and getting errors. One of the errors I am receiving is 'Invalid Sftp credential provided for 'SshPublicKey' authentication type.Invalid private key…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,150 questions
asked 2025-11-18T17:13:54.4733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(28.799999999999997, 90%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
Madhukar Muddasani
10
Reputation points
commented 2026-04-30T08:27:13.59+00:00
FlorisZ
26
Reputation points
2 answers
SftpFailedToConnectToSftpServer
I am having an issue with a client supplied SFTP account from within Data Factory, I am able to connect with the credentials via FileZilla locally, and with some C# code when deployed, but Data factory cannot create a valid connection to this AWS server.…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,150 questions
asked 2025-04-15T16:26:17.8066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 87%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDW%3C/text%3E%3C/svg%3E)
Daniel Woodhouse
0
Reputation points
answered 2026-04-29T10:41:10.2633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(9.6, 52%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESK%3C/text%3E%3C/svg%3E)
Senthil kumar
110
Reputation points
2 answers
The Validation Activity has a timeout of 13 hours, but i configured it to time out after 7 days in Blusehift Env.
The Validation Activity has a timeout of 13 hours, but i configured it to time out after 7 days in Blusehift Env.. this's my validation activity settings: { "dataset": { "referenceName": "DependencyPath_EU", …
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,150 questions
asked 2026-04-14T08:24:18.4766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(304, 6%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYB%3C/text%3E%3C/svg%3E)
Yang Bai
0
Reputation points Microsoft Employee
edited a comment 2026-04-29T05:38:57.18+00:00
Smaran Thoomu
35,045
Reputation points Microsoft External Staff
Moderator
1 answer
unable to see resources and pipelines
Hi Team, I want to see my old resources and all the azure data factories pipeline i created, but this time i am unable to see anything, suggest how to check those pipelines.
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,150 questions
asked 2026-04-28T15:09:01.5333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(121.6, 26%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVS%3C/text%3E%3C/svg%3E)
Vishal7 Sinha
0
Reputation points
commented 2026-04-29T03:18:22.5133333+00:00
Smaran Thoomu
35,045
Reputation points Microsoft External Staff
Moderator
2 answers
ADF ARM Template validation issue
I am getting error while running : run: | # node ./adf/node_modules/@microsoft/azure-data-factory-utilities/lib/index validate ./adf ${{env.RESOURCEID_DEV}} "message":"undefined not found in linked-service-registery"
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,150 questions
asked 2026-04-24T09:18:29.3766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(281.6, 35%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAK%3C/text%3E%3C/svg%3E)
Anju K Joy
0
Reputation points
commented 2026-04-28T17:49:47.2566667+00:00
Pilladi Padma Sai Manisha
7,710
Reputation points Microsoft External Staff
Moderator
2 answers
ADF delete activity failure because of storesettings
ADF delete activity fails with this error. It works fine in Debug mode, but fails in Trigger mode. We checked that the collaboration branch has the same changes as in adf_publish. So not sure why this fails. One observation is whenver we open the delete…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,150 questions
asked 2026-04-22T15:11:34.9733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 88%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Sarangarajan, Swathi SBOBNG-PTIY/EU/S
0
Reputation points
commented 2026-04-28T17:33:41.3233333+00:00
Pilladi Padma Sai Manisha
7,710
Reputation points Microsoft External Staff
Moderator