An Azure service for ingesting, preparing, and transforming data at scale.
I understand you're encountering issues connecting to the AWS-hosted SFTP server from Azure Data Factory. Since the credentials and connection work fine through FileZilla and C# code, but not through ADF.
For additional information, please refer: Troubleshoot the FTP, SFTP, and HTTP connectors in Azure Data Factory and Azure Synapse
Here are a few potential areas to troubleshoot.
Ensure Correct Linked Service Type - One possible cause could be using the FTP linked service instead of the SFTP linked service. Ensure you are using the SFTP linked service in your ADF configuration to connect to the SFTP server.
Check Concurrent Connection Limits - The error message might indicate that the SFTP server is throttling the connection due to multiple parallel requests from ADF. Try setting the maximum number of concurrent connections to 1 in the SFTP dataset and see if the issue persists. If this resolves the issue, the server might be limiting concurrent connections, and you can either contact the SFTP administrator to increase the limit or adjust your ADF setup accordingly.
Verify Network Access - If you're using a Self-hosted Integration Runtime (IR), ensure that the IP address of the machine hosting the IR is added to the SFTP server's allowlist. If you're using Azure IR, make sure that the appropriate Azure Integration Runtime IP addresses are allowed. If you don't want to add a range of IPs, using a Self-hosted IR can help since you control the IP address.
Verify Port Configuration - By default, SFTP uses port 22. Make sure the correct port is specified in your linked service configuration. If the server is using a non-standard port, ensure its configured accordingly in ADF.
For more details, please refer to the similar thread on Microsoft Q&A platform.
I hope this information helps. Please do let us know if you have any further queries.
Kindly consider upvoting the comment if the information provided is helpful. This can assist other community members in resolving similar issues.
Thank you.