Share via

The Synapse job is stuck while reading a large number of ADLSv2 files

Xiwen Yue 0 Reputation points Microsoft Employee
2026-04-24T05:58:13.0533333+00:00

workspace: edp-synapse-cpccogs-prod

spark pool: cpccogs

SparkJobDefinition_412adb40-2985-4d64-93a4-e06e59bd9a2d; livy id: 4538

SparkJobDefinition_463e4caf-1a3e-4949-9fd3-330c0b343295;    livy id: 4539

SparkJobDefinition_c44c2572-ec4a-4478-90b7-4de8868afc5b;    livy id: 4540

SparkJobDefinition_200a6d9e-3bde-4516-af53-99c91653a4f9;    livy id: 4543

SparkJobDefinition_ab87f846-ee39-420a-b70a-d6defcd62bd5;   livy id: 4547

SparkJobDefinition_0c0ced71-26a3-4ddf-83f3-ee54b638ae4f;     livy id: 4548

SparkJobDefinition_e27ac75d-18a6-4963-a739-97b4aa7238b2   livy id: 4549

Our Synapse job is trying to access an ADLSv2 database containing approximately 3000 files, causing the Synapse job to frequently stuck during file reading.

Could you please help me find a solution?

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.