CodexBloom - Programming Q&A Platform

Azure Data Factory pipeline scenarios with 'scenarios to fetch metadata' when using on-premises data gateway

👀 Views: 1254 💬 Answers: 1 📅 Created: 2025-06-07
azure-data-factory on-premises-data-gateway integration-runtime json

I'm upgrading from an older version and I'm wondering if anyone has experience with I've been banging my head against this for hours. I'm working with an scenario with Azure Data Factory where my pipeline is failing with the behavior message 'Failed to fetch metadata' when trying to read data from an on-premises SQL Server using the self-hosted integration runtime. I have set up the self-hosted integration runtime correctly and can confirm that the integration runtime is online. The linked service configuration looks like this: ```json { "name": "AzureSqlLinkedService", "properties": { "type": "AzureSqlDatabase", "typeProperties": { "connectionString": "Server=myServer;Database=myDB;User Id=myUser;Password=myPassword;" } } } ``` In my pipeline, I have a Copy Data activity set up with this linked service, but when I run the pipeline, I keep getting the aforementioned behavior. I’ve verified the firewall settings on Azure SQL, and they allow connections from the IP of the integration runtime. I also tested the connection from the integration runtime configuration tool, and it succeeded. Additionally, I checked the logs in the Azure portal, and they indicate that there is a timeout while trying to fetch metadata. I've tried increasing the timeout settings in the integration runtime configuration, but that did not help. Is there a specific setting or configuration I might be missing? Also, should I be looking at network configurations or any authentication issues that could be causing this question? I'm working on a CLI tool that needs to handle this. Has anyone else encountered this? For context: I'm using Json on CentOS. Any advice would be much appreciated. This is part of a larger REST API I'm building. What would be the recommended way to handle this?