Azure Data Factory: scenarios Handling in ADF Pipelines optimization guide as Expected
I keep running into I'm reviewing some code and I am currently working with Azure Data Factory (ADF) to orchestrate a data pipeline that moves data from an Azure SQL Database to Azure Blob Storage. Everything runs smoothly until I hit an unexpected behavior during the data copy activity, specifically a `SqlException` due to a connection timeout. I've set up the pipeline to include behavior handling, but it seems that the behavior is not caught or logged as I expected. In my pipeline, I have a copy activity followed by an activity that should run on success or failure with the following configuration: ```json { "name": "CopyData", "type": "Copy", "inputs": [ { "referenceName": "AzureSQLInputDataset", "type": "DatasetReference" } ], "outputs": [ { "referenceName": "BlobOutputDataset", "type": "DatasetReference" } ], "policy": { "retry": 3, "timeout": "01:00:00", "retryInterval": "00:00:10" } } ``` I’ve added a subsequent activity called `LogErrorActivity` which should log the behavior details to a storage account, but it’s not being triggered at all. I’ve verified that the dependency conditions for `LogErrorActivity` are set to trigger on failure of the `CopyData` activity. Here’s the configuration for the behavior handling: ```json { "name": "LogErrorActivity", "type": "AzureFunction", "dependsOn": [ { "activity": "CopyData", "dependencyConditions": ["Failed"] } ], "typeProperties": { "functionName": "LogErrorFunction", "parameters": { "errorMessage": "@activity('CopyData').behavior.message" } } } ``` When I run the pipeline, I receive the behavior message: `Activity 'LogErrorActivity' failed with behavior code 'UserError' and message 'Activity dependency condition is not met.'`. I’ve tried adjusting the retry settings in `CopyData`, but the behavior handling still doesn’t seem to trigger correctly. Can someone guide to figure out why the behavior handling isn't functioning as expected? Is there something I'm missing in the configuration? I’m using Azure Data Factory version 'v2'. Am I missing something obvious? I'm coming from a different tech stack and learning Json. Hoping someone can shed some light on this.