OCI Data Integration: best practices for 'Invalid Configuration: Missing Required Parameter' When Running Pipelines?
I've been researching this but I've been struggling with this for a few days now and could really use some help. I'm currently working on an OCI Data Integration pipeline that fetches data from an on-premises database and loads it into OCI Object Storage. I have set up the connectivity using the Data Integration service, but when I attempt to run the pipeline, I encounter the behavior: `Invalid Configuration: Missing Required Parameter`. I've double-checked my connections and mappings, and everything seems to be in order. Here’s a simplified version of my pipeline configuration: ```json { "source": { "type": "Database", "connection": { "host": "10.0.0.1", "port": 1521, "username": "user", "password": "password", "service_name": "orcl" } }, "destination": { "type": "ObjectStorage", "bucket": "my-bucket", "object_key": "data/output.json" }, "transformations": [ { "name": "TransformData", "type": "mapping", "mapping": { "source_fields": ["id", "name"], "destination_fields": ["ID", "Name"] } } ] } ``` In the configuration, I made sure that the source and destination types are correctly specified. I also verified that the field mappings are correct. However, the behavior continues. I reviewed the OCI documentation for Data Integration, but I could not find any insight into what might be causing this scenario. I’ve tried re-creating the pipeline and testing the connection independently, which works fine. I'm using the OCI Data Integration service version 21.4.0. Has anyone experienced a similar scenario or can provide suggestions on what I might be missing in the pipeline configuration? Any help would be greatly appreciated! Thanks in advance! Any feedback is welcome!