The Oracle ADW Bulk Load feature typically refers to the ability to efficiently load large volumes of data into an Oracle ADW instance using specialized techniques to improve performance.
In this blog I will go over steps , how we setup an OIC orchestration that will invoke ADW Adapter with operation as Bulk Load.
First let's talk about some important features about ADW Bulk Load
High-Volume Data Loading: Oracle ADW Bulk Load is designed for scenarios where you need to load a large volume of data into your Autonomous Data Warehouse instance efficiently.
Performance Optimization: Bulk loading techniques are employed to optimize the data loading process. This includes methods such as direct path loading, parallel processing, and minimizing logging for faster inserts.
Minimized Resource Utilization: The bulk load feature aims to minimize resource utilization and maximize throughput during the data loading process.
Parallel Loading: Bulk loading often involves parallel loading, where multiple threads or processes are used to load data concurrently, speeding up the overall loading time.
Integration with OIC & ADW Adapter:
In the context of Oracle Integration Cloud, OIC ADW Adapter provides a set of pre-built, reusable connectors and components for interacting with Oracle ADW. The adapter is used within OIC integrations to facilitate seamless communication between different systems.
Feel free to reach us at email@example.com for any additional information on this Integration
Prerequisites for creating in OIC flow with ADW Adapter for Bulk Load:
- An Oracle Integration Cloud instance
- An Oracle Autonomous Transaction Processing (ADW) database
- A configured Oracle ATP Adapter connection within Oracle Integration Cloud
- A file containing the data to be loaded, in a supported format (CSV, XML, or JSON)
- An Oracle Object Storage bucket to temporarily store the file
Create an Integration:
- Access the Oracle Integration Cloud console.
- Create a new integration.
- Choose a trigger based on your needs (e.g., scheduled trigger for regular imports, or an HTTP trigger for on-demand imports).
Add Oracle ATP Adapter:
- Drag and drop the Oracle ADW Adapter onto the integration canvas.
- Select the "Perform Bulk Data Import Operations" operation.
Configure Source File:
- Specify the Object Storage bucket and file path where the data is located.
- If needed, use a mapper to transform the data format.
- Map the fields in the source file to the corresponding columns in the ADW database table.
- Ensure data types align correctly.
Specify Target Table:
- Provide the name of the ADW database table where you want to load the data.
Configure Security (if needed):
- While Configuring ADW Adapter connection in OIC , use JDBC With OCI Signature security policy, provide required details like compartment OCID and wallet password.
Deploy and Test:
- Save and deploy the integration.
- Test it to ensure successful data loading into the ATP database.
For Additional Details on how to setup Private keys refer https://blogs.oracle.com/integration/post/oci-signature-in-rest-adapter-for-oci-rest-apis