SQL Insert Query with Batch Processing

Owned by Pooja Yadav (Unlicensed), created
Last updated: Mar 10, 2022 by shreedutta.mukherjee (Unlicensed)
3 min read

 

Introduction

In this section of our documentation, the steps to configuring SQL insert queries with processing will be described.

Steps to configure

  1. Drag and drop the SQL task in the automation and click on it. The form below will appear on the right side of the screen.

  2. Add name and an appropriate description for reference.

  3. Select the connection that has been created for the SQL or create a new one from the plus button. Click here : to know how to create an SQL connection.

  4. Choose the type of query according to the action you are going to perform. Since this configuration deals with batch execution, you are supposed to choose the Insert query type.
    A check box named batch execution will appear next to the select connection input field. You can choose from the following query types:

    • Select: A Select statement retrieves zero or more rows from one or more database tables or database views.

    • Insert: The SQL Insert statement is used to add new rows of data to a table in the database.

    • Update: The use of update SQL queries in access databases is to add, change, or delete the information in an existing record.

    • Delete: The SQL Delete query is used to delete the existing records from a table. You can use the WHERE clause with a DELETE query to delete the selected rows, otherwise, all the records would be deleted.

  5. Add the desired query as per the requirement and click on the tick button to verify the query. A query is a request for data or information from a database table or combination of tables.

  6. Click on the check box and a new input field named batch data will appear on the screen.

  7. Now, feed the data into the batch data input field from the data slot. It should be an array type of data since you will be storing data in a sequence of consecutively numbered entries. Batch data pipelines are executed manually. In each run, they extract all data from the data source, apply operations to the data, and publish the processed data to the data sink. They are done once all data have been processed.

  8. Add the query as per the requirement. Then you should make sure that the query is written as per the batch data parameters as it is case-sensitive.

  9. Add the desired query as per the requirement and click on the tick button to verify the query. A query is a request for data or information from a database table or combination of tables.

  10. Once the written query is valid then click on save to save the configuration. In case of an error, correct the query and verify it again.