How to use a Data List Command to load inputs URLs

Steps to create an agent using input csv file in the Data List command

1. Where to upload this file?

   • In Sequentum Cloud, navigate to the Agent Configuration → Files section within the agent editor. Upload the CSV file here to make it accessible for your agent.

2. How to create a CSV file to load multiple URLs?

   • Please prepare a CSV file with each URL listed in a separate row to ensure the agent can process them correctly.

3. How to configure the URL command to load the URLs?

   • In the agent editor, Use the "URL" command to access the URLs from your uploaded CSV file by using the "Data list" command.

Sequentum Cloud enables users to create agents that can efficiently handle multiple URLs by using an input CSV file. In this guide, we’ll walk through the steps to create an agent in Sequentum Cloud that uses a CSV file to load and process multiple URLs.

Below are the detailed Steps to upload an input CSV file using the Agent command:

Where to upload this file?

Step 1: Open the editor window and navigate to the Agent Configuration → Option → Files

Step 2: Next, click on the 'Upload File' option to begin the upload process. In the given  example, we are uploading the csv file Test_InputFile.csv

Step 3: After uploading the CSV file, click on the 'Extract' icon as shown below to proceed. This will open a list of commands

How to use an input CSV file to load multiple URLs?

Step 4: Next, select the 'Data List' command as shown below…

Step 5: After adding the 'Data List' command, navigate to the 'List' option.

Step 6:  Select 'Data Type' as CSV from the dropdown and then choose 'Data Source' as 'Private File'. Once 'Private File' is selected, the uploaded CSV file will appear in the text box below the 'Data Source' dropdown.

Step 7: Next, navigate to the Command panel and click on the 'Browser' icon as shown below.

How to configure the URL command to load the URLs?

Step 8: In the Browser group command, click on the 'URL' command and add it under the 'Data List' command.

Step 9: After adding the 'URL' command, navigate to the 'URL' option and select 'Data List' from the ‘URL’ dropdown menu.

Step 10:  After selecting the 'Data List' option from the URL dropdown, click on the 'Data List' command as shown below.

After selecting the 'Data List' command, the input will be displayed as shown below:

Note:

Additionally, you can generate the agent in text format by clicking on the 'Text' option in the right panel, as shown below.

This text format can be saved locally by clicking the option available at the bottom.

Sample text format:

Agent:

Agent:
    Proxies:
        Proxy Pool: Sequentum Data Center
    Commands: Data List
        CSV:
            Source: Private File
            Path: Test_InputFile.csv
        Commands: URL
            Input:
                Command: Data List
                Data Field:
    Export:
        Commands: CSV

Conclusion

Sequentum Cloud ability to use input CSV files in the URL command significantly enhances the flexibility and efficiency of agent creation. By following the steps outlined in this guide, users can configure agents to handle multiple URLs dynamically, streamlining their data extraction or automation tasks. Whether you're working with a handful or a large number of URLs, this feature ensures that your agents remain adaptable and scalable to meet your needs.