--- language: "en" --- # Sequentum Cloud Knowledge Base FAQ ## **Find answers to questions** * [Overview](https://cloudsupport.sequentum.com/scfaq/overview.md) * [Account Creation/Editing/Deletion](https://cloudsupport.sequentum.com/scfaq/account-creation-editing-deletion.md) * [Using Sequentum Cloud Editor to build Online Agents](https://cloudsupport.sequentum.com/scfaq/using-sequentum-cloud-editor-to-build-online-agent.md) * [Agent Control Center, Proxies, and APIs](https://cloudsupport.sequentum.com/scfaq/agent-control-center-proxies-and-apis.md) * [Organizations and Users](https://cloudsupport.sequentum.com/scfaq/organizations-and-users.md) * [Billing and Usage Tracking](https://cloudsupport.sequentum.com/scfaq/billing-and-usage-tracking.md) * [Moving from SE to SC](https://cloudsupport.sequentum.com/scfaq/moving-from-se-to-sc.md) * [Online support and training](https://cloudsupport.sequentum.com/scfaq/online-support-and-training.md) * [Why we built Sequentum Cloud](https://cloudsupport.sequentum.com/scfaq/why-we-built-sequentum-cloud.md) Common Support Queries * [How to use a Data List Command to load inputs URLs](https://cloudsupport.sequentum.com/scfaq/how-to-use-a-data-list-command-to-load-inputs-urls.md) * [How to use specific features and commands of SE in Sequentum Cloud](https://cloudsupport.sequentum.com/scfaq/how-to-use-specific-features-and-commands-of-se-in.md) * [Agent Creation with Sequentum Cloud Using set of inputs containing Multiple URLs](https://cloudsupport.sequentum.com/scfaq/agent-creation-with-sequentum-cloud-using-set-of-i.md) * [How to use a Data List Command to load inputs URLs using Scripts](https://cloudsupport.sequentum.com/scfaq/how-to-use-a-data-list-command-to-load-inputs-ur-1.md) * [How to use a Data List Command to load inputs URLs using shared file](https://cloudsupport.sequentum.com/scfaq/how-to-use-a-data-list-command-to-load-inputs-ur-2.md) * [How to use List Command to Navigate URLs and Capture Data Efficiently](https://cloudsupport.sequentum.com/scfaq/how-to-use-list-command-to-navigate-urls-and-captu.md) * [How to Download DOC Files Using **File Link**command in Sequentum Cloud?](https://cloudsupport.sequentum.com/scfaq/how-to-use-download-command-to-download-the-doc-fi.md) * [How to Capture Text from Audio Streams](https://cloudsupport.sequentum.com/scfaq/how-to-capture-text-from-audio-streams.md) * [How to Scroll a Webpage from Top to Bottom](https://cloudsupport.sequentum.com/scfaq/how-to-scroll-a-webpage-completely-from-top-to-bot.md) * [How to Capture text from Captcha Image](https://cloudsupport.sequentum.com/scfaq/how-to-capture-text-from-captcha-image.md) * [How to Import External Agent Text into Personal or Other Spaces](https://cloudsupport.sequentum.com/scfaq/how-to-import-external-agent-text-into-personal-or.md) * [How to use DataTables, similar to CustomDataStorage in Sequentum Enterprise?](https://cloudsupport.sequentum.com/scfaq/how-to-use-datatables-similar-to-customdatastorage.md) --- language: "en" --- # Account Creation/Editing/Deletion * **How do I register for an account on Sequentum Cloud?** * Go to the registration page and fill out the form to request an account. Due to high demand, we are putting all new account requests onto a waiting list. We will review your request and respond when we are able to remove you from the waitlist and approve your account. * **How long does it take to get off the waiting list?** * It may take up to a week or more to approve new account requests at this time. If you have submitted a request and are still waiting, please email [cloud.support@sequentum.com](mailto:cloud.support@sequentum.com) for an update on your position in the waitlist. * **What do I get with my account?** * When your account is approved you will be invited to sign in to Sequentum Cloud. Your account comes with full access to the Sequentum Cloud Editor, which allows you to create online agents to gather data from websites. You also get access to the Cloud Control Center where you can deploy and monitor your agents while they run. All accounts come with an initial $5.00 worth of credit that you can use to test run your agents. When the $5.00 of credit is used up, you will need to purchase additional credit to continue to run any agents that you have created. --- language: "en" --- # Agent Control Center, Proxies, and APIs * **Can I schedule an agent to run automatically?** * Yes! Once you have built and tested an agent, you will Publish the agent to the Control Center, where you will be able to set up a schedule and run your agent automatically. See [Scheduling the Agent](https://cloudsupport.sequentum.com/scm/build-your-first-agent-overview#BuildYourFirstAgentOverview-SchedulingtheAgent) for more information. * **How do I know what my agent did? Was the run successful, or did it fail?** * The Control Center is the part of Sequentum Cloud that provides a view of all your agents. You can see the status of the latest run, as well as drill into the full run history of each agent. See [Sequentum Cloud Control Center](https://cloudsupport.sequentum.com/scm/sequentum-cloud-control-center) for details. * **How do proxies work in Sequentum Cloud?** * A proxy (or proxy server) is an intermediary between a user's device and the internet, acting as a gateway that allows users to access websites or services indirectly by routing their requests through the proxy. The user's actual IP address is replaced by a proxy or a list of proxies, which can be rotated with each page load based on the user's requirements. All agents that are running on Sequentum Cloud will be using one of the two types of proxy service that we offer. Our standard proxy is a Data Center Proxy. This is a pool of IP addresses associated with a data center. These IPs can be rotated, but they can be identified and blocked by sites that are trying to prevent web scraping. If you find that you need a higher level of proxy service, you can switch to our Residential Proxy service. A residential proxy pool consists of a wide array of residential IP addresses that can be rotated to help avoid blocking. The residential proxy service is a premium service with associated higher costs. * **What APIs does Sequentum Cloud offer?** * Sequentum Cloud offers various API services that help users integrate and interact with their agents seamlessly, without going through the Sequentum dashboard. Please refer to the link below to know more about cloud API's [Sequentum Cloud API's](https://cloudsupport.sequentum.com/scm/sequentum-cloud-api-usage) --- language: "en" --- # Agent Creation with Sequentum Cloud Using set of inputs containing Multiple URLs **Steps to create an agent using a manually entered input list as the data source in the Data List Command** 1. Where to use this list? * In Sequentum Cloud, navigate to the **Data List\>\>List** section within the agent editor. Use the input list here to make it accessible for your agent. 2. How to create a Simple input list with multiple URLs? * Please prepare a text file with each URL listed in a separate row to ensure the agent can process them correctly. 3. How to configure the URL command to load these inputURLs? * In the agent editor, Use the "URL" command to access the URLs from your input list by using the "Data list" command. Below are the detailed Steps to use simple input list with multiple Urls using the Data List command: **Step 1:** Open the editor window and navigate to the Data List command under the agent command as Extract \>\> Data List \>\> List ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXf5Ha-b62O5oHzmGb0sLgty9tax_FaIACrQOPBzoW-SK9UXJiXFQtldEtM2Od5qE_M3LOfMrfU0unAdA1GQt2Uv2BhaTlc0OUlBySVncK9Hpa5qnClQexP-azXFNj_R1xsHkt_E95pFWtnf1GNBHJRoXq4z?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXf5Ha-b62O5oHzmGb0sLgty9tax_FaIACrQOPBzoW-SK9UXJiXFQtldEtM2Od5qE_M3LOfMrfU0unAdA1GQt2Uv2BhaTlc0OUlBySVncK9Hpa5qnClQexP-azXFNj_R1xsHkt_E95pFWtnf1GNBHJRoXq4z?key=_rUX5Em7UEL73gX9z6WCeA) ## **Where to use this list?** **Step 2:** Next, navigate to the 'List' option and select 'Data Type' as 'List' and 'Data Source' as 'Manual.' Manually enter the input list with multiple URLs by copying and pasting them, then save the changes using the 'Save Options' at the bottom of the page. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXeO0K10AiG77CcQq5vZElEqciAo_CgGrEKmHcVNL3xc2YreZcqHlJCS6FOqoHABdfA89wZvzJNIoh8YwB74_KkVl9cEYn6DrUpxJo99RffhwQ0doMuVjOkrmk6GcRuLbRtZr1-A9eXyCj_oGikW_2RwrRk?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeO0K10AiG77CcQq5vZElEqciAo_CgGrEKmHcVNL3xc2YreZcqHlJCS6FOqoHABdfA89wZvzJNIoh8YwB74_KkVl9cEYn6DrUpxJo99RffhwQ0doMuVjOkrmk6GcRuLbRtZr1-A9eXyCj_oGikW_2RwrRk?key=_rUX5Em7UEL73gX9z6WCeA) ### **How to configure the URL command to load these input URLs?** **Step 3:** Next, in the Browser group command, click on the 'URL' command and add it under the 'Data List' command. **Step 4:** After selecting the 'Data List' option from the URL dropdown, click on the 'Data List' command as shown below. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXezRCoxheYdQo1VTolNK0Uf0UV0zfuEzBwbj8WfFp_UlgkSl4V-5M9-AFC-izNmnEMhW6NqbU1vG4BDeQVaG6SxPPPiy2UEZjGP6gCNHv8kGFuDgqJGKb0XzD9LjxTABZ8HkmK0HR2yqJNFAZrelz-CzTf3?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXezRCoxheYdQo1VTolNK0Uf0UV0zfuEzBwbj8WfFp_UlgkSl4V-5M9-AFC-izNmnEMhW6NqbU1vG4BDeQVaG6SxPPPiy2UEZjGP6gCNHv8kGFuDgqJGKb0XzD9LjxTABZ8HkmK0HR2yqJNFAZrelz-CzTf3?key=_rUX5Em7UEL73gX9z6WCeA) After selecting the 'Data List' command, the input will be displayed as shown below: ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXd0fODZivou1gZ3cUeSzz9X6HPMyQJOJhsLe2Ue6fG2ci2sZrracjVR7hoMLXh1__MgwbqwRHm8gztkrnJ3486i5ewG0pZSJ6xV0tQSbrLxrL3-yR4fs9UHIadJhSBfSvuVG5VkRTVg7R7cYcAUOjlPhGOD?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXd0fODZivou1gZ3cUeSzz9X6HPMyQJOJhsLe2Ue6fG2ci2sZrracjVR7hoMLXh1__MgwbqwRHm8gztkrnJ3486i5ewG0pZSJ6xV0tQSbrLxrL3-yR4fs9UHIadJhSBfSvuVG5VkRTVg7R7cYcAUOjlPhGOD?key=_rUX5Em7UEL73gX9z6WCeA) **Note:** You can generate the agent in text format by clicking on the 'Text' option in the right panel, as shown below. This text format can be saved locally by clicking the option available at the bottom. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfS8dAPYDvNGhKK-5YbmiwDZEugmVG2rjKqJ0ACxhmjuDQrwjKEAfcXkA8KIzQxfuLlaza4jilfyaXdCSDARm1VVx_Aj7l3UJ-4-YFOJguPeyD9VCkM2POiR7UpEO-8knmNKaZnW3gRnEPI493FB974HGA?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfS8dAPYDvNGhKK-5YbmiwDZEugmVG2rjKqJ0ACxhmjuDQrwjKEAfcXkA8KIzQxfuLlaza4jilfyaXdCSDARm1VVx_Aj7l3UJ-4-YFOJguPeyD9VCkM2POiR7UpEO-8knmNKaZnW3gRnEPI493FB974HGA?key=_rUX5Em7UEL73gX9z6WCeA) > Agent: > Proxies: > Proxy Pool: Oxylabs_149.36.13.x > Commands: Data List > List: > Manual Value:> > https://en.wikipedia.org/wiki/Bangalore > https://en.wikipedia.org/wiki/Hyderabad > https://en.wikipedia.org/wiki/Surat > https://en.wikipedia.org/wiki/Nagpur > https://en.wikipedia.org/wiki/Bhopal > https://en.wikipedia.org/wiki/Patna > https://en.wikipedia.org/wiki/Vadodara > Commands: URL > Dynamic Load: > Timeouts: > Discover Activity: 3 > Input: > Command: Data List > Commands: Content > Name: City Name > Extract: //span[@class='mw-page-title-main'] > Export: > Commands: CSV --- language: "en" --- # Billing and Usage Tracking * **How much does Sequentum Cloud cost?** * You can create an account on Sequentum and get started for free, with a $5.00 credit toward running your agents. Costs are determined by the resources that your agent will use when it is run. There are a few different factors in the cost: * Runtime per hour * Data export per GB * Proxy usage * Each of the above has a base price that is determined by our tiered pricing on the [Sequentum Cloud](https://www.sequentum.com/cloud) product page. The pay-as-you-go tier does not require an up-front annual commitment, but the usage prices are higher. If you make an annual commitment and move up to the Starter, Advanced, or Enterprise tier, you per-unit usage prices go down. * **Why do I have to buy credits in advance?** * This is to protect you from incurring unwanted costs. When you buy credits in advance, they are consumed when your agent runs. If your agent starts to run longer than you expected, or to use more resources than you budgeted for, then the agent will stop when your credit runs out rather than continuing to run and adding to your bill. * **How do I know how much I have spent on my agents?** * Click on the Usage link under Your Account on the bottom left of the Control Center. --- language: "en" --- # Common Support Queries * [How to use a Data List Command to load inputs URLs](https://cloudsupport.sequentum.com/scfaq/how-to-use-a-data-list-command-to-load-inputs-urls.md) * [How to use specific features and commands of SE in Sequentum Cloud](https://cloudsupport.sequentum.com/scfaq/how-to-use-specific-features-and-commands-of-se-in.md) * [Agent Creation with Sequentum Cloud Using set of inputs containing Multiple URLs](https://cloudsupport.sequentum.com/scfaq/agent-creation-with-sequentum-cloud-using-set-of-i.md) * [How to use a Data List Command to load inputs URLs using Scripts](https://cloudsupport.sequentum.com/scfaq/how-to-use-a-data-list-command-to-load-inputs-ur-1.md) * [How to use a Data List Command to load inputs URLs using shared file](https://cloudsupport.sequentum.com/scfaq/how-to-use-a-data-list-command-to-load-inputs-ur-2.md) * [How to use List Command to Navigate URLs and Capture Data Efficiently](https://cloudsupport.sequentum.com/scfaq/how-to-use-list-command-to-navigate-urls-and-captu.md) * [How to Download DOC Files Using File Link command in Sequentum Cloud?](https://cloudsupport.sequentum.com/scfaq/how-to-use-download-command-to-download-the-doc-fi.md) * [How to Capture Text from Audio Streams](https://cloudsupport.sequentum.com/scfaq/how-to-capture-text-from-audio-streams.md) * [How to Scroll a Webpage from Top to Bottom](https://cloudsupport.sequentum.com/scfaq/how-to-scroll-a-webpage-completely-from-top-to-bot.md) * [How to Capture text from Captcha Image](https://cloudsupport.sequentum.com/scfaq/how-to-capture-text-from-captcha-image.md) * [How to Import External Agent Text into Personal or Other Spaces](https://cloudsupport.sequentum.com/scfaq/how-to-import-external-agent-text-into-personal-or.md) * [How to Export an Agent text file](https://cloudsupport.sequentum.com/scfaq/how-to-export-an-agent-text-file.md) * [How to use DataTables, similar to CustomDataStorage in Sequentum Enterprise?](https://cloudsupport.sequentum.com/scfaq/how-to-use-datatables-similar-to-customdatastorage.md) --- language: "en" --- # FAQ ## **Find answers to questions** * [Overview](https://cloudsupport.sequentum.com/scfaq/overview.md) * [Account Creation/Editing/Deletion](https://cloudsupport.sequentum.com/scfaq/account-creation-editing-deletion.md) * [Using Sequentum Cloud Editor to build Online Agents](https://cloudsupport.sequentum.com/scfaq/using-sequentum-cloud-editor-to-build-online-agent.md) * [Agent Control Center, Proxies, and APIs](https://cloudsupport.sequentum.com/scfaq/agent-control-center-proxies-and-apis.md) * [Organizations and Users](https://cloudsupport.sequentum.com/scfaq/organizations-and-users.md) * [Billing and Usage Tracking](https://cloudsupport.sequentum.com/scfaq/billing-and-usage-tracking.md) * [Moving from SE to SC](https://cloudsupport.sequentum.com/scfaq/moving-from-se-to-sc.md) * [Online support and training](https://cloudsupport.sequentum.com/scfaq/online-support-and-training.md) * [Why we built Sequentum Cloud](https://cloudsupport.sequentum.com/scfaq/why-we-built-sequentum-cloud.md) --- language: "en" --- # How to Capture Text from Audio Streams Capturing text from audio streams can be a crucial part of data processing and automation workflows. This guide walks you through the steps to achieve this using built-in commands and configurations. **Overview** This process involves downloading audio streams, converting speech to text, and extracting the transcribed content for further use. Follow the steps below to capture and process text from audio streams efficiently. **Step 1:** Download the Audio Stream * Add a URL command: Use the **URL**Command to download the audio file from a specified URL. * Enable Audio Capture: ![image-20260404-181555.png](https://cloudsupport.sequentum.com/__attachments/a_55f2a827b980c9928a12b220cd7b01f7721f9465f546d0813c7f3506e76b43a0/image-20260404-181555.png?cb=6f54957d6b334965ef281a26a6ae6394) * Check the Capture Audio Stream option in the command properties. * Specify the audio format (e.g., .mp3, .wav). * Optionally, set the duration of silence (in seconds) to automatically stop the recording. **Step 2:** Convert Audio to Text * Add a Content Converter Command: * Use the **Content Converter** to process the downloaded audio. * Select **Voice to Text** as the converter type. * Choose a CAPTCHA Service Provider: * Pick a provider and configure its API for speech-to-text conversion. ![VoiceToText-Converter-Settings.png](https://cloudsupport.sequentum.com/__attachments/a_0a99decec7faf17acd0d500df6298ee3d4207f4d24ae9840329f89d71515208c/VoiceToText-Converter-Settings.png?cb=f196207584668c1084d26522fe90066a) **Step 3:**Input the Downloaded Audio File * Use the Arguments field to specify the audio file for transcription. * Reference the downloaded file using ${Captured File}(refer above snapshot) **Step 4:** View the Converted Text * Add a **Data Value** Command: * Configure the command to access the transcribed text. * Set **Data** to **Action Result** and choose**Converted Value** to extract the output. This streamlined process enables you to efficiently capture text from audio streams and integrate the transcription into your workflows. In order to get/view the converted text, one needs to add a [Data Value](https://cloudsupport.sequentum.com/scm/data-value.md) command and need to select the [**Action Result**](https://cloudsupport.sequentum.com/scm/input-action.md) in the **Data** drop down and use the **Converted Value** in the following field. ![Data-Value-Input-ImageToText.png](https://cloudsupport.sequentum.com/__attachments/a_fa197b11c86c21445cfb466dcde809ce2bc77e467229cd11fb5a1614457f759d/Data-Value-Input-ImageToText.png?cb=155eb4149a1805386f56abc42ebb89da) --- language: "en" --- # How to Capture text from Captcha Image Capturing text from captcha images can be a crucial part of data processing and automation workflows. This guide walks you through the steps to achieve this using built-in commands and configurations. **Overview** This process involves downloading captcha image, converting image to text, and extracting the transcribed content for further use. Follow the steps below to capture and process text from image efficiently. **Step 1:** Download the Captcha Image * Add a URL command: Use the **URL**Command to load a specified URL. ![image-20260404-144717.png](https://cloudsupport.sequentum.com/__attachments/a_44a3bf8a655c1bbb4311ab8c9a124f655e7b4b9caf574d80b7805f57e7b0d3d3/image-20260404-144717.png?cb=7b347883e884854731326931feea7ab8) Captcha image Sample * Now select the captcha Image and click on the Image icon as shown below and it will add the command under the url command. ![image-20260404-144614.png](https://cloudsupport.sequentum.com/__attachments/a_f9aa2f0a859d21515a34181a3590f47c86fe70b25625ec7ffffa1f7b9c938848/image-20260404-144614.png?cb=d2bcc991a9b1cb0c9fd7d9deb7957130) Captcha image selection **Step 2:** Now add the convert content commandto process the captcha image and select **Image To Text** as the converter type from the dropdown menu. **Step 3:**Choose a CAPTCHA Service Provider from the dropdown menu and configure its API for image-to-text conversion as shown in the screenshot below - ![image-20260404-144759.png](https://cloudsupport.sequentum.com/__attachments/a_a3527fa06aae5e2d07534f65e597877aec68f5a217ab789d911e213c3e7071fb/image-20260404-144759.png?cb=989fd466627a1fe2a6d6628f7f5b38ca) Convert content options **Step 4:**Next to add the Captcha Input command to enter the converted value in input box as shown below - ![image-20260404-144830.png](https://cloudsupport.sequentum.com/__attachments/a_c0ca02b849acfc9c1db281e6c06bfc665cbb98c93dffba5e8f5e16e55414e58b/image-20260404-144830.png?cb=68d3126106530ba77b8ceae3a0351371) Capture captcha In order to get/view the converted text, one needs to add a **Data Value** Captcha Input command and need to select the Input Action **Action Result** in the **Input** drop-down menu and use the **Converted Value** in the following field. ![image-20260404-144857.png](https://cloudsupport.sequentum.com/__attachments/a_2adaac7a23b192787c9b3ab95f0b850f54e76496093f044316624496172a17de/image-20260404-144857.png?cb=8650e61dd7f6a027f0856a915f71f1c2) Capture input options **Step 5:**After that, add the Submit Action command to finalize the capture text from captcha image process. **Note:**Additionally, you can generate the agent in text format by clicking on the 'Text' option in the right panel. This text format can be saved locally by clicking the option available at the bottom. Agent: Proxies: Run Without Proxies: true Commands: URL Dynamic Load: Timeouts: Discover Activity: 1 Input: https://training.sequentum.com/captcha/captchaimageiframe Commands: - File Link: Captcha Image Extract: //img\[@id='captcha-image'\] Attribute: Image URL - Convert Content: Convert Content Converter: Image To Text Provider: Two CAPTCHA Key: 83i17UfwjmsldfGuSbmG+YfjJSIQOmprZyjzTmz636KNs8+x9x1C0L0JvL71cg6Wo92wRWgj4y9eA4i+Po7FMg== Arguments: File: ${Captcha Image} Lang: en CaseSensitive: true Commands: Input Action Name: Captcha Input Input: Result Value: Converted Value Select: //input\[@id='captcha-input'\] Dynamic Load: Timeouts: Discover Activity: 1 Discover First Activity: 1 Commands: Action Name: Submit Action Select: //button\[@class='btn btn-primary'\] Dynamic Load: Timeouts: Discover Activity: 1 Discover First Activity: 1 Commands: Content Name: Submit Extract: //button\[@class='btn btn-primary'\] Export: Commands: CSV --- language: "en" --- # How to Export an Agent text file By utilizing exporting agents, users can effortlessly and efficiently transfer web data extraction agents across various machines, enhancing their workflow and maximizing productivity. There are several methods to do this: 1. Save to File option 2. Manually copying agent text into a .txt file **Method 1: Save to File Option** The Sequentum Cloud editor includes a feature that lets you share an agent by saving it as a simple, ready-to-share text file. To generate this file, follow these steps: **Step 1:** Log in to and open the agent that needs to be exported. Navigate to the **Text** tab present in the right panel. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXc8fUyrwz-1Ru2nLUJ3hhjuDFhH2PQN84szRZpXN9T9vBkuEpmLbkKUouIP7XXt6I84oHk8N320SGuEFAk4U7xDEU0rlzUIauYoeJhfD6avjhPN6tetEqFM_iryMWr1M4ACOyU?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXc8fUyrwz-1Ru2nLUJ3hhjuDFhH2PQN84szRZpXN9T9vBkuEpmLbkKUouIP7XXt6I84oHk8N320SGuEFAk4U7xDEU0rlzUIauYoeJhfD6avjhPN6tetEqFM_iryMWr1M4ACOyU?key=jOQaYoaNITRy4hsSofPW4Q) **Step 2:** We will see the nested text for the agent, select the **Save to File** option present at the bottom, as shown in the screenshot above. **Step 3:** A directory window will open, allowing the user to choose the path where they want to place the agent export file. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfpuTi3-MaZfSKFiYiZfQhLoq48RsEfz9B0kOAHjyiLI-6iFBjm5dYS4SlQ5kdRhM8erZOu68IS54gukx4JmbqQ1ukxzBxS4foaZuVngFoi4eHGtNkPtC6H0CMGDOhzTs_dsjMT?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfpuTi3-MaZfSKFiYiZfQhLoq48RsEfz9B0kOAHjyiLI-6iFBjm5dYS4SlQ5kdRhM8erZOu68IS54gukx4JmbqQ1ukxzBxS4foaZuVngFoi4eHGtNkPtC6H0CMGDOhzTs_dsjMT?key=jOQaYoaNITRy4hsSofPW4Q) **Step 4:** Choose the preferred directory and click the **Save** button. The agent export file will be successfully saved. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXeP7qVDwxG9wzi1VwsuVtIBdxGNl24H-NNYHEEenK6rEdboEmwoqhyzHx7aChGJcXjqBUp8Be0qdddTZM1fTsIBDSv2Uevu9LmwXoRJgNwtFWNQEa4Hwrtpshpse4sKaA0YIgAH?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeP7qVDwxG9wzi1VwsuVtIBdxGNl24H-NNYHEEenK6rEdboEmwoqhyzHx7aChGJcXjqBUp8Be0qdddTZM1fTsIBDSv2Uevu9LmwXoRJgNwtFWNQEa4Hwrtpshpse4sKaA0YIgAH?key=jOQaYoaNITRy4hsSofPW4Q) **Method 2: Manually Copying Agent Text into a .txt File** To export the agent user can manually copy the agent text and save it into a `.txt` file. Below are the steps for the same: **Step 1:** Log in to and open the agent that needs to be exported. Navigate to the **Text** tab present in the right panel. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdQi05pfCfOic9bpvpvuR9kvU2gtxPiMd1G6ClTp9YAMiMdUKxntTnvgf7hMMDLegIVcEPhPt4VS-Xflj9fkicwKV6g77qbnY4Tf1lAMO2j5qEY3DUe8RwLs5QGaWMrEEWoqAc?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdQi05pfCfOic9bpvpvuR9kvU2gtxPiMd1G6ClTp9YAMiMdUKxntTnvgf7hMMDLegIVcEPhPt4VS-Xflj9fkicwKV6g77qbnY4Tf1lAMO2j5qEY3DUe8RwLs5QGaWMrEEWoqAc?key=jOQaYoaNITRy4hsSofPW4Q) **Step 2:** Select all the agent text using the keyboard shortcut **Ctrl+A**. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXceEsgMhrdEyPBRyLOMPPj2cn6b7eCnsCpfC4trAd9JzQ9uktSZaXaCshXfC3CiLO6ChxXlaHZvEbXC0MAxgg9vG_KSbarDinzX68V76TXG63r898LpX30mgMwFt3qlMI1z1Bo?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXceEsgMhrdEyPBRyLOMPPj2cn6b7eCnsCpfC4trAd9JzQ9uktSZaXaCshXfC3CiLO6ChxXlaHZvEbXC0MAxgg9vG_KSbarDinzX68V76TXG63r898LpX30mgMwFt3qlMI1z1Bo?key=jOQaYoaNITRy4hsSofPW4Q) **Step 3:** To copy the selected text, use the keyboard shortcut **Ctrl + C**. **Step 4:** Open a text editor on your system, such as Notepad or Notepad++, and paste the copied text using the **Ctrl+V** shortcut. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcL9Cs4p71FmzfrgMZgn9yE7tTb_wnuwSPRdddWjOYxWzDgypZXYAMay3qJ_2_qNNJS5-rSD27Gbecp3OAtNQ-PgcIfzwNZFKuU6N52yzP76VQxzkPK7BTVCfIKpPVpnDjQ0MKP?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcL9Cs4p71FmzfrgMZgn9yE7tTb_wnuwSPRdddWjOYxWzDgypZXYAMay3qJ_2_qNNJS5-rSD27Gbecp3OAtNQ-PgcIfzwNZFKuU6N52yzP76VQxzkPK7BTVCfIKpPVpnDjQ0MKP?key=jOQaYoaNITRy4hsSofPW4Q) **Step 5:** Please save the file with a suitable name, for example: **\.txt.** ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXejl3rSaqY9jGo0_E-lxtVLV0LyelG2P4vhGApKNmu4XJMmS5_WB8S_lfAXWi0yqNGxZ86-NH9X-dsUAoD6QwSsb4VivE6rjnhAfpxOaKBfRXXk793ymUbrRT455ZRy7E3W3TOM?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXejl3rSaqY9jGo0_E-lxtVLV0LyelG2P4vhGApKNmu4XJMmS5_WB8S_lfAXWi0yqNGxZ86-NH9X-dsUAoD6QwSsb4VivE6rjnhAfpxOaKBfRXXk793ymUbrRT455ZRy7E3W3TOM?key=jOQaYoaNITRy4hsSofPW4Q) This file can be used to create an agent and can be imported into the Control Center. --- language: "en" --- # How to Import External Agent Text into Personal or Other Spaces In Sequentum Cloud, users have the ability to import an external agent into either their personal space or a newly created space. This feature allows users to integrate existing agent configurations seamlessly into their workspace. To complete this process, users need an agent text file, which contains the necessary details of the external agent. **Step 1:** Navigate to any space (Personal Space or Create any new space) **Step 2:** Now click on the **New Agent** drop down menu list and select the option **New Shared File** as shown below- ![image-20260404-143502.png](https://cloudsupport.sequentum.com/__attachments/a_c1e85dc9da605ab14e346290b0393f7478a81e176e3f85e56f04b82db790eadb/image-20260404-143502.png?cb=2e58fa007d0ae361c531b2b50d770aa8) Option in UI **Step 3:** It will open the Create Shared File as below- ![image-20260404-143712.png](https://cloudsupport.sequentum.com/__attachments/a_b392c1147a4f8c07ccb0e56fa35dc64c782ea53f049ff4bcbbe4703539af90e2/image-20260404-143712.png?cb=957438907b41adbe5d34a52dc7a5b5db) Upload window **Step 4** : Click on **Upload File** option and select the file from local system and Click on **Upload** button ![image-20260412-115111.png](https://cloudsupport.sequentum.com/__attachments/a_a2380aab668a4f5980d6203c833b979b9233467824347abad453bd466b3ece1b/image-20260412-115111.png?cb=a0f7dc7f6040b88d617bdb916942a18a) **Step 5**: Now click on the Close button to exit from this page and the uploaded agent has been imported successfully in the desired space. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXd9m_Bqh_n-Q2Wbs88mG0QxBaiPpHRWla43S1fNQEhxbK0L6gyAXxwr4IN8Bc085-AO-QvIZLi8VfEy8pAEFexnXmj755cWelHK9cojTGdSndlJrl3aMyL6xp2hRGF6jQUrOImU?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXd9m_Bqh_n-Q2Wbs88mG0QxBaiPpHRWla43S1fNQEhxbK0L6gyAXxwr4IN8Bc085-AO-QvIZLi8VfEy8pAEFexnXmj755cWelHK9cojTGdSndlJrl3aMyL6xp2hRGF6jQUrOImU?key=_rUX5Em7UEL73gX9z6WCeA) Additionally, instead of following the steps in the third point, you can also use the Drag \& Drop feature to import the agent text file directly from your local system to the Space screen. (**Note:** Users can obtain the agent text file from the Editor window by navigating to the **Text** tab. Within this tab, an option is available at the bottom of the interface, allowing users to download the text file on your local system.) ![image-20260412-115335.png](https://cloudsupport.sequentum.com/__attachments/a_74b59ec93d061f71d9d9d4218422a97e5235209b95d1c3ea1b69d04e75d987a4/image-20260412-115335.png?cb=470da95db5d23032d9ce8a504f6c384f) Agent Text --- language: "en" --- # How to Scroll a Webpage from Top to Bottom **Scraping page:** ## **Manual Page Scrolling:** To interact with content that loads dynamically after the initial page load, you can manually scroll the page and then use the "Parse All Content" button. This action will refresh the content loaded into the scraper, ensuring that newly appeared elements are captured for further processing. ![image-20260404-180009.png](https://cloudsupport.sequentum.com/__attachments/a_9d09258cc2b02e369c32bcdc7c54a8bc525560f7e32aa05ad6964689db9ed0ca/image-20260404-180009.png?cb=aaf8d54ba2fede17723dd6fe182a5a0b) Parse option in UI * Dynamic Content: Content that loads after the initial page load is often referred to as "dynamic content." * Manual Scrolling: By manually scrolling the page, you trigger the browser to load additional content. * "Parse All Content" Button: Clicking this button refreshes the scraper's view of the page, incorporating the newly loaded content. This message provides instructions on how to scroll to the end of a webpage using the "scrollExpandingContent" event in Sequentum Cloud. ### **Using the scrollExpandingContent Event:** 1. **Add the "Action" Command**: Locate the command after which you want to perform the scroll. Under the "Actions" section, add an "Action" command. ![image-20260404-180128.png](https://cloudsupport.sequentum.com/__attachments/a_ba8eb3d85ee1ed6a361f61558d45e27e3f661f8b13a63024f60ccd3fde0866f9/image-20260404-180128.png?cb=b131255c5605541b7933ba3ef3a0ba20) 2. **Set the Xpath:** Set the Xpath of the node scrolling. To set the Xpath click on the "Selection" tab and pass the Xpath "***/html***" as in your provided URL the complete page is scrolling instead of a particular section on the page. Now click on the "Save Selection" button to save the Xpath. ![image-20260404-180212.png](https://cloudsupport.sequentum.com/__attachments/a_c821129f862187bd812752ce09cedcb7b30d5afff6c7b0983aec2cb9313b575a/image-20260404-180212.png?cb=22a7fa756322c3d702684df2f883e21e) 3. **Configure the Action**: Open the "Options" tab located in the centre. Navigate to the "Action" section. ![image-20260404-180254.png](https://cloudsupport.sequentum.com/__attachments/a_04f76cb21510dd78ce493894c4f2be93514d3aea8ca4be8be86c7f2e680cf07b/image-20260404-180254.png?cb=016cc067f92c5e65d45d9a5a82a3e005) 4. **Customize Scripting**: Uncheck the "Use default action script" option. Replace the existing script with the following: ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXeoQ2uX5txIqzkcYSRKYwOg1fYwXQXdkzZKVsYdZoKI-RaB0SlUcDEo869uwUueBdmUqzBRcVhYKAxfIC56gu4KiWEaQbeYozvD-YXCI2B9lPzpczdngHhPZYq4WkPbZLk4rRFlIA?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeoQ2uX5txIqzkcYSRKYwOg1fYwXQXdkzZKVsYdZoKI-RaB0SlUcDEo869uwUueBdmUqzBRcVhYKAxfIC56gu4KiWEaQbeYozvD-YXCI2B9lPzpczdngHhPZYq4WkPbZLk4rRFlIA?key=_rUX5Em7UEL73gX9z6WCeA) `element.scrollExpandingContent(200, 500, 600);` For detailed information on the "scrollExpandingContent" event, please refer to the Sequentum Cloud Support documentation: **\[** [**https://cloudsupport.sequentum.com/scfaq/how-to-use-specific-features-and-commands-of-se-in\]**](https://cloudsupport.sequentum.com/scfaq/how-to-use-specific-features-and-commands-of-se-in%5D) 5. **Adjust Browser Timeouts:** If the page loads content dynamically while scrolling, navigate to the "Browser" options. Increase the "Discover activity timeout" as needed to provide sufficient time for the scrolling operation to complete. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXc7-FTUR29FjacVFuSQFiP1a22BAM7bYzyJWI6CUKuZtOQXYLl44qgeE9KaibvbTRr1Eo4BjIN1e50s1jghaTpZwc7HmbSMgcZsCVXZoQXWcHiXPJu0JzGpqN_cWOOSupJ7x7HShA?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXc7-FTUR29FjacVFuSQFiP1a22BAM7bYzyJWI6CUKuZtOQXYLl44qgeE9KaibvbTRr1Eo4BjIN1e50s1jghaTpZwc7HmbSMgcZsCVXZoQXWcHiXPJu0JzGpqN_cWOOSupJ7x7HShA?key=_rUX5Em7UEL73gX9z6WCeA) 6. **Save and Test:** Click on "Save" to save your changes. Click the "Play" button to test the implemented scrolling functionality. ![image-20260404-180546.png](https://cloudsupport.sequentum.com/__attachments/a_46698710100d7ca656f33017e2cd988e0fde0c8cec4fccc86cd3fc26739248ca/image-20260404-180546.png?cb=7adb7b9bb2162a723c982afa4c610669) ### **Sample Agent Text:** 1. Open a New Agent. 2. Copy the given Sample Agent text. `Agent:` `Proxies:` `Proxy Pool: Sequentum Data Center` `Commands: URL` `Dynamic Load:` `Timeouts:` `Discover Activity: 4` `Input: https://www.pulte.com/homes/florida/orlando` `Commands: Action` `Name: Click To Show All Action` `Select: //div[@class='ProductSummary__btn-show-more-container']/div/strong` `Wait:` `Search All Frames: Yes` `Wait For Change: true` `Commands: Action` `Name: scroll` `Action Script: element.scrollExpandingContent(200,500,600)` `Select: /html` `Wait:` `Search All Frames: Yes` `Wait For Change: true` `Dynamic Load: Wait For All Content` `Timeouts:` `Discover Activity: 3` `Discover First Activity: 1` `Commands: Page Area List` `Name: Section List` `Select: //div[@class='ProductSummary__communityContainer']/div` `Commands:` * `Content: name` `Extract: //a[@class='experience-modal-button']` * `Content: address` `Extract: //p[@class='ProductSummary__address']` `Export:` `Commands: CSV` 3. Now Click on the "Text" tab. As shown Below. ![image-20260404-180704.png](https://cloudsupport.sequentum.com/__attachments/a_b2f9e0bd03f5c741c569a844d011b677d0109f4ec92cbf9b2c59dfb73c4fa0e2/image-20260404-180704.png?cb=46c858c6ea61ac080c2aa02bc54dc421) 4. Now press "Ctrl + A" to select all content and then press "Ctrl + V" to replace the available content with the previously copied content. 5. Now Click on the "Save Configuration" button as shown below. ![image-20260404-180845.png](https://cloudsupport.sequentum.com/__attachments/a_6eb7eaa55f2c6e48547e43a6c9816e56895d424008f61d048f519058230fdcf8/image-20260404-180845.png?cb=6407dd6660304f525d90aae8f3bb4d2e) 6. Now you have the Sample agent on your system to run or debug. This will create a sample agent with the scrolling functionality pre-configured, allowing you to test and adapt it for your specific needs. Additionally, to simplify the process of scrolling to the end of the page, we are currently working on implementing a user-friendly option within the UI. This will eliminate the need for manual scripting and provide a more intuitive solution. --- language: "en" --- # How to use a Data List Command to load inputs URLs using Scripts **Steps to create an agent using a script to Load input urls in the Input parameters in the Data List Command** 1. Where to use Input Parameter? * In Sequentum Cloud, navigate to the **Agent Configuration \>\>** Input Parameters section within the agent editor. Upload the CSV or Text file to **Agent Configuration \>\>**Files make it accessible for your agent 2. How to create an Input Parameter file to load multiple URLs? * Please prepare a CSV file or Text file with each URL listed in a separate row to ensure the agent can process them correctly 3. How to configure the URL command to load the URLs? * In the agent editor, Use the "URL" command to access the URLs from your uploaded CSV file by using the "Data list" command. Sequentum Cloud enables users to create agents that can efficiently handle multiple URLs by using an Input Parameter. In this guide, we'll walk through the steps to create an agent in Sequentum Cloud that uses an Input Parameter to load and process multiple URLs through the scripts. ## **Where to upload this file?** **Step 1:** Open the editor window and navigate to the **Agent Configuration** → **Option** → **Input Parameters** ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdn0nFwd2a1IO08j3JC6EsZ4zmUb5Uq0JCvO6M5mxYOBQo83fAzmuzXy41hp9RwTBfW35qHT9gduitr7vcuZRkEvlnHh2qAPTrDzI1RPcoG411V_nbnIcLY_HFoSsArW9bfhoux4A?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdn0nFwd2a1IO08j3JC6EsZ4zmUb5Uq0JCvO6M5mxYOBQo83fAzmuzXy41hp9RwTBfW35qHT9gduitr7vcuZRkEvlnHh2qAPTrDzI1RPcoG411V_nbnIcLY_HFoSsArW9bfhoux4A?key=_rUX5Em7UEL73gX9z6WCeA) Here you can enter the file name that you want to call in the script and value in to the Data list command **Step 2:** Open the editor window and navigate to the **Agent Configuration** → **Option** → **Files** ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXe1YvkvH2klRy6gAAwllWzi60yi5kWEG-wLAgyZ-5Vtsmd2SXbqGxmW6sc5tnxnSqNjdqDpw3hxKcLxbSYrgLQySL8SokDwnV7I9SqBuo-8VMq91Va_cx96r0HcE4E7ofQqVGgDg-FlSW6PuqsEi8XHvXPU?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXe1YvkvH2klRy6gAAwllWzi60yi5kWEG-wLAgyZ-5Vtsmd2SXbqGxmW6sc5tnxnSqNjdqDpw3hxKcLxbSYrgLQySL8SokDwnV7I9SqBuo-8VMq91Va_cx96r0HcE4E7ofQqVGgDg-FlSW6PuqsEi8XHvXPU?key=_rUX5Em7UEL73gX9z6WCeA) Here you can upload the files that can be accessed further through the scripts in the Data list command Click on the 'Upload File' option to begin the upload process. In the above given example, we are uploading the csv file and text file **Step 3:** After uploading the file, click on the 'Extract' icon as shown below to proceed. This will open a list of commands ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcK7EdVGuI1J_0wlaKXOCipIFZBY03vrwk9X4vT7z24BS6tvBg_ulBJAWHCxqsYwK7dO6Uo-9BNSG9fSL0r7DIlZrun2zZwDQuXT69iuE0MDwWMASN8gGxHwuZXvTkrUjxeN7rDJ2MFZqPvstnx44LoE_c?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcK7EdVGuI1J_0wlaKXOCipIFZBY03vrwk9X4vT7z24BS6tvBg_ulBJAWHCxqsYwK7dO6Uo-9BNSG9fSL0r7DIlZrun2zZwDQuXT69iuE0MDwWMASN8gGxHwuZXvTkrUjxeN7rDJ2MFZqPvstnx44LoE_c?key=_rUX5Em7UEL73gX9z6WCeA) **Step 4:**Next, select the 'Data List' command as shown below... ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfeL_IO6FdB0LL4-dS7isbGrdpXH9Dzn7Ywv-rDZWJb-eate2JjRrig4uB8RQk2UTgSb6wGk35zmF1MQB8t714Hu8AoJq599k4YLsd9xJGnlslsr5T9QJ8VQBQNSvfQj8NuY7FXUQfOrtxt68A9fVQwZdH7?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfeL_IO6FdB0LL4-dS7isbGrdpXH9Dzn7Ywv-rDZWJb-eate2JjRrig4uB8RQk2UTgSb6wGk35zmF1MQB8t714Hu8AoJq599k4YLsd9xJGnlslsr5T9QJ8VQBQNSvfQj8NuY7FXUQfOrtxt68A9fVQwZdH7?key=_rUX5Em7UEL73gX9z6WCeA) **Step 5:**After adding the 'Data List' command, navigate to the 'List' option. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfYjx5pHnhX8tOsa2Sa5ab56KziMNKJS3QfpwpJ83Dutb04gfgCORqKNmZWw_1_M4O4IWefDBIhGiVUueRLqhurtwA6tY0zHhzegokUWFEjeb6AFIcAnp3oUeiVmHD8RvwmhYa9Fs7VV9ky6mCHhBfQ9z_B?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfYjx5pHnhX8tOsa2Sa5ab56KziMNKJS3QfpwpJ83Dutb04gfgCORqKNmZWw_1_M4O4IWefDBIhGiVUueRLqhurtwA6tY0zHhzegokUWFEjeb6AFIcAnp3oUeiVmHD8RvwmhYa9Fs7VV9ky6mCHhBfQ9z_B?key=_rUX5Em7UEL73gX9z6WCeA) **Step 6 :**Select 'Data Type' as CSV from the dropdown, then choose 'Data Source' as 'Script.' Once 'Script' is selected, choose the coding language for your script. In this example, we select C# as the language. Below is the code to retrieve the input file. #r System.IO.dll using System.IO; public string GetData(RunContext context) { var filename = context.GlobalData.GetString("File"); var filepath = context.PrivateFiles.GetFile(filename); var inputfile = File.ReadAllText(filepath); return inputfile; } **Note:** There is a 'Test Script' option available to check if the script is functioning correctly. **How to configure the URL command to load the URLs?** **Step 7 :**In the Browser group command, click on the 'URL' command and add it under the 'Data List' command. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXf3A0AbiJ--HLQEP8pHEWVYSefdgPCH_YKin7BT49aMmTPLZbAv78mGgF4b3-SjkRPAoNeUZc7U0Tk7BfHzCZA6X6k9M31Y9s8dHCF92SJuROVKeX8KAFV1EBUEUhPidlWaRCTN6aySUJkpxZ6y2W99eDyM?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXf3A0AbiJ--HLQEP8pHEWVYSefdgPCH_YKin7BT49aMmTPLZbAv78mGgF4b3-SjkRPAoNeUZc7U0Tk7BfHzCZA6X6k9M31Y9s8dHCF92SJuROVKeX8KAFV1EBUEUhPidlWaRCTN6aySUJkpxZ6y2W99eDyM?key=_rUX5Em7UEL73gX9z6WCeA) **Step 8:**After adding the 'URL' command, navigate to the 'URL' option and select 'Data List' from the 'URL' dropdown menu. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdkAWVyurOYm2e4BJCgAmKBBwqnITZ4vMsNywwAGm9D0PIxtlIbYXoFup6yXEkUnEqbrEJZRL4qslYb5dS-wHJo9KEbsZH6CKPHy04o2-dT8e71DHcvuB1zoVaS8AjTWeycF1Jm?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdkAWVyurOYm2e4BJCgAmKBBwqnITZ4vMsNywwAGm9D0PIxtlIbYXoFup6yXEkUnEqbrEJZRL4qslYb5dS-wHJo9KEbsZH6CKPHy04o2-dT8e71DHcvuB1zoVaS8AjTWeycF1Jm?key=_rUX5Em7UEL73gX9z6WCeA) After selecting the 'Data List' command, the input will be displayed as shown below: ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfq7osRAYd982lOI-voqT3_m9QjTgDN1stoDOfJfmIx0a80-JkmV8c5BKOcgdECwMi48Pn74f0h4jYBXUOIZqgwGQlos1_lnKq61YefG3n2Z2bGlCPRfPmrkMJ6LEesTF1E3E4RpA?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfq7osRAYd982lOI-voqT3_m9QjTgDN1stoDOfJfmIx0a80-JkmV8c5BKOcgdECwMi48Pn74f0h4jYBXUOIZqgwGQlos1_lnKq61YefG3n2Z2bGlCPRfPmrkMJ6LEesTF1E3E4RpA?key=_rUX5Em7UEL73gX9z6WCeA) **Note:** Additionally, you can generate the agent in text format by clicking on the 'Text' option in the right panel, as shown below. This text format can be saved locally by clicking the option available at the bottom. Agent: Parameters: file: Test.txt Proxies: Run Without Proxies: true Commands: Data List CSV: Source: Script @Script: Data List Script Language: C# Timeout: 5 Commands: URL Dynamic Load: Timeouts: Discover Activity: 1 Input: Command: Data List Data Field: Transform:> match (.*) return ${1} Commands: Content Name: City Name Extract: //span[@class='mw-page-title-main'] Export: Commands: CSV Text: Data List Script >#r System.IO.dll using System.IO; public string GetData(RunContext context) { var filename = context.GlobalData.GetString("File"); var filepath = context.PrivateFiles.GetFile(filename); var inputfile = File.ReadAllText(filepath); return inputfile; } --- language: "en" --- # How to use a Data List Command to load inputs URLs using shared file **Steps to create an agent using a shared file to Load input urls in the Data List Command** **How to create shared file ?** * In the Sequentum Cloud dashboard page, navigate to anyspaces and then click on the**New Shared File** section on the dashboard page. Upload the CSV or Text file in 'Create Shared File'page to make it accessible for your agent **How to use a shared file to load multiple URLs?** * In the Data List command, select the uploaded shared file as the data source to load input URLs. **How to configure the URL command to load the URLs?** * In the agent editor, Use the "URL" command to access the URLs from your uploaded shared file by using the "Data list" command. Sequentum Cloud enables users to create agents that can efficiently handle multiple URLs by using shared files. In this guide, we'll walk through the steps to create an agent in Sequentum Cloud that uses an input file to load and process multiple URLs through the shared file. **How to create a shared file ??** **Step 1:** Open the dashboard page and navigate to any of the Space and then click on the New Agent Tab and select the option '**New Shared File**' ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXf2PPOSMTEB2776NxePz1qACnGi5zRFcfgsRpvTBtJb5phvTVdYYt4A0_hWuOQEPn5cw1hOLfGaexj_o5Do8YIYkAWtWqJ_Dtz7vJIxF9J0pRbeZ7F9MyrpVPzDXtGYIKQHB0G_ug?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXf2PPOSMTEB2776NxePz1qACnGi5zRFcfgsRpvTBtJb5phvTVdYYt4A0_hWuOQEPn5cw1hOLfGaexj_o5Do8YIYkAWtWqJ_Dtz7vJIxF9J0pRbeZ7F9MyrpVPzDXtGYIKQHB0G_ug?key=_rUX5Em7UEL73gX9z6WCeA) This will open the 'Create Shared File' window, where you can upload the file you wish to access in the Data List command. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdYIIobCc7xY-f-U28tB6fP-EaDSV1ZtisRpJrNDjEnaWlDxbXLxZUc8X6nHDp_v6EABxi2Y48lVF9OonnwJupCWRepwSahKYUP2ALXzkWqq4Cs3QImBAi8nOMqT6J_0qu5RHLFJg?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdYIIobCc7xY-f-U28tB6fP-EaDSV1ZtisRpJrNDjEnaWlDxbXLxZUc8X6nHDp_v6EABxi2Y48lVF9OonnwJupCWRepwSahKYUP2ALXzkWqq4Cs3QImBAi8nOMqT6J_0qu5RHLFJg?key=_rUX5Em7UEL73gX9z6WCeA) **Step 2:** Open the editor window and navigate to the **Agent command and then**click on the 'Extract' icon as shown below to proceed. This will open a list of commands ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcMbT-92ZekuurfIpTYYL-sd04UPXmmRmzyXf8G1VoZ6Qu7KHJqdgdPRWeaWo7X_F_xMxUcnbyi1c0bC_YEhpp7BFcpNC1FjXfAvvquAn7uYoFUP7LglZI9ecWCc2S0VkEPa5Cudk5iY6tDb0bgz3gVPjQ?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcMbT-92ZekuurfIpTYYL-sd04UPXmmRmzyXf8G1VoZ6Qu7KHJqdgdPRWeaWo7X_F_xMxUcnbyi1c0bC_YEhpp7BFcpNC1FjXfAvvquAn7uYoFUP7LglZI9ecWCc2S0VkEPa5Cudk5iY6tDb0bgz3gVPjQ?key=_rUX5Em7UEL73gX9z6WCeA) ## **Step 4: Next, select the 'Data List' command as shown below...** ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfin8DgeXfPfTkmoHJTqczCnDzd8RHdPWCfsKy-AbHUNDstN_WCo8jMNmhKKlCihV4syfilvxJY8BahaF-aPZqfGTDlXHAqdPJU3UOir7fzUkMW-MKUqa6SxhUkQoERModldKouVS1crigsRi01nioJ8fSO?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfin8DgeXfPfTkmoHJTqczCnDzd8RHdPWCfsKy-AbHUNDstN_WCo8jMNmhKKlCihV4syfilvxJY8BahaF-aPZqfGTDlXHAqdPJU3UOir7fzUkMW-MKUqa6SxhUkQoERModldKouVS1crigsRi01nioJ8fSO?key=_rUX5Em7UEL73gX9z6WCeA) ### **Step 5: After adding the 'Data List' command, navigate to the 'List' option.** ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXe4sV7ig9bB8pKPAw1xhi1M9VICiBXbyS_bURzkr1VyMYC8zt75K17sglIFbdByL9h8R2UxbVhmPT6zzY-H6Qc-6xhMuaZKRoadjIJmo_jqLthEo3XHtauYcw9kUCbAC5_grPN36MLLXIdKugxJkg_yq17W?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXe4sV7ig9bB8pKPAw1xhi1M9VICiBXbyS_bURzkr1VyMYC8zt75K17sglIFbdByL9h8R2UxbVhmPT6zzY-H6Qc-6xhMuaZKRoadjIJmo_jqLthEo3XHtauYcw9kUCbAC5_grPN36MLLXIdKugxJkg_yq17W?key=_rUX5Em7UEL73gX9z6WCeA) **Step 6:** Select 'Data Type' as 'CSV' and 'Data Source' as 'Shared File.' Once 'Shared File' is selected, click on the 'Select Shared File' box to display the shared file created in Step 1. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXef1RANSvW73eeIu7KO-Qb29np4ePjJFN69UC9lpjwpIKaYfpBFOaiWE-DG-Ucs29xnnVx4SgNJ6bioXEH1OMThm5pJGZJFwQVQDjVrj0deW8lNMa0kMXIR-shh6oNzD-fk-KPh?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXef1RANSvW73eeIu7KO-Qb29np4ePjJFN69UC9lpjwpIKaYfpBFOaiWE-DG-Ucs29xnnVx4SgNJ6bioXEH1OMThm5pJGZJFwQVQDjVrj0deW8lNMa0kMXIR-shh6oNzD-fk-KPh?key=_rUX5Em7UEL73gX9z6WCeA) After selecting the shared file, you will see that the inputs urls will be displayed as below- ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXeBXrEm1vbde8On34-KnQzE1paH1PNsT-kp3Rt3VueSIPhhQwwDJQd7DBr56hXNGpgjihUFDYT5C1zUL506x_K6d_pCZHGBd61zUCYv5Vo5EPt1fwDQRdPyZhQRO-x47rnnvpaL?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeBXrEm1vbde8On34-KnQzE1paH1PNsT-kp3Rt3VueSIPhhQwwDJQd7DBr56hXNGpgjihUFDYT5C1zUL506x_K6d_pCZHGBd61zUCYv5Vo5EPt1fwDQRdPyZhQRO-x47rnnvpaL?key=_rUX5Em7UEL73gX9z6WCeA) **How to configure the URL command to load the URLs?** **Step 7 :**In the Browser group command, click on the 'URL' command and add it under the 'Data List' command. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfm4o9bmZIAl1wi30a4aR88V7y3i96mOpeJjTtAxWQ8HHjoHzOZxA4XDe5vA_e8l1yLiq9fMEK5NPXFVFvmB2qJQiRX_aXM1Rha-qI-GvkKtXtNXNKYI6m_-GLDI0qkvT31MgsxWvQSPmURJpxIpgBwGdU3?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfm4o9bmZIAl1wi30a4aR88V7y3i96mOpeJjTtAxWQ8HHjoHzOZxA4XDe5vA_e8l1yLiq9fMEK5NPXFVFvmB2qJQiRX_aXM1Rha-qI-GvkKtXtNXNKYI6m_-GLDI0qkvT31MgsxWvQSPmURJpxIpgBwGdU3?key=_rUX5Em7UEL73gX9z6WCeA) **Step 8:**After adding the 'URL' command, navigate to the 'URL' option and select 'Data List' from the 'URL' dropdown menu. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXeQKPkZfYRYjwTZ8uE3X3McCN83wy2CSmKAxKD3RiKGDx0kjtz6iHDvXsmiGxUajfa-vOji2NQT6ienxvyDnbyojPYHCm6J28_cnXHfhNimQAh-idXiHcAnQ2ixlj4zbLPCHrNcWw?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeQKPkZfYRYjwTZ8uE3X3McCN83wy2CSmKAxKD3RiKGDx0kjtz6iHDvXsmiGxUajfa-vOji2NQT6ienxvyDnbyojPYHCm6J28_cnXHfhNimQAh-idXiHcAnQ2ixlj4zbLPCHrNcWw?key=_rUX5Em7UEL73gX9z6WCeA) **Note:** Additionally, you can generate the agent in text format by clicking on the 'Text' option in the right panel, as shown below. This text format can be saved locally by clicking the option available at the bottom. Agent: Proxies: Run Without Proxies: true Commands: Data List CSV: Source: Shared File Path: InputSharedFile.txt Commands: URL Input: Command: Data List Data Field: Commands: Content Name: City Detail Extract: //div[@class='mw-content-ltr mw-parser-output']/div[2] Export: Commands: CSV --- language: "en" --- # How to use a Data List Command to load inputs URLs **Steps to create an agent using input csv file in the Data List command** 1. Where to upload this file? * In Sequentum Cloud, navigate to the **Agent Configuration → Files** section within the agent editor. Upload the CSV file here to make it accessible for your agent. 2. How to create a CSV file to load multiple URLs? * Please prepare a CSV file with each URL listed in a separate row to ensure the agent can process them correctly. 3. How to configure the URL command to load the URLs? * In the agent editor, Use the "URL" command to access the URLs from your uploaded CSV file by using the "Data list" command. Sequentum Cloud enables users to create agents that can efficiently handle multiple URLs by using an input CSV file. In this guide, we'll walk through the steps to create an agent in Sequentum Cloud that uses a CSV file to load and process multiple URLs. Below are the detailed Steps to upload an input CSV file using the Agent command: ## **Where to upload this file?** **Step 1:** Open the editor window and navigate to the **Agent Configuration → Option → Files** ![image-20260404-183339.png](https://cloudsupport.sequentum.com/__attachments/a_c8745ad099d6f3e5af854690b539db740b11a064714a0639f0c4995879631a3b/image-20260404-183339.png?cb=d1811bb787707f20a2417e7d55df7f32) **Step 2:** Next, click on the 'Upload File' option to begin the upload process. In the given example, we are uploading the csv file *Test_InputFile.csv* ![image-20260404-183432.png](https://cloudsupport.sequentum.com/__attachments/a_866aca71a95f3c56d94a7f3a4dfde7e7fa6123c8c712ac6cbb2d0e42fb75e171/image-20260404-183432.png?cb=126d95dac657a1b158d0d231b09f237d) ### **How to use an input CSV file to load multiple URLs?** **Step 3:** Select the 'Data List' command as shown below... ![image-20260404-183916.png](https://cloudsupport.sequentum.com/__attachments/a_abf610bd658107b69bd033f22a18e8dfc846dfc1f580ebc65db7e02ac7d6bb5f/image-20260404-183916.png?cb=abc646afcda5d16a3b922028ffc97f90) **Step 4:** After adding the 'Data List' command, navigate to the 'List' option. ![image-20260404-183952.png](https://cloudsupport.sequentum.com/__attachments/a_be5eac21764b0cb967c575a9a870ab83b10f93ad1a31a35801b1204195f78cb0/image-20260404-183952.png?cb=d7ea2d0ad6d4a8eaa312b64a1fe9a5fb) **Step 5:** Select 'Data Type' as CSV from the dropdown and then choose 'Data Source' as 'Private File'. Once 'Private File' is selected, the uploaded CSV file will appear in the text box below the 'Data Source' dropdown. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcK2SJsT0rNLWh7TG-dXK6g0l76iihie9DLoZqYGXFMYIJ4GgQr7XOkyqJABqTHyiJpEoImS6lcyqa-V5KzG6XXsD6SgHFZk9I__xmMLZDTGdvpbqATiK0-NBUgicUo8uOb-kDlE_eRaBxnEv6d_nS73z72?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcK2SJsT0rNLWh7TG-dXK6g0l76iihie9DLoZqYGXFMYIJ4GgQr7XOkyqJABqTHyiJpEoImS6lcyqa-V5KzG6XXsD6SgHFZk9I__xmMLZDTGdvpbqATiK0-NBUgicUo8uOb-kDlE_eRaBxnEv6d_nS73z72?key=_rUX5Em7UEL73gX9z6WCeA) ### **How to configure the URL command to load the URLs?** **Step 8:** In the Browser group command, click on the 'URL' command and add it under the 'Data List' command. ![image-20260404-184313.png](https://cloudsupport.sequentum.com/__attachments/a_37fc90340e23c3512bea558832de94707b1f70ab78bfe0259d7f053d251eaeb4/image-20260404-184313.png?cb=a8f32d582e273eed3c179dcf073ac693) **Step 9:**After adding the 'URL' command, navigate to the 'URL' option and select 'Data List' from the 'URL' dropdown menu. ![image-20260404-185128.png](https://cloudsupport.sequentum.com/__attachments/a_cec1abebd64a64d7eb3f548878f4267afec9ba08d4614a0afb5df4ef6efc20b8/image-20260404-185128.png?cb=cc578ed298e4d57689a34792cd278183) **Step 10:** After selecting the 'Data List' option from the URL dropdown, click on the 'Data List' command as shown below. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXclF2ukxKqMuFkvgNhhqw8wuPzFeiDSgAkpkNptVuRg6IgDfpC97WuE2wS7-rux4DxIUaPUHMYc_GtIhg1suI5pmU6tCVU87UMOlHucRjnzL-6VmoKoh28yw6P2yjmTIrPJrmKy-a-aCsbXZK_MSKMuwe_L?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXclF2ukxKqMuFkvgNhhqw8wuPzFeiDSgAkpkNptVuRg6IgDfpC97WuE2wS7-rux4DxIUaPUHMYc_GtIhg1suI5pmU6tCVU87UMOlHucRjnzL-6VmoKoh28yw6P2yjmTIrPJrmKy-a-aCsbXZK_MSKMuwe_L?key=_rUX5Em7UEL73gX9z6WCeA) After selecting the 'Data List' command, the input will be displayed as shown below: ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcJLIXkKagTCqEEm9RhQkcT-w69jSLPTf5oUMJJS8C7h3ig1ubEDbfZ8Y7Z8JY-8emd0Und6E3nZuiCh14Zta4N8hot1fGCKErt4aWRbh5XON8tLoNicuR7o8bSpYvoQFdRS1lpdgXK73uvK64rcs6jRJ1H?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcJLIXkKagTCqEEm9RhQkcT-w69jSLPTf5oUMJJS8C7h3ig1ubEDbfZ8Y7Z8JY-8emd0Und6E3nZuiCh14Zta4N8hot1fGCKErt4aWRbh5XON8tLoNicuR7o8bSpYvoQFdRS1lpdgXK73uvK64rcs6jRJ1H?key=_rUX5Em7UEL73gX9z6WCeA) ### **Note:** Additionally, you can generate the agent in text format by clicking on the 'Text' option in the right panel, as shown below. This text format can be saved locally by clicking the option available at the bottom. ![image-20260404-184449.png](https://cloudsupport.sequentum.com/__attachments/a_1807a8929a7f421a2493b8b11c9cd7b9a59ee2c8f23158413fc41eeda435d0d0/image-20260404-184449.png?cb=35b7a604fffaa0edd1074f146cd95cde) ### **Sample text format:** ### **Agent:** Agent: Proxies: Proxy Pool: Sequentum Data Center Commands: Data List CSV: Source: Private File Path: Test_InputFile.csv Commands: URL Input: Command: Data List Data Field: Export: Commands: CSV ### **Conclusion** Sequentum Cloud ability to use input CSV files in the URL command significantly enhances the flexibility and efficiency of agent creation. By following the steps outlined in this guide, users can configure agents to handle multiple URLs dynamically, streamlining their data extraction or automation tasks. Whether you're working with a handful or a large number of URLs, this feature ensures that your agents remain adaptable and scalable to meet your needs. --- language: "en" --- # How to use DataTables, similar to CustomDataStorage in Sequentum Enterprise? Data tables represent an organized and structured collection of data, arranged into rows and columns. These can be used in DataList scripting as they are helpful for joining data tables and returning results in the form of tables. To implement this, first, add a **Data List** command. Under the **List** tab, select **"Script"** as the **Data Source** from the drop-down menu. In Sequentum Cloud, the following utility functions are available for working with data tables: |------------------------------------|-----------------------------------------------------------------------------------------------------------| | **Property or Function** | **Description** | | LoadCsvFileIntoDataTable(filePath) | Load the CSV file from the specified location into the Data table. *filepath - The path to the CSV file.* | | DataTableToCsv(newdt) | Converts the contents of a DataTable (newdt) into a CSV-formatted string. *newdt - Name of Data Table.* | ## **Example** The following example demonstrates how to read a .CSV file and extract the first two rows and their first two columns into a new DataTable: #r System.IO.dll #r System.Data.Common.dll using System.IO; using System.Data; public string GetData(RunContext context) { var filePath = context.SharedFiles.GetFile("test.csv"); DataTable dt = context.ScriptUtilities.LoadCsvFileIntoDataTable(filePath); DataTable newdt = new DataTable(); newdt.Columns.Add("col1", typeof(int)); newdt.Columns.Add("col2"); newdt.Rows.Add(dt.Rows[0][0], dt.Rows[0][1]); newdt.Rows.Add(dt.Rows[1][0], dt.Rows[1][1]); return context.ScriptUtilities.DataTableToCsv(newdt); } **Input:** ![AD_4nXcL5iIirpvEKNnOguDFiAFmgk_LVtVlXLe8yZnfQ4pHIh_owhnCzulO9pA3INohvEsFl8v7zOYRO33NzuyuhJ1tInZBSvpk8tfDVx8wJBrBEjXH2jk3cPLVs3Xr7FMFW8rnUdX7?key=yDfxdCr5-wIUT94iupecYQ](https://cloudsupport.sequentum.com/__attachments/a_0ca8fffd05da5375c4aec2a2669405178dff3430d5aec1cdf43061730dc810f8/AD_4nXcL5iIirpvEKNnOguDFiAFmgk_LVtVlXLe8yZnfQ4pHIh_owhnCzulO9pA3INohvEsFl8v7zOYRO33NzuyuhJ1tInZBSvpk8tfDVx8wJBrBEjXH2jk3cPLVs3Xr7FMFW8rnUdX7%3Fkey=yDfxdCr5-wIUT94iupecYQ?cb=13e038c29f95e94220ac88bc4c8a80d5) **Output:** ![AD_4nXf_CIsVpaY0CKTyLO-109_kcUrDhs8Uo6II_Dy-alVwXpgiEvk6sDUCmf3NfUajbF7SqnhD2NEkTbqhy2jYqicgxYIYmsWfdo8rSoq9Jx1iCw1XAbqtxY8HPG89U0i9ewa1u6mG?key=yDfxdCr5-wIUT94iupecYQ](https://cloudsupport.sequentum.com/__attachments/a_0c7230325b440a612ddfc9e74d83549e66d94da29bf2d15d999250ef3d316014/AD_4nXf_CIsVpaY0CKTyLO-109_kcUrDhs8Uo6II_Dy-alVwXpgiEvk6sDUCmf3NfUajbF7SqnhD2NEkTbqhy2jYqicgxYIYmsWfdo8rSoq9Jx1iCw1XAbqtxY8HPG89U0i9ewa1u6mG%3Fkey=yDfxdCr5-wIUT94iupecYQ?cb=a4d67c9e0d2cc83625c23088de4fe91f) The example below illustrates how to join two tables by reading data from separate CSV files and returning a combined data table from both tables: #r System.Text.RegularExpressions.dll #r System.Data.dll #r System.Data.Common.dll #r System.ComponentModel.TypeConverter.dll using System.IO; using System; using System.Collections.Generic; using System.Data; using System.Text.RegularExpressions; using System.Data.Common; public string GetData(RunContext context) { // Fetch the filenames from the context GlobalData var storeFilename = context.GlobalData.GetString("StoreFilename"); var categoryFileName = context.GlobalData.GetString("CategoryFileName"); // Load the CSV files into DataTables var storeDT = context.ScriptUtilities.LoadCsvFileIntoDataTable(context.PrivateFiles.GetFile(storeFilename)); var categoryDT = context.ScriptUtilities.LoadCsvFileIntoDataTable(context.PrivateFiles.GetFile(categoryFileName)); // Initialize the final DataTable DataTable finalDT = new DataTable(); finalDT.Columns.Add("StoreID"); finalDT.Columns.Add("StoreName"); finalDT.Columns.Add("Street"); finalDT.Columns.Add("City"); finalDT.Columns.Add("State"); finalDT.Columns.Add("ZipCode"); finalDT.Columns.Add("Country"); finalDT.Columns.Add("Latitude"); finalDT.Columns.Add("Longitude"); finalDT.Columns.Add("URL"); finalDT.Columns.Add("CollectionName"); // Add category-related columns finalDT.Columns.Add("CatID_Level2"); finalDT.Columns.Add("CatID_Level3"); // Combine the rows from both store and category tables into the final DataTable foreach (System.Data.DataRow storeRow in storeDT.Rows) { foreach (System.Data.DataRow categoryRow in categoryDT.Rows) { // Add a row to the final DataTable with combined values finalDT.Rows.Add( storeRow["StoreID"], storeRow["StoreName"], storeRow["Street"], storeRow["City"], storeRow["State"], storeRow["ZipCode"], storeRow["Country"], storeRow["Latitude"], storeRow["Longitude"], storeRow["URL"], categoryRow["level1_name"], // CollectionName categoryRow["level2_id"], // CatID_Level2 categoryRow["level3_id"] // CatID_Level3 ); } } return context.ScriptUtilities.DataTableToCsv(finalDT); } **NOTE:** `context.GlobalData.GetString("StoreFilename")`accesses the Global Parameter "StoreFileName" present in the **Input Parameters** of the **Agent** command. Similarly, `context.GlobalData.GetString("CategoryFileName")`accesses the Global Parameter "CategoryFileName" present in the **Input Parameters** of the **Agent**command. **Input File 1**: ![AD_4nXdccTmIWeh3_rIbgxyzgeVZqlfIyPP4gP96Or8GYyPbdmDNzdnzMAwJRRXjT9HsCBfLKifemu6ibVtAjCRYmP7hs1jujihLfzBsC02n8sDEXFDVy2BXGIWzaDU8fWK4RqjM_B-E?key=yDfxdCr5-wIUT94iupecYQ](https://cloudsupport.sequentum.com/__attachments/a_91c6535b17dd046bcb3f460d41bbc5fecb25201c457b7c61e8e39e8e9546b1f9/AD_4nXdccTmIWeh3_rIbgxyzgeVZqlfIyPP4gP96Or8GYyPbdmDNzdnzMAwJRRXjT9HsCBfLKifemu6ibVtAjCRYmP7hs1jujihLfzBsC02n8sDEXFDVy2BXGIWzaDU8fWK4RqjM_B-E%3Fkey=yDfxdCr5-wIUT94iupecYQ?cb=e7448073f286511698e24f16c95fcd9b) **Input File 2**: ![AD_4nXd7zzDEcn36LjYTkvQfnnBVAKvV8RZTQJ0_VcIfasVGI-R5PiZo39Cc2tSsIYxTjOuaEBF3sITseRhNhf0IknTIf18AjUFtCX-0qeOMW5jqgaCqiFxIXbHrgWMeUol7ibzSuvsp?key=yDfxdCr5-wIUT94iupecYQ](https://cloudsupport.sequentum.com/__attachments/a_04d5fe5af5b430f2fcacdfbfe06dda604bbe202c3119d9be6d930307217ff9d3/AD_4nXd7zzDEcn36LjYTkvQfnnBVAKvV8RZTQJ0_VcIfasVGI-R5PiZo39Cc2tSsIYxTjOuaEBF3sITseRhNhf0IknTIf18AjUFtCX-0qeOMW5jqgaCqiFxIXbHrgWMeUol7ibzSuvsp%3Fkey=yDfxdCr5-wIUT94iupecYQ?cb=106d6c9346b8d71cf7f28d604cc4bbd5) ### **Output** : ![AD_4nXdIKJOI6JjcVpzzpwM_mY8DNZfk7M4oZUTB8wXhE5fXgjnnkNSn_MyMekqGn1KZ-marHNrhg1si817RTDjfScQzzqeam2PHpM01Ma9q_Jx5WYUBOJXkAgg6_CZ-KFUJ-YUckAQl?key=yDfxdCr5-wIUT94iupecYQ](https://cloudsupport.sequentum.com/__attachments/a_f5a0577f3fb6b89eb8f426cba8edb81e8885bce91b5f44ee26b9c3dc7f590d2c/AD_4nXdIKJOI6JjcVpzzpwM_mY8DNZfk7M4oZUTB8wXhE5fXgjnnkNSn_MyMekqGn1KZ-marHNrhg1si817RTDjfScQzzqeam2PHpM01Ma9q_Jx5WYUBOJXkAgg6_CZ-KFUJ-YUckAQl%3Fkey=yDfxdCr5-wIUT94iupecYQ?cb=84070160d2ef3b2af9001b75fc979f19) --- language: "en" --- # How to Download DOC Files Using File Link command in Sequentum Cloud? **Steps to create an agent using a download command to download the files.** Where to use the download command? * In Sequentum Cloud, navigate to the **Agent Configuration** and add theNavigate Url command to navigate to the desired page where all the docs files are available to download. How to configure the File Link command to download the desired files? * In the Agent Editor, use the **Link** command to navigate to the page where all the files are accessible for download. You can use the **List** command here to select and download multiple files at once, or simply use the **File Link** command to download a single file directly. **How to use Url command to load the url:** **Step 1:** Open the editor window and navigate to the **Agent Configuration** → **Browser** → **Url** ![image-20260404-182511.png](https://cloudsupport.sequentum.com/__attachments/a_46ea45912dc4eb9bb33326fb1b30bc9e709adb9b53e49639d0ba37d8bd2282ca/image-20260404-182511.png?cb=d105fdf258b263aa672280d65d953548) **Step 2:** In the URL section, enter the website URL from which you want to download the files. ![image-20260404-182621.png](https://cloudsupport.sequentum.com/__attachments/a_1d3e2855980789fee2eb2edf59252583c8eceb996abaf74191a068cba0f98abd/image-20260404-182621.png?cb=913e7790090d293e9e2955c1c5ffbea0) **Step 3:** Now Select the **Download Documents** option on the loaded page and click on the **Link** button, as shown below: ![image-20260404-182906.png](https://cloudsupport.sequentum.com/__attachments/a_9d49c6b4b25a0c5711b18f24dca8ad3e0cb0e3b99d0f392b8ae496d1b1f4b52a/image-20260404-182906.png?cb=08f0ad40342187e1c3e43b70b4d0b004) After executing this page, you will be redirected to the following page, where you can download the documents. ![image-20260404-182957.png](https://cloudsupport.sequentum.com/__attachments/a_c9a50e9c4714d99f5d1d54afd77fdf9cf31b9c209ac15f93a143157ef89206bd/image-20260404-182957.png?cb=8bdfb6031e0099550014ea1fa5ca6706) **Step 4**: On the page above, you can select the document link of your choice. You can use the **List** command to select and download multiple files at once or the **File Link** command to download a single file directly. To select multiple files, click on the first link, hold the **Shift** key, and then click on the second link. Once the desired files are selected, click on the **File Link** button, as shown below: ![image-20260404-183053.png](https://cloudsupport.sequentum.com/__attachments/a_e5c7dd5da5a5961b4a91db22e93f8509fecf7b943565387a227132d84a1d7073/image-20260404-183053.png?cb=9083e0eb3ce78dd2ae5f156ce6cb6844) Now click on the **Save Selection** option at the bottom to finalize and create the agent. **Note:**Additionally, you can generate the agent in text format by clicking on the 'Text' option in the right panel. This text format can be saved locally by clicking the option available at the bottom. `Agent:` `Proxies:` `Run Without Proxies: true` `Commands: URL` `Dynamic Load:` `Timeouts:` `Discover Activity: 1` `Input: https://training.sequentum.com/filedownload` `Commands: Link` `Name: Download Documents Link` `Extract: //div[@class='pageContent']/div/div[2]/div/a` `Dynamic Load:` `Timeouts:` `Discover Activity: 1` `Commands: Page Area List` `Name: Download List` `Select: //div[@class='container']/main/section[1]/div[@class='pageContent']/div/div/div[@class='card-body']/table/tbody/tr[@class='odd'][td[3][.='download']/a[1][.='download']]` `Commands: File Link` `Name: Download` `Extract: /td[3][.='download']/a[1][.='download']` `Transform:` `Enabled: false` `Export:` `Commands: CSV` --- language: "en" --- # How to use List Command to Navigate URLs and Capture Data Efficiently **Steps to create an agent using a List command to navigate urls in the List Command to capture data.** Sequentum Cloud enables users to create agents that can efficiently handle list commands to navigate URLs. In this guide, we'll walk through the steps to create an agent in Sequentum Cloud that uses an List Commands to Navigate URLs and Capture Data Efficiently **How to use Url command to load the url:** **Step 1:** Open the editor window and navigate to the **Agent Configuration** → **Browser** → **Url** ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXeGPCZ3UGQH5JnEURvMq_8mxs86lbjN9ltVSxz3IhHHNw_Hq2lpXrw9r3fWVk1vgox-1BSrSjFHZ70LKBY5XiwknFcUybystvMvkPYr-VjPKAhPthQOE7Z02MdtVNwqfZomW0sL2A?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeGPCZ3UGQH5JnEURvMq_8mxs86lbjN9ltVSxz3IhHHNw_Hq2lpXrw9r3fWVk1vgox-1BSrSjFHZ70LKBY5XiwknFcUybystvMvkPYr-VjPKAhPthQOE7Z02MdtVNwqfZomW0sL2A?key=_rUX5Em7UEL73gX9z6WCeA) **Step 2:** In the Url section, enter the site's url for which you want to extract the data ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXeuKVFEPiHSzvS2WfBQX572ioTWa8tZbeNT2bRzLnefLgzqvQAwW3NGiQEEHU1dmWQl2U5CNO-1rEg7J2kr2J-q__OfhozuWureB95QeHpeTmiiZGjwoj1G8vixtWV24Zj2cwiJDA?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeuKVFEPiHSzvS2WfBQX572ioTWa8tZbeNT2bRzLnefLgzqvQAwW3NGiQEEHU1dmWQl2U5CNO-1rEg7J2kr2J-q__OfhozuWureB95QeHpeTmiiZGjwoj1G8vixtWV24Zj2cwiJDA?key=_rUX5Em7UEL73gX9z6WCeA) **Step 3:** After adding the Url command, Select the elements in the list as shown below (To select multiple elements, click on the first element, hold the **Shift** key, and then click on the second element.), After that click on Extract option available at the bottom. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXeOmeORgRq8uVYnDLnKTX2IrvinzR7rvHh7tg4sy9yw6FhypLy3hrJAcwY53o6irg3O_eL142Bh8IXLcnhto_6dfVQnc7DPBuumtiHO-5Q-jTkVcMLmcO0VFAizi_krF6qCs1rJRg?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeOmeORgRq8uVYnDLnKTX2IrvinzR7rvHh7tg4sy9yw6FhypLy3hrJAcwY53o6irg3O_eL142Bh8IXLcnhto_6dfVQnc7DPBuumtiHO-5Q-jTkVcMLmcO0VFAizi_krF6qCs1rJRg?key=_rUX5Em7UEL73gX9z6WCeA) This will add the command in the left panel as shown below - ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXc2QWY8A0SUUfqBPWc6IZ8nHU52Arox2YIcvKw-2OriqWFddq7g-Jsfg9oSIBcVe6UouedFr9YH3JpnLZV4Xo8lFcKVtu0Fda9400LBskLXvT7HgYCHPPttGTYKjflNpRi1aFznlA?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXc2QWY8A0SUUfqBPWc6IZ8nHU52Arox2YIcvKw-2OriqWFddq7g-Jsfg9oSIBcVe6UouedFr9YH3JpnLZV4Xo8lFcKVtu0Fda9400LBskLXvT7HgYCHPPttGTYKjflNpRi1aFznlA?key=_rUX5Em7UEL73gX9z6WCeA) *Note:* *When you click the 'List' option (as shown above), it will insert the List command alone, without adding any extra commands, as demonstrated below:* ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdrKKzHkzhOu2164d-zCbYhCvO6bg_0oF6gHVzrhF8_-6PUAMBrDCf-ls7akzk7qAZxsEhwzMdd23bdki9bMMIjxNPmPIbE2CpD8RinX0drifOYFj_LQCNkaC5q56PhBbsAPdWTPg?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdrKKzHkzhOu2164d-zCbYhCvO6bg_0oF6gHVzrhF8_-6PUAMBrDCf-ls7akzk7qAZxsEhwzMdd23bdki9bMMIjxNPmPIbE2CpD8RinX0drifOYFj_LQCNkaC5q56PhBbsAPdWTPg?key=_rUX5Em7UEL73gX9z6WCeA) *Similarly, clicking the 'Link' option based on the selected list on the web page will function as shown below:* ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXeJXcOP6yxPsQkf8e_zk4q20fEVoM3JMjNoA_VAJLSQgRvVPSBJI2nh0kR7AcaEZfIIjhY7VwR3hd0po65jrgkSM6H7EtT8LYhSFGE5VClQrU3R1WLK2lHmT0aOqDHGUbPQo7OfCA?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeJXcOP6yxPsQkf8e_zk4q20fEVoM3JMjNoA_VAJLSQgRvVPSBJI2nh0kR7AcaEZfIIjhY7VwR3hd0po65jrgkSM6H7EtT8LYhSFGE5VClQrU3R1WLK2lHmT0aOqDHGUbPQo7OfCA?key=_rUX5Em7UEL73gX9z6WCeA) *After clicking on the Link command, it will now add the List command with the additional Link command as shown below-* ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXc3DqGdx9rP7DNaHOhwngedcoGnwBuOKzEv5k1CWmsWdeBlwQCnu0uVRFJdE4u99zyLVd_rbrc021CRKvtBs4oYMOvFkpamA0RI2ytWJAN0j_brkQMSDq9yeY84QcNDhcPbqlNijQ?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXc3DqGdx9rP7DNaHOhwngedcoGnwBuOKzEv5k1CWmsWdeBlwQCnu0uVRFJdE4u99zyLVd_rbrc021CRKvtBs4oYMOvFkpamA0RI2ytWJAN0j_brkQMSDq9yeY84QcNDhcPbqlNijQ?key=_rUX5Em7UEL73gX9z6WCeA) **Step 4:**After adding the Link List option as mentioned in the step 3, Next add the Navigate Url command on the list command to navigate the urls one by one and capture the data. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXf_sbrPyIg_DgctkdLb2Sf6jt_RG2IA4jwv5Xq0dA0NF61bQ62e9wg19GmmFOve2Mz2XmUvNXEnirXhtsVqi_maHfLN-dZFeV6CPdV6H18-OBqa9O6OnlBjbvFX6T4IiWnntR-cig?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXf_sbrPyIg_DgctkdLb2Sf6jt_RG2IA4jwv5Xq0dA0NF61bQ62e9wg19GmmFOve2Mz2XmUvNXEnirXhtsVqi_maHfLN-dZFeV6CPdV6H18-OBqa9O6OnlBjbvFX6T4IiWnntR-cig?key=_rUX5Em7UEL73gX9z6WCeA) **Step 5:** Add the Capture command to extract content from the navigated page. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcIe8UYr8aYcrnrN_hS9dpVQTf9WJ0GcXnDnawQOYJu6XyuZsiiP_7vuQz1mBFYWQ80lYdmIYcbLAzS7cmlUF761c-MoUbDAhEHlBHNMlVb0jYXrKmNT-hajWMcUsUYPjkCnr_GFA?key=_rUX5Em7UEL73gX9z6WCeA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcIe8UYr8aYcrnrN_hS9dpVQTf9WJ0GcXnDnawQOYJu6XyuZsiiP_7vuQz1mBFYWQ80lYdmIYcbLAzS7cmlUF761c-MoUbDAhEHlBHNMlVb0jYXrKmNT-hajWMcUsUYPjkCnr_GFA?key=_rUX5Em7UEL73gX9z6WCeA) **Note:** Additionally, you can generate the agent in text format by clicking on the 'Text' option in the right panel This text format can be saved locally by clicking the option available at the bottom. Agent: Proxies: Run Without Proxies: true Commands: URL Dynamic Load: Timeouts: Discover Activity: 1 Input: Commands: Page Area List Name: Link List Select: //div\[@class='pageContent'\]/div/div\[@class='card mb-1'\]\[div\[1\]\[@class='card-body'\]/a\[1\]\[@class='media text-dark'\]\] Commands: - Content: Link Extract: /div\[1\]\[@class='card-body'\]/a\[1\]\[@class='media text-dark'\] Attribute: Exact URL - URL: URL Dynamic Load: Timeouts: Discover Activity: 1 Input: Command: Link Commands: Content Extract: //div\[@class='pageContent'\] Export: Commands: CSV --- language: "en" --- # How to use specific features and commands of SE in Sequentum Cloud ## **Questions 1:** **Static Browser** - How to set a maximum of 10 concurrent connections/requests to target website The Static Browser is already set to run 10 connections/requests concurrently. Also to change the Dynamic/Static browser max active browsers please follow the below steps: 1. Open your agent and click on the "Agent" command shown below, ![image-20260412-130709.png](https://cloudsupport.sequentum.com/__attachments/a_7ead504e7305eeb3db13e70d89f5a86585372d52476d0851e7040a44a2f07267/image-20260412-130709.png?cb=4f160508d62070148bab1346e67236ba) 2. Now you can see the "Browser" property, as shown below. ![image-20260412-131040.png](https://cloudsupport.sequentum.com/__attachments/a_8c5f48016a34a8e11c7c96f4af4fb226c68f4253137ca2864609acae8b03fcc3/image-20260412-131040.png?cb=2a21315f5564b0521ad739bcbb3f0d2b) 3. Now you can update the "Max. Dynamic browsers \& Max. static browsers" They provide the functionality to change the number of concurrent browsers at runtime. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXd-aU0_JC_drkQ5kTBCpf1h5kVh4nBAqEIMO2Ujvq2jADTl0edKGyU3Y6s02kCkdQjO-B2pWgDz_SbAmaNVtg-qYt5yRr026ZnppJTTC7jsRUk6J9YivK0j_yMI7TO1bbAi74SG8hNidTP9Wba5zaEsYZI?key=uBmrlrvbgmaoEhOXJLGqcA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXd-aU0_JC_drkQ5kTBCpf1h5kVh4nBAqEIMO2Ujvq2jADTl0edKGyU3Y6s02kCkdQjO-B2pWgDz_SbAmaNVtg-qYt5yRr026ZnppJTTC7jsRUk6J9YivK0j_yMI7TO1bbAi74SG8hNidTP9Wba5zaEsYZI?key=uBmrlrvbgmaoEhOXJLGqcA) Please refer to the documentation for more detailed information about the "Max. Dynamic browsers \& Max. static browsers" the link is provide below, [Agent Configuration Overview](https://cloudsupport.sequentum.com/scm/agent-configuration-overview) ## **Question 2:** ### URL Command - Where is "Scroll to end of page" To scroll the page at the runtime please use the steps below: 1. Please Open your agent and Load a URL you want to scroll the page on. ![image-20260412-131142.png](https://cloudsupport.sequentum.com/__attachments/a_d537a50912af951251c638578e87ba752d95f9ee947d30dfce099b8d63efe0bf/image-20260412-131142.png?cb=3545332a9e52e72b38b3a6b7b24c1eed) 2. Now, on the commands section click on the "Action" section and Add the "Action" command available under the "Action" section as shown below, ![image-20260412-131306.png](https://cloudsupport.sequentum.com/__attachments/a_d1d213db8644ef9f9b33bfe59a5f2e00feedd6234a0c67e64d7cd9c760e0fdf5/image-20260412-131306.png?cb=8d1570c7e0b8757241e2fbef63b2b247) 3. Now, Provide the XPath as per your target site page scrolling section. As for the Site I used, the below XPath was working. ![image-20260412-131352.png](https://cloudsupport.sequentum.com/__attachments/a_132b0b43cd0a4f14b8c26b77b3f037c0391964409a52fd0cc7030d9ea8730717/image-20260412-131352.png?cb=e9e9934111aeb5d975a1abe9b2d006cd) 4. Save the XPath from the "Save Selection" button, as shown below. ![image-20260412-131501.png](https://cloudsupport.sequentum.com/__attachments/a_4ce38144355cb3f0728ed496018e1e6725b65f0147a8c6a958d787e255ab995e/image-20260412-131501.png?cb=85a23465a0da97eacae5f240a97a004e) 5. Now, click on the "Options" property on the Top right, as shown below. ![image-20260412-132726.png](https://cloudsupport.sequentum.com/__attachments/a_2c7d376cb03a2649b99e6935e425d4de061771c3b9c8153bf4398b3a7ee8e456/image-20260412-132726.png?cb=2ddb69e361c51a0d783493a2ea6c1ab9) 6. Now, you can see the "Action" property and under it, you have the "Action settings" property. ![image-20260412-132834.png](https://cloudsupport.sequentum.com/__attachments/a_46387be1074c5ad0a0ad65d30a79efaeeb26daf283c39ba531f12eef2710c804/image-20260412-132834.png?cb=ff3a488d51c4520f1cd5d2c176899ca6) 7. Now, uncheck the "Use default action script" to use the actions script as per your need which is "scroll to the end of the page". ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXepNalWn3Cy9mIsAgeHNUdu0GhCy1d8hSOCqabYeg26VmkhcsogJFNs0Es2ve46Y-siD-JWCEHTJ6C7BxBavS23ngADBG2JacLIIPF6bwnEOU_esAPX-IadT8snpnuBIKwNJBDGiqrkk_kE5CbYA0KPApIw?key=uBmrlrvbgmaoEhOXJLGqcA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXepNalWn3Cy9mIsAgeHNUdu0GhCy1d8hSOCqabYeg26VmkhcsogJFNs0Es2ve46Y-siD-JWCEHTJ6C7BxBavS23ngADBG2JacLIIPF6bwnEOU_esAPX-IadT8snpnuBIKwNJBDGiqrkk_kE5CbYA0KPApIw?key=uBmrlrvbgmaoEhOXJLGqcA) 8. Now, use the below code in "Action Script" which uses the "scrollExpandingContent" method and takes (Maximum number of scrolls, number of pixels to scroll at a time, Delay in every scroll of millisecond ). **"element.scrollExpandingContent(200, 100, 500)"** ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfYUCVasmLXzx8U2j8RoRt8tl1WIJoIkR4uSQX6jMHelz3z9h6TTdR1yuxGeqNRN28PQsYTliCL82Kuq5vUFOSKj8UEsTqb2P-JVxhnfjmSIbCggTYCukEeOV-iRF9h2IjM4vMlJrZS4ZOa1wrwJhbZiRzO?key=uBmrlrvbgmaoEhOXJLGqcA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfYUCVasmLXzx8U2j8RoRt8tl1WIJoIkR4uSQX6jMHelz3z9h6TTdR1yuxGeqNRN28PQsYTliCL82Kuq5vUFOSKj8UEsTqb2P-JVxhnfjmSIbCggTYCukEeOV-iRF9h2IjM4vMlJrZS4ZOa1wrwJhbZiRzO?key=uBmrlrvbgmaoEhOXJLGqcA) 9. Now, Click on the "Save" button and then click on the "Execute Action" button as shown below. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXezM4vbm7oBKQsYzST5x6dAvLHbpwH9JXbhdXnTteLVJhdEbfm_gVjmJc3OxWWjCuSdLN-ECUGr-ptukbvlKRqCrpv4Tgds9m92VMjeP5GOoWPtQve8RrAtZVyFDMBxBmH0NraxXU04F7rurNEeANQUGyr1?key=uBmrlrvbgmaoEhOXJLGqcA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXezM4vbm7oBKQsYzST5x6dAvLHbpwH9JXbhdXnTteLVJhdEbfm_gVjmJc3OxWWjCuSdLN-ECUGr-ptukbvlKRqCrpv4Tgds9m92VMjeP5GOoWPtQve8RrAtZVyFDMBxBmH0NraxXU04F7rurNEeANQUGyr1?key=uBmrlrvbgmaoEhOXJLGqcA) ![image-20260412-132940.png](https://cloudsupport.sequentum.com/__attachments/a_1152acecf3659703ddb05b4a5c5193205bfe9c69e829ce02a60c3a716994d4ad/image-20260412-132940.png?cb=6c6839da5a9655635d59bd3619121ea9) ## **Questions 3** Sequentum Enterprise Commands: where are these in Sequentum Cloud? * Calculated Value * Page Attribute/HTML * Page Attribute/Page URL In SC, the[Data Value](https://cloudsupport.sequentum.com/scm/data-value-overview) command is the one place command in which you can access all these options which are available in "Calculated Value, Page Attribute/HTML, Page Attribute/Page URL". 1. In the "Data Value" command if you select the "Data" option as "Static" it works the same as the "Calculated Value". You can store the fixed-value data and perform the transformation on the Input data, as shown below. ![image-20260412-133100.png](https://cloudsupport.sequentum.com/__attachments/a_f27ab19dbd82a61d269759ea36175a16abec42bdb871f92a1b1a17982ecddeb2/image-20260412-133100.png?cb=370d76ff80cd49171bfe871fcdef6356) 2. In the "Data Value" command you select the "Data" option as "Action Result". Once the "Action Result" is selected you will see another Input box below the Data box. As shown below, ![image-20260412-133144.png](https://cloudsupport.sequentum.com/__attachments/a_13e6808e6585da33f5e80fd67bcd6b1c45365034a77082449d279fc0d0726194/image-20260412-133144.png?cb=363cb2f3a355c04640671f3575b93b04) Click on the Input box It will drop down some options as shown below. Select the "Page HTML" option which provides the same result as the "Page Attribute/ Page HTML" ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcH7vevcLaoM3subBfGHa5EZCd4XroGZ3ulVaSKxIapaDmD422yHyX1fCjbahMNqCwr8vA35MLx2QimeYlXvG9oj_ezJ2j5LjDZ4nsoYk6SMK9LWbmUpzba2iLAm0q7PIBr79y9c_uVJu5wPh3tLL-lFy-F?key=uBmrlrvbgmaoEhOXJLGqcA](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcH7vevcLaoM3subBfGHa5EZCd4XroGZ3ulVaSKxIapaDmD422yHyX1fCjbahMNqCwr8vA35MLx2QimeYlXvG9oj_ezJ2j5LjDZ4nsoYk6SMK9LWbmUpzba2iLAm0q7PIBr79y9c_uVJu5wPh3tLL-lFy-F?key=uBmrlrvbgmaoEhOXJLGqcA) ![image-20260412-133541.png](https://cloudsupport.sequentum.com/__attachments/a_3508f3c64ca7c2d516c549f7e3b520e7e29781378d39c005e805afc6f065da62/image-20260412-133541.png?cb=944bead3766d9e6a0e97bf716570ad7f) 3. In the "Data Value" command you select the "Data" option as "Action Result". Once the "Action Result" is selected you will see another Input box below the Data box. As shown below, ![image-20260412-133437.png](https://cloudsupport.sequentum.com/__attachments/a_b63a93963eea8cf0c650a51346d3ed601fcfa21ba36eae59b474284759b7be7f/image-20260412-133437.png?cb=c4f669d498b21b41b73fbbad12927192) Click on the Input box It will drop down some options as shown below. Select the "Page URL" option which provides the same result as the "Page Attribute/ Page URL". ![image-20260412-133336.png](https://cloudsupport.sequentum.com/__attachments/a_9facaacdf5b9dd3145ca5b94ff6cb52b06419b302ba220230f0fb1a0ab900d27/image-20260412-133336.png?cb=452ba198397325d1583f34784c821cbd) --- language: "en" --- # Moving from SE to SC * **Can I import existing Sequentum Enterprise agents to my Sequentum Cloud account?** * **Sequentum Enterprise** is Sequentum's third-generation data extraction platform, designed for robust, scalable agent development. **Sequentum Cloud** represents the fourth generation in Sequentum's product line, offering a modern, cloud-based architecture for agent management and execution. It supports importing agents created in Sequentum Enterprise using the agent's nested text format. **Note:** This import process is not fully automated. In most cases, agents will require manual review and adjustments after import to ensure proper functionality in Sequentum Cloud. To convert an agent from Sequentum Enterprise to Sequentum Cloud, use the **Export to Sequentum Cloud** option within Sequentum Enterprise. This generates a `CloudExport.zip` file, which can be imported into Sequentum Cloud either by: 1. Dragging and dropping the .zip file into the Sequentum Cloud UI, or 2. Copying the .txt content from the export and pasting it into the Text tab of a new agent in Sequentum Cloud. For complete steps guidance, please refer to [Converting Sequentum Enterprise Agents to Sequentum Cloud Agent Text guidance](https://cloudsupport.sequentum.com/scm/converting-sequentum-enterprise-agents-to-sequentu.md) --- language: "en" --- # Online support and training * **How do I get started?** * Create an account, login, and follow the instructions in our our walkthrough of [how to build your first agent](https://cloudsupport.sequentum.com/scm/build-your-first-agent-overview). * **What other materials are available?** * Use our [Cloud Training](https://cloudsupport.sequentum.com/ct/) page to view a getting started video * Attend a weekly training [webinar](https://www.sequentum.com/webinars). * Read the [manual](https://cloudsupport.sequentum.com/scm/) * **Can I purchase training for myself and my team?** * Yes! Contact us at [sales@sequentum.com](mailto:sales@sequentum.com) if you would like to schedule a private training session or sessions for a fee. --- language: "en" --- # Organizations and Users * **How do users and organizations work in Sequentum Cloud?** * When you create an account on Sequentum Cloud, a new organization will be created for you. You can have multiple users associated with an organization, and those users will have shared access to the agents and the Control Center for that organization. For more, see the [Organization and User Screen](https://cloudsupport.sequentum.com/scm/organization-and-user-screen) section of the manual. * Multiple users cannot all register for the same organization; one user should register as the org admin first, and then once approved, that org admin can add their other team members to their org. * **Can my organization have multiple people logged in and working simultaneously?** * They can't work on the same agent at the same time but they can work on different agents at the same time. --- language: "en" --- # Overview * **There are lots of scrapers on the market - why is Sequentum better?** * Sequentum Cloud offers seamless configuration of scalable agents that effortlessly meet complex requirements. * Built-in change tracking, de-duplication and strong proxy management capabilities as well as Sequentum's exceptional resistance to bot-blocking and new nested text format keep Sequentum ahead of the curve. * Our unique nested text format instructs our absurdly powerful web data extraction and robotic process automation software to interact in deeply customizable ways with all manner of web accessible data -- websites, documents, databases, files, audio streams, images, video, whether via browser, parser or injected JavaScript calls. * Maintaining end-to-end data quality, from ingestion to delivery, exemplifies Sequentum's dedication to excellence and the edge we provide to our clients. These are just a few examples of what makes us the tool to choose for those seeking the Sequentum Edge. * **Does Sequentum Cloud impact Sequentum Enterprise Data Platform or Sequentum Bespoke, our Managed Services?** * Sequentum Enterprise will continue to be supported and updated with the highest of standards as usual. * Sequentum Cloud has a growing team to ensure our same level of customer support. * Our expanded team is in place to onboard customers during these initial months and will be working to ensure our customers are set up for success and are leveraging every powerful component of Sequentum Cloud. --- language: "en" --- # Using Sequentum Cloud Editor to build Online Agents * **What is an agent?** * When we talk about an "agent" at Sequentum, we mean a semi-autonomous application that you write using the Sequentum Cloud Agent Editor. The purpose of an agent is to extract data from a website. It does this by navigating to a site and following the paths that you have instructed it to follow to find specific data, such as product and price information, and then collecting that data into a file. At the end of the process the agent aggregates the data and delivers it to you in a structured format, such as .csv or JSON. Using the Control Center, you can schedule an agent to run periodically to gather new data. * **How do I build my first agent?** * Please use our walkthrough of [how to build your first agent](https://cloudsupport.sequentum.com/scm/build-your-first-agent-overview). * **What can I do if a website is blocked?** * Sometimes when you set up an agent to gather data from a site, you find that your agent is blocked by the site. Blocking is a complex subject with many possible causes. The Sequentum Cloud Agent Editor offers tools for overcoming some types of blocking. Also, using our Residential Proxy Service, as opposed to our standard Data Center Proxies, can help get around certain types of blocking. A good place to learn more about overcoming blocking is in the Sequentum Cloud Manual page on [Agent Configuration](https://cloudsupport.sequentum.com/scm/agent-configuration-overview). --- language: "en" --- # Why we built Sequentum Cloud Since 2008, Sequentum has powered mission-critical, data-driven decisions for Global 500 enterprises, financial institutions, and government agencies. An industry leader in web automation, data extraction and data pipeline infrastructure, we built our reputation on delivering precise, trusted, enterprise-grade web data at scale, all fully auditable, transparent and compliant. As the landscape changed and data became democratized, the tools to collect and operationalize it needed to evolve as well. Our response to this shift is Sequentum Cloud. Sequentum Cloud represents the fourth generation of our technology platform and first fully cloud-based PaaS product. Built on a modern, cloud-native architecture, SOC 2 Type II accredited for enterprise security, it removes the traditional barriers to web data extraction: No downloads. No dedicated servers. No complex installations. No infrastructure management. It is device-independent, self-serve, and pay-as-you-go with built-in access to easy to use and affordable proxies. Our cloud-native PaaS model reduces barriers to entry by eliminating infrastructure requirements and shifting to a usage-based cost model. Users can get started immediately and scale as their needs grow. At its core, Sequentum Cloud leverages nearly two decades of deep expertise in data extraction and process automation. It is a battle-tested, enterprise-grade engine reimagined for universal access. --- language: "en" --- # Cloud Training ## Build your first agent with our video demonstration The video below will demonstrate how to use the Sequentum Cloud Agent Editor to scrape data from a test website called [books.toscrape.com](http://books.toscrape.com/). To follow along with the instructions in the video, you should first [sign in to Sequentum Cloud](https://dashboard.sequentum.com/login) and click the **New Agent** button which will open the Agent Editor. ## Practice building agents that perform specific tasks Our online manual also offers a written guide to [Building your First Agent](https://cloudsupport.sequentum.com/scm/build-your-first-agent-overview). The guide is a walkthrough of how build a simple agent to scrape data. The site we will be scraping from is [training.sequentum.com](http://training.sequentum.com/), a site we built for you to practice your web scraping techniques. The guide covers the basics of capturing a list, structuring the data, and publishing the agent to the Control Center. [![SequentumCloudAgentCreationProcess.gif](https://cloudsupport.sequentum.com/__attachments/a_cd895a3c657c83f243bd4222b6bde8ac9b66eddc927c34dbdaf903db7404449f/SequentumCloudAgentCreationProcess.gif)](https://cloudsupport.sequentum.com/scm/build-your-first-agent-overview) Click above to visit the Building Your First Agent guide Once you have built your first agent, you can continue to learn by using the [training.sequentum.com](http://training.sequentum.com/) site. ## The Training Site [http://training.sequentum.com](http://training.sequentum.com/) contains a list of different types of web elements that you might want to scrape. For each section in the list you can copy the URL and paste it into the Start URL box of the Sequentum Cloud Editor, then use the tools in the editor to build an agent to capture the elements on the page. --- language: "en" --- # Sequentum Cloud Manual Introduction * [Understanding Web Data Extraction](https://cloudsupport.sequentum.com/scm/understanding-web-data-extraction.md) * [Why Sequentum Cloud?](https://cloudsupport.sequentum.com/scm/why-sequentum-cloud.md) * [The Power of Sequentum Cloud](https://cloudsupport.sequentum.com/scm/the-power-of-sequentum-cloud.md) * [Web Data Extraction Challenges](https://cloudsupport.sequentum.com/scm/web-data-extraction-challenges.md) * [Web Data Extraction Techniques](https://cloudsupport.sequentum.com/scm/web-data-extraction-techniques.md) Sequentum Cloud Control Center * [Login and Dashboard page](https://cloudsupport.sequentum.com/scm/login-and-dashboard-page.md) * [Organization and User Screen](https://cloudsupport.sequentum.com/scm/organization-and-user-screen.md) * [Proxy Pool](https://cloudsupport.sequentum.com/scm/proxy-pool.md) * [Destinations](https://cloudsupport.sequentum.com/scm/destinations.md) * [Manage Sequentum](https://cloudsupport.sequentum.com/scm/manage-sequentum.md) * [Manage Labels](https://cloudsupport.sequentum.com/scm/manage-labels.md) * [Manage Spaces](https://cloudsupport.sequentum.com/scm/manage-spaces.md) * [Organizing your Data Operation](https://cloudsupport.sequentum.com/scm/organizing-your-data-operation.md) * [Organizing Your Agents](https://cloudsupport.sequentum.com/scm/organizing-your-agents.md) * [Accounts Management](https://cloudsupport.sequentum.com/scm/accounts-management.md) * [Usage Management](https://cloudsupport.sequentum.com/scm/usage-management.md) Quick Start with Sequentum Cloud * [Quick Start Options](https://cloudsupport.sequentum.com/scm/quick-start-with-sequentum-cloud.md) * [Demo Video](https://youtu.be/KlXagOLx9Ic) * [Quick Tour](https://cloudsupport.sequentum.com/scm/build-your-first-agent-overview.md) * [Build Your First Agent](https://cloudsupport.sequentum.com/scm/building-your-first-agent.md) * [Build An Advanced Agent](https://cloudsupport.sequentum.com/scm/building-an-advanced-agent.md) Sequentum Cloud Editor * [Sequentum Cloud Editor UI](https://cloudsupport.sequentum.com/scm/sequentum-cloud-editor-ui.md) * [Drafting/Debugging an Agent](https://cloudsupport.sequentum.com/scm/drafting-debugging-an-agent.md) * [Parse All Content in Sequentum Cloud](https://cloudsupport.sequentum.com/scm/parse-all-content-in-sequentum-cloud.md) * [Turn on Navigation Mode](https://cloudsupport.sequentum.com/scm/turn-on-navigation-mode.md) * [Nested Text Overview](https://cloudsupport.sequentum.com/scm/nested-text-overview.md) * [Sequentum Cloud Open Developer Tools](https://sequentum.atlassian.net/wiki/display/VEUD/Sequentum+Cloud+Open+Developer+Tools) Sequentum Cloud Commands References * [Agent Configuration Overview](https://cloudsupport.sequentum.com/scm/agent-configuration-overview.md) Browser Commands * [URL Command Overview](https://cloudsupport.sequentum.com/scm/url-command-overview.md) * [Link Command Overview](https://cloudsupport.sequentum.com/scm/link-command-overview.md) * [Open Page Command](https://cloudsupport.sequentum.com/scm/open-page-command.md) * [Open Content Command](https://cloudsupport.sequentum.com/scm/open-content-command.md) Action Commands * [Action Command](https://cloudsupport.sequentum.com/scm/action-command.md) * [Input Action Command](https://cloudsupport.sequentum.com/scm/input-action-command.md) * [Page Action Command](https://cloudsupport.sequentum.com/scm/page-action-command.md) * [Wait For Content Command](https://cloudsupport.sequentum.com/scm/wait-for-content-command.md) * [Test Command](https://cloudsupport.sequentum.com/scm/test-command.md) Extract Commands * [Content Command](https://cloudsupport.sequentum.com/scm/content-command.md) * [Data Value Overview](https://cloudsupport.sequentum.com/scm/data-value-overview.md) * [Data List Command](https://cloudsupport.sequentum.com/scm/data-list-command.md) * [Page area command](https://cloudsupport.sequentum.com/scm/page-area-command.md) * [Page Area List Command](https://cloudsupport.sequentum.com/scm/page-area-list-command.md) * [Group Command](https://cloudsupport.sequentum.com/scm/group-command.md) * [File Link Command](https://cloudsupport.sequentum.com/scm/file-link-command.md) * [Convert Content Command](https://cloudsupport.sequentum.com/scm/convert-content.md) Pagination Commands * [Action Repeater Command](https://cloudsupport.sequentum.com/scm/action-repeater-command.md) * [Link Repeater Command](https://cloudsupport.sequentum.com/scm/link-repeater-overview.md) Other Commands * [Retry Command](https://cloudsupport.sequentum.com/scm/retry-command.md) * [Exit Command](https://cloudsupport.sequentum.com/scm/exit-command.md) * [Branch Command](https://cloudsupport.sequentum.com/scm/branch-command.md) * [Fail Command](https://cloudsupport.sequentum.com/scm/fail-command.md) Export Commands * [CSV Command](https://cloudsupport.sequentum.com/scm/csv-command.md) * [JSON Command](https://cloudsupport.sequentum.com/scm/json-command.md) * [Excel Command](https://cloudsupport.sequentum.com/scm/excel-command.md) * [Parquet Command](https://cloudsupport.sequentum.com/scm/parquet-command.md) * [Snowflake Command](https://cloudsupport.sequentum.com/scm/snowflake-command.md) * [FTP Command](https://cloudsupport.sequentum.com/scm/ftp-command.md) * [Export Scripts](https://cloudsupport.sequentum.com/scm/export-script.md) * [Google Sheets Command](https://cloudsupport.sequentum.com/scm/google-sheets-command.md) * [Google Drive command](https://cloudsupport.sequentum.com/scm/google-drive-command.md) Common Command Properties * [Container Commands Export Overview](https://cloudsupport.sequentum.com/scm/container-commands-export-overview.md) * [Browser Properties Overview](https://cloudsupport.sequentum.com/scm/browser.md) * [Error Handling Overview](https://cloudsupport.sequentum.com/scm/error-handling.md) * [Files Overview](https://cloudsupport.sequentum.com/scm/files-overview.md) Selection Techniques Overview * [Selection Techniques](https://cloudsupport.sequentum.com/scm/selection-techniques.md) * [Editing XPaths Manually](https://cloudsupport.sequentum.com/scm/editing-xpaths-manually.md) * [List Selections](https://cloudsupport.sequentum.com/scm/list-selections.md) * [Sequentum Cloud XPath Functions](https://cloudsupport.sequentum.com/scm/sequentum-cloud-xpath-functions.md) * [Optimizing Selections](https://cloudsupport.sequentum.com/scm/optimizing-selections.md) * [Multiple XPaths](https://cloudsupport.sequentum.com/scm/multiple-xpaths.md) Data * [Using Input Data](https://cloudsupport.sequentum.com/scm/using-input-data.md) * [Exporting Data](https://cloudsupport.sequentum.com/scm/exporting-data.md) * [Tracking Changes](https://cloudsupport.sequentum.com/scm/change-tracking-overview.md) Scripting * [Assembly Reference](https://cloudsupport.sequentum.com/scm/assembly-references.md) * [Script Utilities](https://cloudsupport.sequentum.com/scm/script-utilities.md) * [Data Export Scripts](https://cloudsupport.sequentum.com/scm/data-export-scripts.md) * [Snowflake Export](https://cloudsupport.sequentum.com/scm/snowflake-export.md) * [Condition Scripts](https://cloudsupport.sequentum.com/scm/condition-scripts.md) * [Command Transformation Scripts](https://cloudsupport.sequentum.com/scm/command-transformation-scripts.md) Proxies * [Proxies](https://cloudsupport.sequentum.com/scm/proxies.md) Captcha Handling with Sequentum Cloud * [Captcha Handling with Sequentum Cloud](https://cloudsupport.sequentum.com/scm/captcha-handling-with-sequentum-cloud.md) Configuring Multi-Session with Sequentum Cloud * [Configuring Multi-Session with Sequentum Cloud](https://cloudsupport.sequentum.com/scm/configuring-multi-session-with-sequentum-cloud.md) --- language: "en" --- # Accounts Management After a successful login, when we click on the 'Account' option, three options are displayed: API Keys, Change Password, and Log Out. With the help of these options, users can change their password, Add or edit their API keys, and log out from the current screen. ![image-20250602-122019.png](https://cloudsupport.sequentum.com/__attachments/a_ac16a4cb40295c6c57b68a490cea76f4b572b1b4edf5b9791f151b4d1942bcf3/image-20250602-122019.png?cb=85f3b98ab0952eadcff6215d48cf51dc) **API Keys:** Users have the option to create a new API key with a specified expiry date by clicking the 'New API Key' button. ![image-20250603-051353.png](https://cloudsupport.sequentum.com/__attachments/a_61d337dcc97e3c2be3a079b769bad80ab4fb57b2086a73211144c6283ffee975/image-20250603-051353.png?cb=54776d4286091cd4bc08c534ff230d36) After clicking the 'New API Key' button, the 'API Keys / New' window will open. Here, the user can enter the required details and click the 'Add Key' button to create a new API key. ![image-20250603-051543.png](https://cloudsupport.sequentum.com/__attachments/a_868b2e7b9b1bf1eb60254fae23a669dad549dd1f9e875c57345a40dbd68ee952/image-20250603-051543.png?cb=34d636a710da2e895e46829bf6456591) Once an API key is created, users can also update or delete existing API keys using the 'Edit' and 'Delete' options available in the context menu, as shown below. ![image-20250603-052037.png](https://cloudsupport.sequentum.com/__attachments/a_5eb295837e8bcd94bce75c79cbf11a69ce108b396b8e2896a923483f8dc47839/image-20250603-052037.png?cb=e06443b64698d4b056dbd338aa39f13a) **Log Out:** When a user selects the 'Log Out' option, a logout window will appear. Upon clicking 'Logout,' a confirmation popup will be displayed to confirm the logout action. Once the user confirms, they will be logged out and redirected to the login screen. ![image-20250603-054311.png](https://cloudsupport.sequentum.com/__attachments/a_4e35b75f6e180a0fe69bc39c75821128c016a25b523b011c8e8271cfb85c8d96/image-20250603-054311.png?cb=e357d2972ccc9c18573173b80063d80e) ![image-20250603-054346.png](https://cloudsupport.sequentum.com/__attachments/a_7b64f248189f161dc62d5c1c20c0ed403d0d074f779e7aa1cd68012e7361763a/image-20250603-054346.png?cb=fab32bcda6bb78ca142cc21a783bcf45) This ensures that no further actions can be performed until the user logs in again. **Change Password:** By selecting the 'Change Password' option, users are directed to a 'Change Password' window where they are required to enter their current password, along with the new password they wish to set. The new password must be entered twice for confirmation to avoid any errors. Once the details are submitted, the user's password will be updated, and they can use the new credentials the next time they log in." ![image-20250603-060549.png](https://cloudsupport.sequentum.com/__attachments/a_c80b1ac4c735211184b50b2b1f79d8ecd33d239a5f28c6e18fa68654b682179d/image-20250603-060549.png?cb=d22d0e9255f0e3b77c3908f6b0efe0ee) --- language: "en" --- # Action Command The Action command performs actions such as mouse clicks on web elements like links, buttons, and menus. It can be applied to any type of web element, enabling interactions within a web page. The screenshot below demonstrates a simple example where the Action command is used. ![image-20250902-191608.png](https://cloudsupport.sequentum.com/__attachments/a_6a3845770cea5b5e652b5d96022e6146176ba15ef971608686b9bc92dbe4d26c/image-20250902-191608.png?cb=58e5d92b4bf4e9fd9e90ac475af3c0e2) The **Action** command is located under the **Action**section in the New Command palette (refer the below snapshot) ![image-20250902-192008.png](https://cloudsupport.sequentum.com/__attachments/a_f934801a110b077a814197eb1c82ed97e008852bf58c402e06fc13e0a1e55e1a/image-20250902-192008.png?cb=ca99beb9a937b2feba57e48205c29ae7) In order to make the optimum use of the 'Action' command, we can configure the options as shown in the below screenshot, as per the user requirement. ![image-20250902-192231.png](https://cloudsupport.sequentum.com/__attachments/a_7312023be7f2cbc8736e2495f95d73a4fca084320c5da6ed330f047c20d1e69d/image-20250902-192231.png?cb=e4869d99a072cd6c16417d43c36b1099) ## **Command Configuration** The configuration screen for the Action command has three tabs viz. Browser, Options, and Text. Use the **Browser** tab to select command XPath and apply selection transformations. Use the **Options** tab to set the command name and other command properties. Use the **Text** tab to navigate to the text of the agent where the command part is present. ![image-20250902-192428.png](https://cloudsupport.sequentum.com/__attachments/a_c0ecf2836a5912f1d533dc79e4b2957eace2fff44a03a373c1a49702d8eb5dee/image-20250902-192428.png?cb=304c3af16e3cec8ba734022518a483c6) ## **Command Properties** On the **Options** tab of the command, we have six options: 1. General Settings 2. Action 3. Browser 4. Wait for Content 5. Error Handling 6. Export ![image-20241021-070003.png](https://cloudsupport.sequentum.com/__attachments/a_1562be702e6e6e3cbae24fe1f7e8f707587182fe87348d5fe036021683856a6a/image-20241021-070003.png?cb=4a2364fb09cdcc3cf68016d680b99354) ### **General Settings → General Command Settings** The 'General command settings' section is designed for user customization to give the command a desired name, comment to describe in brief about the usability or requirement for the command and the disabled option to not execute this command at all. ![image-20241021-070209.png](https://cloudsupport.sequentum.com/__attachments/a_b1c07234a27e8075038d2a09542d9ec142b78cfa8284666cc0e0f28067b2776b/image-20241021-070209.png?cb=af774b4f16a56070d0236152eae48547) * **Command name:** This textbox allows the user to change the name of the command according to their requirements. By default, the command is named **Action**. * **Comments:**This textbox is used to add comments for this command, helping other users understand its purpose and functionality, similar to the description. By default, this textbox is blank and does not contain any text. * **Disabled:**This option is used to disable the command. By default, it is unchecked, indicating that the command is enabled. ### **Action → Selected action element** ![image-20250902-194341.png](https://cloudsupport.sequentum.com/__attachments/a_88e506a37204c995702944b7d7dde10fd014f86f568406b232fd7ce0e8ebf0da/image-20250902-194341.png?cb=4969c95aa4e8e40c8a21a318a185f1d7) * **When missing:** This option lets the user select one of four actions from a dropdown menu to specify what should happen if the selected element is missing. The default value is set to "**Warn**". * **Fail:** If the element is missing, An error message is generated in the logs and the agent fails. * **Warn:** If the element is missing, A warning message is generated in the logs and the agent continues. * **Ignore:** If the element is missing, the agent skips child commands and moves to the next command. * **Passthrough:** If the element is missing, the agent ignores it and continues executing child commands. * **When hidden or disabled:** This option lets the user select one action from a dropdown menu to specify what should happen if the selected element is hidden or disabled. The default value is set to "**Select**". * **Select :**If the element is hidden or disabled the element will be available for selection. * **Ignore :** If the element is hidden or disabled the command will be ignored. * **Selected action element :**In this section, the user can view the selected element in HTML format, displayed within the box. Please note that this HTML content is non-modifiable, meaning the user cannot make changes to it. This feature is particularly intended to allow users to see the selected element. ### **Action → Action settings** These settings allow you to modify the default action, specify a custom action, enable or disable the action script, and indicate if the action interrupts/breaks an HTML area. ![image-20241021-070405.png](https://cloudsupport.sequentum.com/__attachments/a_a6902874233a7b4b2b1517226d5263721be61042b31b227f124dbe994a4d994c/image-20241021-070405.png?cb=1ba0464b91f8bbe531c776fe6c3bc2b0) * **Action script:** This section displays the action script associated with the command, which is used to trigger specific actions. By default, this is set to element.click(), but users can modify it to suit their needs by selecting a different action script. When the default action script is enabled, you can observe the actions the agent performs, though editing is restricted. Once disabled, you can customize the actions using most standard HTML element interaction functions, with each command written on a separate line. * **Use default action script:** This checkbox/option allows you to enable or disable the default action script for the command. When checked, the default action script is used. Unchecking it gives you the flexibility to specify custom events manually for the command. By default, it is checked. * **Break List:** This setting specifies whether the action disrupts an HTML area. Actions that load a new page automatically break HTML areas. By default, this is set to "**Default**". There are three options available: * **Default**: Uses the default setting for breaking HTML areas. * **Yes**: Enables the Break List option. * **No**: Disables the Break List option. ### **Browser** Please refer to the "[++Browser++](https://cloudsupport.sequentum.com/scm/browser.md)" section for more insight. ### **Wait for content → Wait For Content settings :** Wait for Content command can be used to wait for web content to appear on a web page, or to wait for a specific URL to complete loading. When a Wait for Content command is configured to wait for web content, a web element must be selected in the web browser, and the Wait for Content command's parent action command will wait until that web element is available on the web page. *These* ***Wait for Content*** *settings are only effective with an active browser wait selection*, meaning they will only function with the current active web browser. The UI of the Wait for Content section also includes a note at the top indicating this requirement, as shown in the screenshot below. ![image-20250902-195245.png](https://cloudsupport.sequentum.com/__attachments/a_ec82c50fccecb7002c181c6200cbfd8e3eee090fab345f9534da1eca5bed1cb8/image-20250902-195245.png?cb=8d01ebc2bc679d0ca5c6ab5525af61fd) **Requirement:** This option allows the user to specify their preference for how the command should handle waiting for content to appear or for a specific URL to fully load. From the dropdown menu, you can choose between **Required** , **Optional** or **No Wait** options. The default value is set to **Required**. * **Required:** The action command will focus on waiting for content to appear or for a specific URL to fully load. If the content doesn't appear within the specified **Wait for Content Timeout**, the command will fail. * **Optional:** The action command is designed to wait for content to appear or for a specific URL to fully load. The parent action command will not fail if the content doesn't appear within the specified **Wait for Content Timeout**. * **No Wait:** The parent action command is configured to complete as soon as the content appears, without waiting for it to fully load. **Timeout:**The default number of seconds to wait between action to complete and page is parsed. The default value is 60 seconds. The user can update it as per his requirements. **Wait for removal:** When enabled, this checkbox ensures the command waits until the selected element is removed from the page before continuing. It waits for content to be removed rather than just being present. By default, this option is disabled. **Wait for visibility:** This checkbox ensures the command waits until the selected element is visible on the page before moving on to the next step. By default, this option is enabled. **Wait for change:**When enabled, this checkbox waits until any change occurs on the page before proceeding to the next step. This option is enabled by default. **Search All Frames:**This dropdown menu option specifies whether to wait for all frames on the page to fully load, ensuring that all content across multiple frames is loaded before continuing. * **Default:**Inherits the setting from the parent command. * **Yes:** Checks the URL of all frames and monitors all web requests that load content asynchronously. * **No:**It will check only the selected frames. ### **Error Handling** Please refer to the "[++Error Handling++](https://cloudsupport.sequentum.com/scm/error-handling.md)" section for more insight. ### **Export** Please refer to the "[++Export++](https://cloudsupport.sequentum.com/scm/container-commands-export-overview.md)" section for more insight. --- language: "en" --- # Action Commands Action commands are used to perform interactions on the web, such as clicking buttons, filling out forms, or waiting for certain content to load. They simulate user actions, enabling agents to interact with websites in a way that facilitates data extraction, especially from dynamic or interactive web pages. * [Action](https://cloudsupport.sequentum.com/scm/action-command.md) * [Action Repeater](https://cloudsupport.sequentum.com/scm/action-repeater-command.md) * [Input Action](https://cloudsupport.sequentum.com/scm/input-action-command.md) * [Page Action](https://cloudsupport.sequentum.com/scm/page-action-command.md) * [Wait For Content](https://cloudsupport.sequentum.com/scm/wait-for-content-command.md) * [Test](https://cloudsupport.sequentum.com/scm/test-command.md) --- language: "en" --- # Action Repeater Command The Action Repeater command automates the repeating actions such as clicking each button in a list or navigating through several links. It is ideal for tasks that involve repeated interactions with similar elements, continuing the action until no new web elements are detected. This makes it especially useful for tasks like following pagination links, where you need to navigate through multiple pages. The screenshot below demonstrates a simple example where the Action Repeater command is used. ![image-20260404-142033.png](https://cloudsupport.sequentum.com/__attachments/a_29fb23dc998cd69e673fec8923b2da76fda0fb12046bd4028a64bc951ad64e73/image-20260404-142033.png?cb=e3af34152fce1ba9c8cd07ecc6bde493) Action Repeater command In this case, the Action Repeater is configured to repeatedly click on a web element labelled **Next** until there are no additional new web elements available. You can access this command under the 'Action' category within the command palette (refer to the screenshot). ![image-20260404-142156.png](https://cloudsupport.sequentum.com/__attachments/a_b7dcd4665b1393cb790dd2ec8de96122dd541c5b62cc93c1d7148b2384d9d69c/image-20260404-142156.png?cb=b9f33d8d1f175494bbc68fdb9c6b410b) Placement in the command template ## **Command Configuration** The configuration screen for the URL command has three tabs viz. Browser, Options, and Text. Use the **Browser** tab to select command XPath and apply selection transformations. Use the 'Options' tab to set the command name and other command properties. Use the **Text** tab to navigate to the text of the agent where the command part is present. ![image-20260404-142411.png](https://cloudsupport.sequentum.com/__attachments/a_ec3016109dc7148f18fe79cbf6b162cdff438478c00dd458bfae3fce7a44cfd9/image-20260404-142411.png?cb=6585cb71cddb05c9f5afe7fcc3d0fcfe) Command Configuration ## **Command Properties** On the **Options** tab of the command, we have seven options: 1. General Settings 2. Repeater 3. Action 4. Browser 5. Wait For Content 6. Error Handling 7. Export ![image-20241021-135730.png](https://cloudsupport.sequentum.com/__attachments/a_f5899c225eafc0972efb107f56ef4e19b0908811fb18ce306cb90a5db3024983/image-20241021-135730.png?cb=b1ef46a0b79bd8509f9406928e368d01) ### **General Settings → General Command Settings** The 'General command settings' section is designed for user customization to give the command a desired name, comment to describe in brief about the usability or requirement for the command and the disabled option to not execute this command at all. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXftbR380bXUcYu7lfaCxaYF96fXgqotXcUOun800kohaC-UC2CiTv1luXFu0LeSKS8sHvlLVNoiVZRYW3Y2gDqRsz4YeaAd-vF3KBmtvmgkE47qowAc8RFD-oFnDBwCkpbPRlF3?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXftbR380bXUcYu7lfaCxaYF96fXgqotXcUOun800kohaC-UC2CiTv1luXFu0LeSKS8sHvlLVNoiVZRYW3Y2gDqRsz4YeaAd-vF3KBmtvmgkE47qowAc8RFD-oFnDBwCkpbPRlF3?key=jOQaYoaNITRy4hsSofPW4Q) * **Command name:** This property specifies the name of the command. By default the name is provided as "Action Repeater" but we can also manually change the name and can give any desired name as per the requirement. * **Comments:** Provides a field for entering metadata or a brief description regarding the command. These annotations are used internally to provide context for developers or team members. Comments are not part of the exported data and are only used for documentation purposes within the configuration. * **Disabled:** This checkbox allows the user to disable the command. When checked, the command is ignored during execution. By default, it is unchecked. ### **Repeater → Repeater Settings** The **Repeater Settings** section enables users to configure actions they wish to repeat, set limits and control looping behaviour. ![image-20241021-135901.png](https://cloudsupport.sequentum.com/__attachments/a_49b9211ace27ddfa7a764c876374fd89578ad939492cca8cc658a0c169c90483/image-20241021-135901.png?cb=8230681bb9a88615adc0d17774620625) * **Repeat:**This option allows the user to specify the action they wish to perform on the selected web content. * **When Exists:** This option continues to repeat the action as long as a selected object is available for it to be performed on. * **When New:**This option repeats the action whenever a new object appears, instead of using the previously selected one. * **Loop Control:**This option enables the user to specify where to start or end the loop during pagination. The user must select this option from the available choices: Exit or Entry. * **Exit:** Evaluates the condition after the child commands have been executed for the first time. * **Entry:** Evaluates the condition before executing the child commands. * **Repeat Limit:**Specify the maximum number of times the loop should repeat. ### **Action → Selected action element** ![image-20241021-135940.png](https://cloudsupport.sequentum.com/__attachments/a_0b34fc69fc7395e162b0eb8f11802a6f48ff6204bea4c7e62804b85ff45830b5/image-20241021-135940.png?cb=0fb58d206b72b413c660b3bde4cef47b) * **When action element missing:** This dropdown menu allows users to specify the agent's behavior when content is not found. The default option is **Warn**, which means the agent will log a warning message and continue executing the next command. * **Fail**: The agent will stop and return an error, or if there are parallel commands, it will log the error and move to the next parallel command. * **Warn**: The agent logs a warning but continues processing further commands. * **Ignore**: The agent neither logs an error nor a warning, and it skips any child commands, moving to the next parallel command. * **Passthrough**: The agent ignores the error but continues to execute the child commands. * **Selected action element:**This section displays the selected element that the command has selected on the current page. If no action element is selected or if the selection is missing, it will display the message "No selected content" inside this textbox. This textbox is not editable. ### **Action → Action Settings** The **Action settings** section determines the JavaScript actions to be performed using this command. Default value is 'element.click()'. The user can also customize the actions after unchecking the 'Use default action script' checkbox. ![image-20241021-140015.png](https://cloudsupport.sequentum.com/__attachments/a_294e77b200edb674e5d781a46f018632ce68e417fe20d5466be82bfba6c273dd/image-20241021-140015.png?cb=9af42b4c50f06b020012063bce6ba277) * **Action Script:** This pane defines the JavaScript actions that will be performed. Based on the selection in the form field, the actions are automatically generated by the command. A user can also manually use JavaScript actions post unchecking the 'Use default action script' checkbox. * **Use default action Script:** This check box determines if the automatically generated action is appropriate for the command or not. If a user wants to input different actions, then the user must uncheck the box and then input the actions in the 'Action script' manually. * **Break List:**Specifies whether the action breaks an HTML area. Actions that load a new page always break HTML areas. Its default value is set as 'default' that can be updated to 'Yes' or 'No' based on the page load. * **Yes**: Enables the Break List option. * **No:** Disables the Break List option. ### **Browser** Please refer to the "[++Browser++](https://cloudsupport.sequentum.com/scm/browser.md)" section for more insight. ### **Wait for Content → Wait for Content settings** Wait for Content command can be used to wait for web content to appear on a web page or to wait for a specific URL to complete loading. When a Wait for Content command is configured to wait for web content, a web element must be selected in the web browser and the Wait for Content command's parent action command will wait until that web element is available on the web page. These **Wait for Content** settings are only effective with an active browser wait selection, meaning they will only function with the current active web browser. The UI of the Wait for Content section also includes a note at the top indicating this requirement, as shown in the screenshot below: **Requirement:** This option allows the user to specify their preference for how the command should handle waiting for content to appear or for a specific URL to fully load. From the dropdown menu, you can choose between 'Required', 'Optional', or 'No Wait' options. The default value is set to "Required". ![image-20241021-140058.png](https://cloudsupport.sequentum.com/__attachments/a_6c0d28662d55475793cabaaa41d24066433bf882c1cb45b0dcc4220ef0c4fe95/image-20241021-140058.png?cb=ca0d9f4a663bff7debcc4a59f3dcdee8) * **Required:** The action command will focus on waiting for content to appear or for a specific URL to fully load. If the content doesn't appear within the specified **Wait for Content Timeout**, the command will fail. * **Optional:** The action command is designed to wait for content to appear or for a specific URL to fully load. The parent action command will not fail if the content doesn't appear within the specified **Wait for Content Timeout**. * **No Wait:** The parent action command is configured to complete as soon as the content appears, without waiting for it to fully load. **Timeout(seconds):**The default number of seconds to wait between action to complete and page is parsed. The default value is 60 seconds. The user can update it as per his requirements. **Wait for removal:** When enabled, this checkbox ensures the command waits until the selected element is removed from the page before continuing. It waits for the content to be removed rather than just being present. By default, this option is disabled. **Wait for visibility:** This checkbox ensures that the command waits until the selected element is visible on the page before moving on to the next step. By default, this option is enabled. **Wait for change:**When enabled, this checkbox waits until any change occurs on the page before proceeding to the next step. This option is enabled by default. **Search All Frames:**This dropdown menu option specifies whether to wait for all frames on the page to fully load or not, ensuring that all content across multiple frames is loaded before continuing. * **Default:**Inherits the setting from the parent command. * **Yes:** Checks the URL of all frames and monitors all web requests that load content asynchronously. * **No:** It willCheck only the selected frames. ### **Error Handling** Please refer to the "[++Error Handling++](https://cloudsupport.sequentum.com/scm/error-handling.md)" section for more insight. ### **Export** Please refer to the "[++Export++](https://cloudsupport.sequentum.com/scm/container-commands-export-overview.md)" section for more insight. --- language: "en" --- # Agent Approval Workflow ## **Overview** Agent Approval is an organization-level control that requires an agent to be reviewed and approved by an org admin --- or by a user in a group with **Approve** access --- before that agent can not be **scheduled** or **run via API**. Approval is tracked per agent and shown as a status badge next to the agent's name: **Not Approved** , **Pending Approval** , or **Approved** . All of the controls for submitting, approving, and disapproving an agent live on a new **Approval** tab on the agent page. **Note:** Manually running an agent from the UI (the **Run** button) is not blocked by this setting. Only **Schedule** and **run via API** are gated behind approval. ## **Enabling Agent Approval for your organisation** Agent Approval is off by default and is turned on per organisation. 1. Go to **Manage → Organization → Agent Approval**. 2. Toggle **Require agent approval** on. 3. Confirm the change in the dialogue by clicking **Enable Agent Approval**. 4. Click **Save** . ![image-20260819-151209.png](https://cloudsupport.sequentum.com/__attachments/a_66184b25c6d29c7c1ae8d5f236faeadbb8610a7de816e8abdef5042291c68bcc/image-20260819-151209.png?cb=2bcf18d9a81b2e134c670819ecb22c7c) *Agent Approval, off --- the default state for an organisation.* ![image-20260819-171542.png](https://cloudsupport.sequentum.com/__attachments/a_8f90ac855466b3475fc5d21b43238ac4668f01cc803ff2308dee2bd4e85a5968/image-20260819-171542.png?cb=fb94b146f9c1817f4b052c380eb98e59) *Toggling Require agent approval on.* ![image-20260819-171709.png](https://cloudsupport.sequentum.com/__attachments/a_37ff436a9fa984534fa32af247cf5948611afa2cf9580e40715d6dbdd02270a7/image-20260819-171709.png?cb=8027e6736a846f2cef092d098f0babab) *Confirmation dialog shown before the setting takes effect..* **Note:**All existing agents in the organisation are automatically pre-approved the moment this setting is turned on. Only agents created (or updated, depending on the re-approval setting) after that point start out as Not Approved. ## **The Approval tab** Every agent that is subject to approval has an **Approval** tab alongside Info, Versions, Runs, Schedules, and the rest. The screenshot below is annotated to show where everything lives: ![image-20260819-172628.png](https://cloudsupport.sequentum.com/__attachments/a_7fefbe219aef115f21f123291cd14f3543eb7434f79d8e871c8f17315ecd608b/image-20260819-172628.png?cb=8032c5311235a2e89348ac475d78d0d7) *Anatomy of the Approval tab on an approved agent.* * **A --- Status badge**: shows the agent's current approval state (Approved, Not Approved, or Pending Approval) next to its name, visible from every tab. * **B --- Approval tab**: where all approval actions for this agent live. * **C --- Approval details**: who approved the agent, when, and whether it will need re-approval after future updates. * **D --- Disapprove Agent panel**: appears once an agent is approved, so it can be revoked. * **E --- Notify checkbox**: optionally emails the agent's developer that it was disapproved. * **F --- Disapprove Agent button**: opens a confirmation dialog before the change is applied. ## **What changes for a new agent** Once Agent Approval is enabled, any newly created agent starts out **Not Approved** . On the agent page, the **Schedule** button is greyed out and cannot be used until the agent is approved --- the same restriction applies to running the agent via API. ![image-20260819-173300.png](https://cloudsupport.sequentum.com/__attachments/a_654e3fd50c7c06702c3436215c6ebd82816daf677905894b6d77acf1efdbeb10/image-20260819-173300.png?cb=08d094b9074c09509197ba451c99b8ff) *A new agent (API_TEST): Schedule is disabled because the agent has not been approved. Run from the UI is still available* ![image-20260819-173402.png](https://cloudsupport.sequentum.com/__attachments/a_b55df6f83561148d603e8402bfd4940157bfc6eb011e88b783423b33869ed5be/image-20260819-173402.png?cb=e16524c0897c9cd8883c5a4008d0052d) *The same agent as it appears in its space's agent list before it has any approved run activity.* ## **Submitting an agent for approval** 1. Open the agent and go to its **Approval** tab. 2. Under **Submit for Approval** , adjust the **Message** if you want to add context for the approver (it defaults to "Please review and approve this agent for production use."). 3. Optionally check **Send email to notify a specific approver** and pick an **Approver** from the dropdown. 4. Click **Submit for Approval** . ![image-20260819-173550.png](https://cloudsupport.sequentum.com/__attachments/a_0ead1c5e068413cf859862a4eca0ef93506d7de055fd3e32f249edd3e77ac74d/image-20260819-173550.png?cb=bfba478b953432f05bea4fadb5cde82f) *Submitting an agent for approval, with no specific approver selected.* ![image-20260819-173639.png](https://cloudsupport.sequentum.com/__attachments/a_a03a75ea6cac109cb7c1eec0d94b56af62a9fc94405f620abda195348914e4cc/image-20260819-173639.png?cb=eec7beae987825f927f4a2b277a9a622) *Selecting a specific approver to notify by email.* **Note:**Selecting a specific approver only decides who gets notified by email --- it does not restrict who is allowed to act on the request. Any org admin, or any user in a group with Approve access, can approve or disapprove the agent, whether or not they were the one selected. Once submitted, the agent's badge changes from **Not Approved** to **Pending Approval**, and the request appears for approvers both on the agent itself and on the organization-wide Pending Approvals page. ![image-20260819-173826.png](https://cloudsupport.sequentum.com/__attachments/a_6968db2cad219f26272718ece0cc51f8c87a0ae3985f912e442d0dd3081d077a/image-20260819-173826.png?cb=4b55f522dd8320e60816d3c52c4fbec9) *Agent status after submission: Pending Approval, with the Approval Decision panel ready for an approver.* ## **Approving an agent** An approver can act on a request in either of two places. ### **From the agent's Approval tab** 1. Open the agent while it is **Pending Approval** and go to its Approval tab. 2. Under **Approval Decision** , leave **Approve agent** toggled on. 3. Leave the **Require re-approval after future updates** checkbox checked if the agent needs to be approved again after it is next edited, or leave it unchecked otherwise. 4. Optionally check **Send email to notify agent developer**. 5. Click **Confirm Approval** . ![image-20260819-173936.png](https://cloudsupport.sequentum.com/__attachments/a_31da2aaa2a15c8aefc7b4ff5f3798b9e538da52a488f350a7950794942accb68/image-20260819-173936.png?cb=b162a20edd830e9cc7969d371fa7b1dc) *Approving a request directly from the agent's Approval tab.* ### **From the organization's Pending Approvals page** **Manage → Organization → Pending Approvals** lists every agent across the organization that is currently awaiting approval, with the requesting space, who requested it, when, and the submitted message. ![image-20260819-174123.png](https://cloudsupport.sequentum.com/__attachments/a_56be76562556cb9f7d677cf17979ce8c9ca3e7efd2b776acce04593e8b400582/image-20260819-174123.png?cb=f7a88120e4924d4ee2c9007c7f7f7b45) *Pending Approvals with nothing awaiting review.* 1. Go to **Manage → Organization → Pending Approvals**. 2. Find the agent and click **Approve** on its row. 3. Fill in the Approval Decision panel that expands below the list and click **Confirm Approval** . ![image-20260819-174301.png](https://cloudsupport.sequentum.com/__attachments/a_18c0fd6ca0e8b429857b1efaf0113abcab7c35f1cc309f830bea4f6348a7414a/image-20260819-174301.png?cb=998d916af51cfe8b55c42af1665131ab) *An agent (API_TEST) awaiting approval, listed for the org admin.* ![image-20260819-174355.png](https://cloudsupport.sequentum.com/__attachments/a_f3316755b5e066b452a78ded45c333f31c6378dfacb854eb743ddcf991bd8283/image-20260819-174355.png?cb=a51911b6170199f363d8acf63905f879) *The Approval Decision panel, expanded inline from the Pending Approvals list.* ![image-20260819-174503.png](https://cloudsupport.sequentum.com/__attachments/a_762c1f2f7bb037e8fa708a27edb536f2505ebd648a5993b0fee19800a9ae7175/image-20260819-174503.png?cb=627c93c035ad4d16615a6b7e7899507b) *Confirmation after approving --- the agent drops off the Pending Approvals list.* Once approved, the agent's badge changes to **Approved**, its Approval tab shows who approved it and when, and it can immediately be scheduled or run via API. ![image-20260819-174631.png](https://cloudsupport.sequentum.com/__attachments/a_d66d89efca605130961cf5db6180c19d5eee6fd433f43c38d7fad096226d8d0a/image-20260819-174631.png?cb=a5dfecadb07cf6c1be0654c0b29699dd) *The agent's Approval tab after approval.* ## **Disapproving an agent** Approval can be revoked from an already-approved agent at any time, whether or not it currently has active schedules. 1. Open the approved agent and go to its **Approval** tab. 2. In the **Disapprove Agent** panel, edit the **Message** if needed (it defaults to a note asking the developer to make changes and resubmit). 3. Optionally check **Send email to notify agent developer** and choose the developer from the dropdown. 4. Click **Disapprove Agent**. 5. Confirm the action in the dialogue. ![image-20260819-174823.png](https://cloudsupport.sequentum.com/__attachments/a_fab98d4820c395f96a050dd9b30958b540e2fe23b6c58c31d741537b222fed54/image-20260819-174823.png?cb=a1f3824884a30d6674a45003b6eb0612) *Disapproving an agent, with the developer notification enabled.* ![image-20260819-174923.png](https://cloudsupport.sequentum.com/__attachments/a_f882328dbdfb4d016f2e70691d65aab431b04807e4b45d797f82dd8a18890831/image-20260819-174923.png?cb=5400e296a58eb1051665911d74de6cab) *Confirmation dialog shown before an agent is disapproved.* **Note:**Disapproving an agent immediately turns off all of its schedules. It also blocks it from running via API again until it is resubmitted and re-approved. ![image-20260819-175046.png](https://cloudsupport.sequentum.com/__attachments/a_f11b835027ed02508c92647fbdc301a2b36ce6081d49208f6fe6f74f36878bff/image-20260819-175046.png?cb=58c640214b8fb50858e104d2a8e77402) Disabled schedule post disapproval The agent's badge changes back to **Not Approved**, and the Submit for Approval panel reappears so it can be sent back for review once changes are made. ![image-20260819-175222.png](https://cloudsupport.sequentum.com/__attachments/a_7955afedd732ee3afeff8e411d008657f1915909321e4173c51f731c62091277/image-20260819-175222.png?cb=e94c634a8de55cc1755568a814e87570) *Agent status immediately after being disapproved.* ## **Granting approval access to a user group** Approving and disapproving agents is not limited to org admins. Approval is one of the access levels that can be granted to a user group on a per-space basis, alongside Full, Read, Write, Delete, Run, and Schedule. 1. Go to the space and open **Edit Space**. 2. Under **User Group Access**, add the user group (or locate it if it's already listed). 3. Check **Approve** for that group. 4. Click **Save Space** . ![image-20260819-175334.png](https://cloudsupport.sequentum.com/__attachments/a_f27ca6bdbf49856eef716df71e229558a4b2d6e11b3b74ba9a36f69d24c7e793/image-20260819-175334.png?cb=9b43301677023a53f47dd05d2825b53d) *Granting a user group Approve access on a space, alongside its other permissions.* **Note: Default Access** grants every user in the organization all permissions on a space except Approve. To let a group of users approve or disapprove agents in a space, it must be added under User Group Access with Approve (or Full) checked explicitly. --- language: "en" --- # Agent Builder The Agent Builder in Sequentum Cloud is an AI-powered capability that enables users to create data extraction agents using natural language instructions. Instead of manually configuring extraction steps and workflows, users can describe the required automation in plain English, and the platform automatically generates the agent structure and extraction logic. Agent Builder is designed to simplify and accelerate the creation of common to moderately complex web scraping workflows. By combining AI-driven prompt interpretation with Sequentum Cloud's enterprise-grade automation framework, it reduces development effort while making agent creation more accessible to both technical and non-technical users. ## Creating an Agent Using Agent Builder Follow the steps below to create an agent using AI-assisted workflow generation. ### Steps to Create an Agent 1. **Open the Agent Creation Menu** : From the Sequentum Cloud dashboard, navigate to the **New Agent** option available in the main Home page and spaces. This option allows users to create a new extraction agent from scratch. 2. **Select Build with AI :** In the agent creation options, select Build with AI to launch the Agent Prompt Builder interface. The Agent Prompt Builder provides a conversational input area where users can describe the workflow they want to automate using natural language. ![image-20260513-163700.png](https://cloudsupport.sequentum.com/__attachments/a_7cfb1cdbc9867d711f46f0c9447f095a4f62fe299a597bfaf08727ce45ede182/image-20260513-163700.png?cb=af881eb4fead3ee20ed3ada0c6cd3419) Create new agent window 3. **Enter the Workflow Instructions:** In the prompt input field, provide a clear and detailed description of the extraction workflow. The more specific the instructions, the more accurately the AI can generate the required agent structure. You can include details such as: * Target website or URL * Type of data to extract * Pagination requirements * Navigation steps * Filters or categories * Output expectations ![Screenshot 2026-05-12 191212-20260512-134212.png](https://cloudsupport.sequentum.com/__attachments/a_be5a8fbbf94b5456ea89c58d4be202a21309824ab7ef1d94fa22621c504e9f98/Screenshot%202026-05-12%20191212-20260512-134212.png?cb=b40600db8458964622f1ccef469c5439) Sample User prompt for agent builder #### **Example Prompt** `Extract details from the URL https://www.nike.com/w/mens-shoes-nik1zy7ok with pagination` 4. **Click Build Agent** After entering the instructions, click Build Agent. The platform will process the prompt using AI and begin generating the extraction workflow automatically. During this process, Sequentum Cloud interprets the request, identifies the target page structure, and creates the corresponding agent steps. ![image-20260513-163804.png](https://cloudsupport.sequentum.com/__attachments/a_91b5a32fc6ce7bcf13f678750808a10cad2de7af633cb5a31567ff372938d44e/image-20260513-163804.png?cb=aa46db1c084bbb0e2af2e9e7d4023ccd) Build agent screen 5. **Review the Generated Workflow** Once the generation process is complete, the newly created agent will open.Review the generated workflow carefully to verify: * Navigation steps are correct * Data fields are mapped properly * Pagination logic is working as expected * Extraction actions are aligned with the requested workflow #### 6. **Refine the Agent if Required** Depending on the complexity of the target website, minor adjustments may be required before execution. Users can further refine the generated agent 7. **Save and Run the Agent** After validating the workflow, save the agent configuration and execute the agent to begin data extraction. The extracted data can then be reviewed, exported, or integrated into downstream workflows based on the configured output settings. ![image-20260513-164238.png](https://cloudsupport.sequentum.com/__attachments/a_d0d6bb8824274d745fa6653cb7b552eafa16ac9906ce1f1629333060bf7d3f33/image-20260513-164238.png?cb=d26ec0cd582e2bfb618d452459025cbb) Agent builder in progress To learn more about Agent Builder, please refer to --- language: "en" --- # Agent Configuration Overview The **Agent Command** is the primary command that executes first and serves as a container for all other commands within the agent. It manages crucial aspects such as input parameters, success criteria, proxies and files. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXduawcdJ787Kvh7hBo9jn96Pq6hTVDgJkNofN7BY-IK3cGlX40SaOAq4XWlupD1DBYsl_fVkRP5IBNoMWo0lUdvRf8YCZv8msUj9k5IW4Oqxr04OsvzNlvha22BJQd9TDastsq7iA?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXduawcdJ787Kvh7hBo9jn96Pq6hTVDgJkNofN7BY-IK3cGlX40SaOAq4XWlupD1DBYsl_fVkRP5IBNoMWo0lUdvRf8YCZv8msUj9k5IW4Oqxr04OsvzNlvha22BJQd9TDastsq7iA?key=jOQaYoaNITRy4hsSofPW4Q) ## **Agent Configuration** The configuration screen for the Input Action command has two tabs viz. Options, and Text. Use the 'Options' tab to set the configuration for the agent. Use the **Text** tab to navigate to the text of the agent where the agent configuration text part is present. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXeglqwYaDacQXNWvJGiTDBbs7l8PZP569fI0hPGi20r6r-MZVxfZevEukODViS46d8W8m_dr-ASNQs-pRvwaSsVHNoXKxHb9t9Ma9WwZd48XSBKiamws483RA_2DVS3pkcuwwoY7g?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeglqwYaDacQXNWvJGiTDBbs7l8PZP569fI0hPGi20r6r-MZVxfZevEukODViS46d8W8m_dr-ASNQs-pRvwaSsVHNoXKxHb9t9Ma9WwZd48XSBKiamws483RA_2DVS3pkcuwwoY7g?key=jOQaYoaNITRy4hsSofPW4Q) ## **Agent Properties** On the **Options** tab of the command, we have ten options: 1. Browser 2. Input Parameters 3. Proxies 4. User-Agents 5. Geolocation 6. Browser Profile 7. Success Criteria 8. Basic Authentication 9. Files 10. Runtime ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXe-vz9LNBoBfGYTXCW5X0NYIjRYQs26JuivEe1tVQlElc2xH2VcHUYLSE6He0r2mTcpeduoOUlHJex_ikKoVU_6RgYPY8r7HAioWc_iNcTFuf3RsbdIeidV5Agx5MvpGXSFF9gjXQ?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXe-vz9LNBoBfGYTXCW5X0NYIjRYQs26JuivEe1tVQlElc2xH2VcHUYLSE6He0r2mTcpeduoOUlHJex_ikKoVU_6RgYPY8r7HAioWc_iNcTFuf3RsbdIeidV5Agx5MvpGXSFF9gjXQ?key=jOQaYoaNITRy4hsSofPW4Q) ### **Browser → General browser settings** ![image-20241022-105058.png](https://cloudsupport.sequentum.com/__attachments/a_f81db3342dcb180cc2fe47601c1cb917e262c713472df0814eaad60c4d1cc567/image-20241022-105058.png?cb=6e5a7844f96f9c05fe02f156af308955) General Browser Settings * **Default browser type:**Specifies the type of a new web browser. * **Dynamic:** A fully interactive browser that seamlessly executes scripts and renders styles, providing the complete functionality you'd experience during regular web browsing. It first loads the web page into a browser, where the page is parsed, rendered, and any JavaScript is executed. This makes the execution time of agents slow in Dynamic as compared to Static. By default, this property is set to Dynamic. * **Static:**A lightweight browser that loads only specified file types, such as HTML or JSON, without executing JavaScript, resulting in faster performance. The HTML parser processes web pages without a web browser, completely ignoring JavaScript, which allows for much quicker execution than a standard browser. Similarly, the JSON parser efficiently handles only text-based content, making it ideal for retrieving data through HTTP APIs in JSON format. However, this approach may not function properly on websites reliant on JavaScript. In Sequentum Cloud Static mode, the system automatically selects the most appropriate browser for your agent to optimize performance. * **Max. dynamic browsers:** This property specifies the maximum number of active dynamic web browsers this agent uses to retrieve data when the property "Default browser type" is set to Dynamic. An active web browser refers to one that is currently loading a web page. The default value is set to 1. **Note:** The best number for Max dynamic browsers depends on how hard you can hit the target website without making the website unstable and without getting blocked by the website. The number also depends on how much memory and how many CPU cores are available on the computer running the Sequentum Cloud. A dynamic web browser uses a significant amount of memory and CPU and often uses many concurrent web connections to download content from a website, so the Max. dynamic browsers options should not be set too high. An HTML or JSON parser uses little memory and CPU, and only a single web connection, so the Max. static browsers option can often be set much higher. * **Max. static browsers:** This property defines the maximum number of concurrently active HTML or JSON parsers. An active parser refers to one currently in the process of loading a web page. By default, this value is set to 10. * **Dynamic browser width:**This property sets the width of all web browsers at runtime when using the Dynamic browser type. By default, the width is set to 800, but it can be adjusted as needed. This feature is only relevant when the Default browser type is set to Dynamic. * **Dynamic browser height:** This property sets the height of all web browsers at runtime when using the Dynamic browser type. By default, the height is set to 1200, but it can be adjusted as needed. This feature is only relevant when the Default browser type is set to Dynamic. ### **Browser → Block browser content** ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfK7lIJK7UxP0NFoMNxrczx2hAXp7U1kc5dQfSPfqOH0aFsFQKWpbanKT6klwR9H5QdxlRXsSjiEyu3xGmD-KjZ0fvcEuBP_bJ1mkYbteFBooWw5YrXMVhpPeo4gvwEC7_3tfh9?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfK7lIJK7UxP0NFoMNxrczx2hAXp7U1kc5dQfSPfqOH0aFsFQKWpbanKT6klwR9H5QdxlRXsSjiEyu3xGmD-KjZ0fvcEuBP_bJ1mkYbteFBooWw5YrXMVhpPeo4gvwEC7_3tfh9?key=jOQaYoaNITRy4hsSofPW4Q) * **Load images by default:**This property determines when images should be downloaded and displayed in the web browser. While an agent can still capture images without displaying them in the browser, proper screenshots require the images to be visible. Disabling image downloads improves the agent's performance. This option is applicable only when using the Default browser type as Dynamic. By default, this property is set to True/Checked. * **Load styles by default:**This property defines when style sheets are downloaded by the web browser. It also applies to the HTML static parser in design mode, allowing for precise control over when styles are loaded. This feature is particularly useful in dynamic browsing environments, optimizing content loading and performance. By default, this property is set to True/Checked. * **Block known ad servers by default:** This property prevents the web page from loading content from known ad servers( such as '[http://ad.doubleclick.net](http://ad.doubleclick.net/) '), trackers, and social media widgets to improve speed, reduce noise, and avoid unnecessary data collection, which can slightly improve the page loading speed or speed up the Processing. By default, this property is set to True/Checked. * **Block requests between actions by default:** Prevents background network requests that aren't triggered by user actions, ensuring cleaner, more accurate scraping and reducing unwanted traffic. By default it is Unchecked. ### **Custom Javascript** ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXeYFB2xflXkckRIkrJ-ezhRTsUm7nhuAB8QZwqdhwK5n4ijlN4cSeJWzILw6KwpNBI_fXrk9kSDqkkGCSzVlSyOd-ThHLf4My4A0MZM_zQ-PI6fp_vb6MeSwK-FlByR_yGauLVoTw?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeYFB2xflXkckRIkrJ-ezhRTsUm7nhuAB8QZwqdhwK5n4ijlN4cSeJWzILw6KwpNBI_fXrk9kSDqkkGCSzVlSyOd-ThHLf4My4A0MZM_zQ-PI6fp_vb6MeSwK-FlByR_yGauLVoTw?key=jOQaYoaNITRy4hsSofPW4Q) **Inject Custom Javascript:**The Custom JavaScript will be injected into all pages loaded by a Dynamic Browser. By default it is Unchecked. ### **Browser → Advanced Browser Settings** ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdMq5fgX6lofrLbWOXzvWA2gYr3vbuqubSPR4drXf8n6tSPNnbcQ258UAdlWetLfd7OD4JWn1jVcaVKD4xiqA8dxyqoVYcuZrY8ikKvvAJrGxdjN4uoOu9zd8EnWi7duhaDZCf7?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdMq5fgX6lofrLbWOXzvWA2gYr3vbuqubSPR4drXf8n6tSPNnbcQ258UAdlWetLfd7OD4JWn1jVcaVKD4xiqA8dxyqoVYcuZrY8ikKvvAJrGxdjN4uoOu9zd8EnWi7duhaDZCf7?key=jOQaYoaNITRy4hsSofPW4Q) * **Allow Canvas reading:**The default setting is False/Unchecked, which prevents canvas reading at runtime. Setting this property to True enables canvas reading during runtime, helping to combat browser fingerprinting and prevent blocking. This feature is only applicable when using the Default browser type as Dynamic. * **Load insecure content:**The default value is False/Unchecked, which prevents loading or running insecure content at runtime. When set to True/Checked, it allows the loading and execution of insecure content during runtime. By default, an HTTPS page cannot run JavaScript, CSS, or plugins from HTTP URLs, but enabling this option overrides that restriction. * **Load PDF documents:**This property controls the loading of PDF URLs and the downloading of PDF documents in Sequentum Cloud. It also helps prevent blocking on certain websites. When set to True/Checked, it enables the PDF extension in the dynamic browser at runtime. By default, the property is set to False/Unchecked, meaning PDFs will not be loaded or downloaded unless explicitly enabled. By default, the property is set to False/Unchecked. * **Load WebGL:**When set to True/Checked, this property enables the loading of WebGL in dynamic web browsers at runtime. This feature is only applicable when using the Default browser type as Dynamic. By default, the property is set to False/Unchecked. * **Load Flash:**When set to True/Checked, this property allows Flash to load in dynamic web browsers at runtime. This feature is only applicable when using the Default browser type as Dynamic. By default, the property is set to False/Unchecked. * **Load Gpu:**Enables hardware acceleration by loading the system's GPU during scraping. Useful for rendering complex or animated web pages that require graphical processing. By default it is Checked. * **Load WebGpu:**Activates support for WebGPU, a modern web graphics API, allowing pages that rely on it (e.g., for 3D rendering or advanced visual effects) to render correctly during scraping. By default it is Checked. ### Input Parameters → Agent input parameters Input parameters are named values that are assigned when an agent starts. Any data-consuming command within the agent can access and use these parameters. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdxtNn1wI0APDfbv18EXEMjP4QdbEkb5VaYv_LIZNYTYeZy3_BX8sPd8KvBFrRBEczOGpin_DrE7D6HQAw5ot0n4cYZshNj-ft7655uSZlJvb5PGW4r6G6-fyHKeP-Fu7kt55lxNg?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdxtNn1wI0APDfbv18EXEMjP4QdbEkb5VaYv_LIZNYTYeZy3_BX8sPd8KvBFrRBEczOGpin_DrE7D6HQAw5ot0n4cYZshNj-ft7655uSZlJvb5PGW4r6G6-fyHKeP-Fu7kt55lxNg?key=jOQaYoaNITRy4hsSofPW4Q) **Agent input parameters** ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcpx-Txf41j-wuZvi9N69rlsyf3i6PiDpJzJ87cLaAZ3hUMME3RkJM15obwZroMQ2MkRZPxBBj1HXfDWaRu9T7FxTMrtbwms5ZLfIBClUWYX12FvkzKHwok2nji0fJZTWe9nlKF?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcpx-Txf41j-wuZvi9N69rlsyf3i6PiDpJzJ87cLaAZ3hUMME3RkJM15obwZroMQ2MkRZPxBBj1HXfDWaRu9T7FxTMrtbwms5ZLfIBClUWYX12FvkzKHwok2nji0fJZTWe9nlKF?key=jOQaYoaNITRy4hsSofPW4Q) * **New:** Adds an input parameter which thereby becomes visible on the UI and whenever the user clicks on the New button, a new Input parameter is added. A user can add as many input parameters as they want. * **Name:** Define the name of the parameter, which is used to reference it within the agent. The user must input the parameter name in this field, and it will be reflected in any data-consuming commands within the agent. * **Value:**Assign the value for the parameter. This value can be adjusted externally during runtime configuration. The user is required to input the parameter value in this field, which the agent will use during execution. * **Encrypt:** Secures the parameter by encrypting the text entered in the Value box. Once encrypted, the content inside the Value box will be displayed in its encrypted form. * **Delete:** A delete icon is displayed in front of each input parameter added by the user, allowing the user to remove the parameter if it is no longer needed. **Adding Multiple Input Parameters :** A user can add multiple input parameters based on the agent's requirements, and these parameters can be used in any data-consuming command within the agent. The text entered in each Name textbox will be visible and accessible to every data-consuming command. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcQno11q7lz57G6oOlxCkCaskfvFHYYbFIJzCqD4wP465pxcbUCO6ODjQGefMDpdceU6d4kaSJln1Ew-gEJjhnsHGC_V9mraovGiuqUMRHbKT6VXpujIDVYVkDp-fu4Skvi7pkh1g?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcQno11q7lz57G6oOlxCkCaskfvFHYYbFIJzCqD4wP465pxcbUCO6ODjQGefMDpdceU6d4kaSJln1Ew-gEJjhnsHGC_V9mraovGiuqUMRHbKT6VXpujIDVYVkDp-fu4Skvi7pkh1g?key=jOQaYoaNITRy4hsSofPW4Q) ![image-20241022-080305.png](https://cloudsupport.sequentum.com/__attachments/a_6c12c3f005666e4b24be5b18b1518485d749de1e605115d8fc95329a0ddc95b5/image-20241022-080305.png?cb=3f3c23bf44fbb0b49bf437f7834a4865) We can also modify Input Parameter values at runtime. These values can be adjusted or manipulated externally during the runtime configuration, as shown in the above screenshot. ### **Proxies → Proxy settings** A proxy (or proxy server) is an intermediary between a user's device and the internet, acting as a gateway that allows users to access websites or services indirectly by routing their requests through the proxy. The user's actual IP address is replaced by a proxy or a list of proxies, which can be rotated with each page load based on the user's requirements. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfVStjC06jc-6jgCbN7wWl8frvvoTHzy5emgIr0ELZT0WRWQpGpfw5Og6w-AxU2VHT9fplXRwgflTAhDXfknLV_9zNisUTA4q3YYKLsL40lAgwWU5en6uwbEtCkiaehNC2p6oXT?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfVStjC06jc-6jgCbN7wWl8frvvoTHzy5emgIr0ELZT0WRWQpGpfw5Og6w-AxU2VHT9fplXRwgflTAhDXfknLV_9zNisUTA4q3YYKLsL40lAgwWU5en6uwbEtCkiaehNC2p6oXT?key=jOQaYoaNITRy4hsSofPW4Q) **Proxy type** This setting allows you to configure the proxy. The default value is Proxy Pool. * **Proxy pool:** Proxies play a crucial role in web scraping operations to ensure anonymity and avoid website blocking. Sequentum Cloud allows for the configuration of proxy pools, which are collections of proxies purchased or rented from a provider. A proxy pool can combine multiple proxy provider pools into one large pool for efficient management. When this option is selected, two new textboxes - "Proxy Rotation Interval" and "Proxy Pool" - along with a "New Proxy Pool"' button, will appear on the user interface as shown below : ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcHCX4zwTmDz8HArsQOc1xVypVNrusW-TLQzIb2OgOnxasCpv9_w5bNIvEhmDdkssTFmBHQ-e5Xkrd7yiGOXwoBl3zlENwh8jB59-DGqt0vlgxooLM89J2cZxN_3W9DpwzEt_hDUA?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcHCX4zwTmDz8HArsQOc1xVypVNrusW-TLQzIb2OgOnxasCpv9_w5bNIvEhmDdkssTFmBHQ-e5Xkrd7yiGOXwoBl3zlENwh8jB59-DGqt0vlgxooLM89J2cZxN_3W9DpwzEt_hDUA?key=jOQaYoaNITRy4hsSofPW4Q) **Proxy rotation interval:** This property specifies how frequently the proxy pool is rotated based on the number of page loads executed. The proxy will rotate with each new page load according to the count specified by the user, helping to prevent website blocking. The effectiveness of this property may vary depending on the website's performance and how frequently it experiences blocking. By default, the count is set to 0 which means the proxies will not get rotated. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXeJWmvjJxY5WLbGO_QvUB1TK0d5ol6sdoMdTzYmfMpfDlLfLz-7AUypBSf-E51DXyr2MbCjtib5QINNsftEpzZvHJ9GtM8HR0KEVT5FrYCwRT9qAh5SZJDNkC86o2VsGywetlmc?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeJWmvjJxY5WLbGO_QvUB1TK0d5ol6sdoMdTzYmfMpfDlLfLz-7AUypBSf-E51DXyr2MbCjtib5QINNsftEpzZvHJ9GtM8HR0KEVT5FrYCwRT9qAh5SZJDNkC86o2VsGywetlmc?key=jOQaYoaNITRy4hsSofPW4Q) **Proxy pool:** In this textbox, the user can either manually enter the proxy pool name or select a desired proxy pool from the dropdown menu. The available options in the dropdown are those created by the user in the Sequentum Cloud Control Center, accessible via**Organizations \> Proxy Pools**, as shown below ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfkjV10HaGXr6eI5GkjuGlYg_TQRwRm1m1vQ72FLINgkWBi06bPNJ7UCr9-xpnEKkvw4gfRsrYOZIz-IuhnKcSCwzya-RggaOtf8amH4bfk6zQf-qCdGMi4AO6e1OQyguR4X44_?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfkjV10HaGXr6eI5GkjuGlYg_TQRwRm1m1vQ72FLINgkWBi06bPNJ7UCr9-xpnEKkvw4gfRsrYOZIz-IuhnKcSCwzya-RggaOtf8amH4bfk6zQf-qCdGMi4AO6e1OQyguR4X44_?key=jOQaYoaNITRy4hsSofPW4Q) ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdaLJUwahis9SMYcLJW1RXh7mlgPxfT3VZAXLVfUjC7ii58rg02axu0dT8qVb8SCeOyiR6v68u2Yma4eg8xjDILnZsC0QVW3rc46OnTQLuLlZxibK7usLMKelYXzGt5jVmEplQn3A?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdaLJUwahis9SMYcLJW1RXh7mlgPxfT3VZAXLVfUjC7ii58rg02axu0dT8qVb8SCeOyiR6v68u2Yma4eg8xjDILnZsC0QVW3rc46OnTQLuLlZxibK7usLMKelYXzGt5jVmEplQn3A?key=jOQaYoaNITRy4hsSofPW4Q) **New Proxy Pool:**If the user wants to add and create their own Proxy Pool, then this option comes into play. Clicking this option/button generates a new window with various options as listed below: ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcxFGEGNTNDedZWz17UWiWqlY4pFr6c9_33UR-3wGvVFGphOqKb7PBZDl3zqY3E18zfnHiSf5O-HSNBj6DYE165SWw09w5ua6XW-MSJFQBGiaMaifn6XSrHu7IFqRBOogaFeumfaA?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcxFGEGNTNDedZWz17UWiWqlY4pFr6c9_33UR-3wGvVFGphOqKb7PBZDl3zqY3E18zfnHiSf5O-HSNBj6DYE165SWw09w5ua6XW-MSJFQBGiaMaifn6XSrHu7IFqRBOogaFeumfaA?key=jOQaYoaNITRy4hsSofPW4Q) * **Back to proxies:** This option navigates the user back to the previous page, which is the Proxy Settings. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfr_Wi2lnkbVEkIu69fj1uWf2CqKKfcTxyCaPxyuGopUz73gp1w6asVUD3ssrtupwx5cpK1TgsXNmIIqXBnyyr776yeks4yI1jVro8T0GVCBLpXQRefseHEsGFDP_JOJrqB1FEF0Q?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfr_Wi2lnkbVEkIu69fj1uWf2CqKKfcTxyCaPxyuGopUz73gp1w6asVUD3ssrtupwx5cpK1TgsXNmIIqXBnyyr776yeks4yI1jVro8T0GVCBLpXQRefseHEsGFDP_JOJrqB1FEF0Q?key=jOQaYoaNITRy4hsSofPW4Q) ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXc3ng0XwwvRLHA3qNiviSH1ngx0QWkOcoIaWpg0BkfeSkZNJlVy6nibcf9RmgHTEQoucs73L9meYTjcduCy8TJKUPMZaIUIie7m8he80rgEFHzt3lK2Qxjltmytu1IFyjKm_cet?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXc3ng0XwwvRLHA3qNiviSH1ngx0QWkOcoIaWpg0BkfeSkZNJlVy6nibcf9RmgHTEQoucs73L9meYTjcduCy8TJKUPMZaIUIie7m8he80rgEFHzt3lK2Qxjltmytu1IFyjKm_cet?key=jOQaYoaNITRy4hsSofPW4Q) **Proxy pool name:** The user must enter a desired name for the Proxy Pool, which will be displayed in the UI within the Proxy Pool List dropdown menu and will be used by the user at runtime. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcB10YMfXMs2F2OZIm8AHfsGpcMr6KY3Ic4WsDG6_XLICZ-NwfkwhMnz5D9i3FMnjFn1Bs0dFEXr6sCHdS7Yq9S9WhEWpf4dfxdSTPJ2V1uvSGs8W6svnDCTZ2OlKQ1G8O9khFrUA?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcB10YMfXMs2F2OZIm8AHfsGpcMr6KY3Ic4WsDG6_XLICZ-NwfkwhMnz5D9i3FMnjFn1Bs0dFEXr6sCHdS7Yq9S9WhEWpf4dfxdSTPJ2V1uvSGs8W6svnDCTZ2OlKQ1G8O9khFrUA?key=jOQaYoaNITRy4hsSofPW4Q) * **Description:**The user must provide any description, such as the country of the proxy pool being used or details about a specific agent for which the proxy pool is created. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfFG2cwWGAr3ERliOXa93cbMGH6ThSycs4wPxtUrDyqaSvZ4FxtD-D6Czx_TG61tJE4B7XdwHGdmYkI9J6K79qymPpydAhWs32b-9qXNP69WRl4WGHPb9d9t9Xz1t14L2QlxH0W8A?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfFG2cwWGAr3ERliOXa93cbMGH6ThSycs4wPxtUrDyqaSvZ4FxtD-D6Czx_TG61tJE4B7XdwHGdmYkI9J6K79qymPpydAhWs32b-9qXNP69WRl4WGHPb9d9t9Xz1t14L2QlxH0W8A?key=jOQaYoaNITRy4hsSofPW4Q) * **Proxies:** The user must enter a list of valid proxies, including the associated usernames and passwords. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXeWhKQbtXABx8nu-ub57xAKfZX3Qk7WX0p1MAdK9cVRpExWDgIORRdWPlMNpjpdbbIIK3nj9AFL0omMjdNLYA5Lty7DawLBPwXS1U2u_IKNZWJGGGy_VSHFgMgTpaTk6temQs2zCw?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeWhKQbtXABx8nu-ub57xAKfZX3Qk7WX0p1MAdK9cVRpExWDgIORRdWPlMNpjpdbbIIK3nj9AFL0omMjdNLYA5Lty7DawLBPwXS1U2u_IKNZWJGGGy_VSHFgMgTpaTk6temQs2zCw?key=jOQaYoaNITRy4hsSofPW4Q) * **Add Proxy Pool:** This option is used to successfully create the proxy pool and the same will be reflected on the UI under the Proxy Pool List dropdown menu. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfPvX-XzdfYh5kb1dVVUS7Y0ceTUa_JzNTwF6n9amOKwAoWdpJnfWVC8PyjTCjC8LAg9D8nrMqAman9hJKYiO2sEHMnvYRn30_3LqwqaakEqm-7KQuMgmwBi1xZ4Bxg20DUIt80Lw?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfPvX-XzdfYh5kb1dVVUS7Y0ceTUa_JzNTwF6n9amOKwAoWdpJnfWVC8PyjTCjC8LAg9D8nrMqAman9hJKYiO2sEHMnvYRn30_3LqwqaakEqm-7KQuMgmwBi1xZ4Bxg20DUIt80Lw?key=jOQaYoaNITRy4hsSofPW4Q) ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXf-wCtNom9YC1-nmd_eb2pIviOcGMGdZgYGI2j_XyGF0iPKKJS6JUJiLosmO1skdnild8IUrC2J2iTr-YWZB1u7EAKTDipAS4OFNxEyqp6UQmMxp1-GlbyQTcTbDd4fEAxfGsSY4g?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXf-wCtNom9YC1-nmd_eb2pIviOcGMGdZgYGI2j_XyGF0iPKKJS6JUJiLosmO1skdnild8IUrC2J2iTr-YWZB1u7EAKTDipAS4OFNxEyqp6UQmMxp1-GlbyQTcTbDd4fEAxfGsSY4g?key=jOQaYoaNITRy4hsSofPW4Q) **Cancel:** This option cancels the process of creating a new proxy pool and returns the user to the previous page, i.e., Proxy Settings. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcwH02vtO6KRXAYvuBN83utSJhAYLHbIF2yELfyva3lSzuxKKrSWmibfZX_NA82XHhb1pEefTG4CuNZuJaXRSkyvIyfGfA4cioTQ_ml6A7eKROPfFmbUmFQDRqWnNrxckxDV3i8Lg?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcwH02vtO6KRXAYvuBN83utSJhAYLHbIF2yELfyva3lSzuxKKrSWmibfZX_NA82XHhb1pEefTG4CuNZuJaXRSkyvIyfGfA4cioTQ_ml6A7eKROPfFmbUmFQDRqWnNrxckxDV3i8Lg?key=jOQaYoaNITRy4hsSofPW4Q) ### **User-Agents \> User agent pools** This property is used to configure the User Agent pool according to specific requirements. It consolidates all the User Agent-related settings, such as override and rotation configurations into a unified category. This enables end-users to customize and manage User Agents based on browser type and version. User Agent pools provide options like rotating User Agents on each page load, rotating with proxy addresses and shuffling the User Agent list during runtime. The available configuration options include: ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcOEB-D9up90kOrJ9kwW2tD0H6PVCzHJ0rNcH4Y-_TMBmnBVM7PBWLFe2jyc5dBKCKqThTeQ9x6C_Go3KXJ037EyhBdxeSsyDQ8R8hnoj3wOdTIHAMk_FlbBlWHfRz0x1J5RHb6?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcOEB-D9up90kOrJ9kwW2tD0H6PVCzHJ0rNcH4Y-_TMBmnBVM7PBWLFe2jyc5dBKCKqThTeQ9x6C_Go3KXJ037EyhBdxeSsyDQ8R8hnoj3wOdTIHAMk_FlbBlWHfRz0x1J5RHb6?key=jOQaYoaNITRy4hsSofPW4Q) **User-Agent** This setting allows you to configure the User Agent as either "No Override" or "Chrome" or "Override with Pools". By default, the option is set to **"No Override".** * **Override With Pools:** A collection of user-agent pools. Each pool contains a list of user-agents. All **enabled** pools are combined and shuffled (if shuffle is enabled) at runtime *(applicable only when overriding with pools)*. This option allows the agent to override the default User Agent with custom defined configurations, enabling it to mimic different browser environments. This feature is crucial in web scraping for avoiding detection and bypassing anti scraping mechanisms that track User Agent consistency. When you choose **"Override With Pools"**, you unlock customized User Agent settings for your agent. This lets you override the default User Agent and explore new options as described below: * **Rotate User-Agent:** Randomizes the User Agent with each request, reducing the risk of being blocked by websites that monitor repeated requests from the same User Agent. By default, this option is set to "**No Rotation**". * **No Rotation:**Maintains a consistent User Agent throughout the session minimizing variation but also increasing the detection risk. * **On Every Page Load:** Changes the User Agent with every page load to introduce variability which helps avoid blocking by mimicking real users. * **Associate With Proxy Address:**Synchronizes User Agent rotation with proxy changes, ensuring anonymity by rotating both elements, a critical strategy to avoid IP-based blocking. * **New On Proxy Rotation:**The user agent rotates specifically with proxy rotation. Ensures both the User Agent as well as the proxy change simultaneously, further obscuring scraping patterns and minimizing detection. These options provide fine control over User Agent behaviour enhancing the ability to scrape without triggering server-side blocking mechanisms. * **User-Agent Pools(Type)**: This option allows you to select specific browser types (e.g., Chrome, Firefox) or device types (e.g., mobile, desktop) for the User Agent pool, enabling more targeted scraping that mimics real user environments. * **Shuffle User-Agents** : Randomizes the order of User Agents within the combined pool *(applicable only when overriding with pools)* . to reduce detection risk. This feature adds an additional layer of variability by selecting User Agents randomly during runtime, helping to avoid server-side detection mechanisms that look for patterns in web scraping. By default, this option is enabled (**Checked**). * **New User-Agent Pool**: Build a unique pool of User Agents for your tasks. With the help of this option, we can create a new User Agent pool either by manually providing the values or by using the option "**Import from Csv**". By selecting this option, it will give rise to further multiple options which will help us in creating a new User Agent pool or list of pools. All the options with their descriptions are described below : ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdGVmbMz-j6_mF3Aq8S41p_RizhJm3UI0gM72jXkZ8rHot93a1jM8LCuXW0LkbUPULoUW5h2Mrb8RtIgI0O_uW7ZLZrtlEljrcN7B3DAnALwwhGb4Czfoz8HpdBBD1c8sTKG-PaTQ?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdGVmbMz-j6_mF3Aq8S41p_RizhJm3UI0gM72jXkZ8rHot93a1jM8LCuXW0LkbUPULoUW5h2Mrb8RtIgI0O_uW7ZLZrtlEljrcN7B3DAnALwwhGb4Czfoz8HpdBBD1c8sTKG-PaTQ?key=jOQaYoaNITRy4hsSofPW4Q) * **Add user agents:** Users can create and add as many user agents as needed and also have the option to import a CSV file containing a list of User Agents. This flexibility allows for easy management and bulk additions of user agents, improving efficiency. **Example User Agent String:**Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/119.0.6045.159 Safari/537.36 * **Pool Type:** This option is enabled by default and will create user agents as lists. * **Description:** Users can provide a description in this text box based on their needs. However, it is not a mandatory field and can be left blank, as it is optional. By default, the text box is empty, displaying "**(Optional)**" as a placeholder. * **Import from Csv:** This option allows users to import a CSV file containing multiple User Agent Strings, which will be added directly. Ensure that the column names are correctly formatted and the CSV file is properly structured for a smooth import process. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcLDr2v1Fvpc-VoLq2KZ4-F6dr5OxKs-XPu5QA3bGzVIgeHHZ9sC_uE-bEwVgf2pC63zbXHyJJsGUOhKUszwOGRQeTg0FjJjffEbkxDiGLC7kk2Enc6vB1m1ZjY6TscC0XPzf-g?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcLDr2v1Fvpc-VoLq2KZ4-F6dr5OxKs-XPu5QA3bGzVIgeHHZ9sC_uE-bEwVgf2pC63zbXHyJJsGUOhKUszwOGRQeTg0FjJjffEbkxDiGLC7kk2Enc6vB1m1ZjY6TscC0XPzf-g?key=jOQaYoaNITRy4hsSofPW4Q) ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXec-ni1h1tSrILV7AzOPmKTwqF_Jpc8pmZ8AGNtov-XzebS0CodaK0lmwz4mm5-od0C7jNkQDD3T9oOd1uZpDJaaakqsE4iRuRF84bbqsdZMucIAI7a7jILU34Ss0_9bu0qpG-K?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXec-ni1h1tSrILV7AzOPmKTwqF_Jpc8pmZ8AGNtov-XzebS0CodaK0lmwz4mm5-od0C7jNkQDD3T9oOd1uZpDJaaakqsE4iRuRF84bbqsdZMucIAI7a7jILU34Ss0_9bu0qpG-K?key=jOQaYoaNITRy4hsSofPW4Q) * **Save Pool:** This option is used to create a pool once all fields are set by the user. After clicking "**Save** ", the user will be redirected to the previous page i.e. "**User Agent Pools**" where the newly created pool will be visible in the UI. * **Cancel:** This option cancels the creation of a new user agent pool and redirects the user back to the "**User Agent Pools**" page. * **New** : This option allows users to manually add a row where they can enter a user agent string along with the associated values. Users can click the "**New**" button to add multiple rows, providing as many user agent strings as needed. By default, none of the rows are added to the UI. * **Delete:** This option allows users to remove a row containing a user agent string or a blank row that is no longer needed. * **Back to User-Agent Pools:** This option navigates the user back to the previous page, which is "**User Agent Pools**". * **Enabled:** This option allows the user to enable or disable the user agent pool based on their requirements. * **Edit Pool:** This option enables users to modify an existing User Agent Pool that was previously created. By clicking on this option, users will be redirected to the "Add User Agents" page, where the previously created pool will be displayed in the UI for editing. * **Delete:** This option allows users to remove a User Agent Pool that was previously created and is no longer needed. **No Override:** Selecting this option will use the default chromium browser's User Agent throughout the entire session. **Chrome:** ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcu7xE23OqZi9H4WiYzU6ZPIGx_9A5CEmNK-InsF1WFkv-AmhhLegi-_oKte2IyYVWn5uo6hxDcxohbLiblACXtPJ-zpSGw3zHdIIihgnOS9DRT8BbWQPjusEhLiXmvbaQkiAdN-w?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcu7xE23OqZi9H4WiYzU6ZPIGx_9A5CEmNK-InsF1WFkv-AmhhLegi-_oKte2IyYVWn5uo6hxDcxohbLiblACXtPJ-zpSGw3zHdIIihgnOS9DRT8BbWQPjusEhLiXmvbaQkiAdN-w?key=jOQaYoaNITRy4hsSofPW4Q) ### **Geolocation → Geolocation pool** This property allows users to configure the Time Zone pool based on their specific requirements of the user. By default, the value is set to "**No Override**". **Geolocation / Timezone** The **Time Zone** feature enables users to configure a different time zone other than the one set on their machine. Users can input a Timezone ID in the IANA format \[e.g. '**America/Los_Angeles** '\]. This feature offers two options: **No Override** and **Override With Pool** . Choosing **Override With Pool** grants agents access to predefined pools for setting time zone overrides based on user preferences. Opting for **No Override** retains the default system time zone. By default, the value is set to **No Override**. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXe-mvv956zM56bZRy0T3532m49xbycFHtCxcRprr85JZ2xvlYxPhQMQ0VqIbkWblHkyRBZVfM2ye0SR4Kr5DvKNLvksQo9WPjXe_zcBKsHveKTIsf-hYOahpA21sgUTiNeTq8fkiw?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXe-mvv956zM56bZRy0T3532m49xbycFHtCxcRprr85JZ2xvlYxPhQMQ0VqIbkWblHkyRBZVfM2ye0SR4Kr5DvKNLvksQo9WPjXe_zcBKsHveKTIsf-hYOahpA21sgUTiNeTq8fkiw?key=jOQaYoaNITRy4hsSofPW4Q) * **No Override:**Selecting this option will use the default system time zone. * **Override With Pool:** This option allows the agent to bypass default system Timezone settings by customizing pool configurations, which can help mitigate detection and blocking during web scraping. It unlocks advanced features like Rotate Geolocation, Shuffle Geolocation, and New Timezone ID enabling the agent to dynamically adjust its geolocation and Timezone, reducing the chances of being blocked by anti-scraping mechanisms that rely on identifying static user data. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdpqQZ_Tdviz7CPM51SRH3L9K0-IzOK4CZuZw09e1QPkvZA-B322sacJmgVcItZGTwnvdEpmNEh4wZZVOIUmZGPtN8vIAM7ZLFLAsIf3UlTYG7sN6Evvl5iyIcNFvK2lS5daRdpew?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdpqQZ_Tdviz7CPM51SRH3L9K0-IzOK4CZuZw09e1QPkvZA-B322sacJmgVcItZGTwnvdEpmNEh4wZZVOIUmZGPtN8vIAM7ZLFLAsIf3UlTYG7sN6Evvl5iyIcNFvK2lS5daRdpew?key=jOQaYoaNITRy4hsSofPW4Q) * **Rotate Geolocation:** Emulates different Timezone IDs. This setting can cause some websites to work incorrectly. The default value is set to "**No Rotation**". * **No Rotation:** Indicates that the Timezone will not change. * **On Every Page Load:** Indicates that the Timezone will Rotate on every page load. * **New On Proxy Rotation:** Indicates that the Timezone will rotate with proxy rotation. * **Shuffle Geolocations:**This option shuffles the individual Timezone IDs and and will provide shuffled Timezone IDs to the agent at runtime instead of following a sequential order. By default, this option is Enabled. * **Timezone Id:** The Time Zone feature allows users to configure a time zone different from the one set on their machine. It accepts time zone IDs in the IANA format \[e.g. '**America/Los_Angeles** '\]. Two options are available under Timezone ID: **New** to add additional time zone input fields and **Delete** to remove them. * **New:** Adds a Timezone ID input field to the UI. Each time the user clicks the 'New' button, an additional Timezone ID input field appears. Users can enter valid Timezone IDs in IANA format and can add as many IDs as needed. * **Delete:** A delete icon is displayed in front of each Timezone Id added by the user, allowing the user to remove the Timezone Id if it is no longer needed. ### **Browser Profile → Browser profile settings** Browser profile settingsrefer to the configurable options that allow users to customize and manage their browsing experience within a web browser. These settings can include various parameters that affect how the browser functions, how it interacts with the websites and how it manages user data. **Rotate Browser Profile** An agent can be set up to randomly switch between different web browser profiles during data extraction. By default, the "Rotate Browser Profile" option is set to "No Rotation." There are four available options in the dropdown menu that users can choose from, each controlling how the agent handles browser profiles. If the user selects "No Fake Profile," all associated checkbox options will be disabled and ignored. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfHzsZj-y3gtoKXvA47y-Y9CpOgLRVWvRQmOKdv5THLsqV0QU-vCHBr9IEw4Eqa8iaw_9TeO73LyohRjaV-i3gzDGg4Q9lVmQUBeybkDIrlmkWdLy5jzxohg1tWyjx-ydpOK8OXNA?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfHzsZj-y3gtoKXvA47y-Y9CpOgLRVWvRQmOKdv5THLsqV0QU-vCHBr9IEw4Eqa8iaw_9TeO73LyohRjaV-i3gzDGg4Q9lVmQUBeybkDIrlmkWdLy5jzxohg1tWyjx-ydpOK8OXNA?key=jOQaYoaNITRy4hsSofPW4Q) * **Generate canvas string :**This property returns fake yet valid canvas strings, even when "Allow Canvas Reading" is disabled. Canvas reading in HTML5 is utilized by certain websites for browser fingerprinting. In Sequentum Cloud, this property consistently generates a valid random (spoofed) canvas string, helping to conceal your fingerprint signature and ensuring uniqueness for your canvas string on target websites. By default, this property is Disabled. * **No Fake Profile:**Choose this option to use the user's real browser profile without any anonymization or masking. When selecting this option from the dropdown, all related checkbox options will be disabled and ignored. * **No Rotation:**Indicates that the Web browser profile will not change. * **On Every Page Load:**Indicates that Web browser profile will Rotate on every page load. * **New On Proxy Rotation:**Indicates that Web browser profile will rotate only when the proxy gets rotated. **Webdriver:**This setting defines the value of the browser's navigator.webdriver property, which indicates whether a web driver is in use or not. By default, the property is set to "False." Users can adjust this value by selecting one of three options from the dropdown menu: "True," "False," or "Undefined. * **Undefined:** Selecting "Undefined" deletes the navigator.webdriver property, making it return as undefined. * **True:** Selecting "True" sets the navigator.webdriver property to return true. * **False:** Selecting "False" sets the navigator.webdriver property to return false. **Generate canvas string :**This property returns fake yet valid canvas strings, even when "Allow Canvas Reading" is disabled. Canvas reading in HTML5 is utilized by certain websites for browser fingerprinting. In Sequentum Cloud, this property consistently generates a valid random (spoofed) canvas string, helping to conceal your fingerprint signature and ensuring uniqueness for your canvas string on target websites. By default, this property is enabled. **Generate audio context** : This property returns a fake audio fingerprint context filled with random noise. By default, this property is disabled. **Generate connection info** : This property returns false information regarding the internet connection. By default, this property is disabled. **Generate cpu info** : This property returns false information about the CPU and memory. By default, this property is disabled. **Generate fonts:**This property returns false information about the installed fonts. By default, this property is disabled. **Generate language** : This property returns false information regarding the language. By default, this property is disabled. **Generate media devices** : This property returns false information about media devices. By default, this property is disabled. **Generate performance timers :**This property returns false timings from performance timers. By default, this property is disabled. **Generate plugins :**This property returns false information about installed plugins. By default, this property is disabled. **Generate browsing history :**This property returns a random browser history length and overrides the actual browser history length. By default, this property is Disabled. **Generate media codecs support :**This setting enables the browser to simulate support for certain media codecs, allowing it to bypass checks from websites that require specific audio or video formats. It helps avoid blocking during testing or automation. By default, this setting is Disabled. **Generate webshare api:**This property mocks Chrome's Web Share API, allowing Sequentum Cloud to imitate the functionalities it provides. Specifically, it can mock two main functions: * **navigator.share**: This method allows web pages to trigger the native sharing capabilities of the user's device. * **navigator.canShare**: This method checks if data can be shared using the Web Share API. By default, this property is Disabled. **Generate chrome.app api :**This property mocks the Chrome App API, allowing Sequentum Cloud to replicate the functions and responses of the Chrome App API. This API is typically utilized in Chrome extensions and apps to interact with browser-level functionalities and settings. By default, this property is disabled. **Generate chrome.runtime api :**This property mocks the Chrome Runtime API, allowing Sequentum Cloud to mimic the functions and responses of the chrome.runtime API. This API is typically used in Chrome extensions and apps to interact with the Chrome browser environment, manage the extension lifecycle, and facilitate communication between components. By default, this property is disabled. **Mask tostring prototype:** Some bot-detection scripts verify browser APIs by inspecting overridden functions/properties using the `toString()` method. Enabling this option masks the overrides and returns the expected native `toString()` output, helping prevent detection. By default, this property is enabled. **Generate User Agent Data:** When disabled, specific fields may remain empty. When enabled, these fields are populated with user-agent metadata. This setting controls whether browser user-agent parameters are transmitted to the target site. Useful for managing client-hint exposure. ### **Success Criteria \> Success criteria** Allows users to define the conditions under which an agent run is considered successful. This includes setting specific values for minimum page loads, data count, export count, and maximum errors. These conditions help ensure that the agent performs as expected. Each option can be configured in provided text boxes, which are by default as empty with **No Check** written as a placeholder in each one. To access the Success Criteria window, navigate to the Agent command and select Success Criteria in the Sequentum Cloud Editor. ![image-20250603-122711.png](https://cloudsupport.sequentum.com/__attachments/a_abe93934220d190b3b302c6042adb56d76e748d663a2c9552c03d3687e67dd9e/image-20250603-122711.png?cb=28a823f68cc03183be887eaef6a903ab) The following four success criteria can be defined: * **Min. page loads:** The minimum number of pages the agent must load. * **Min. data count**: The minimum number of data entries the agent must extract. Data entry is defined by setting the option to Increase data count on any command. The data count is increased every time a command with Increase data count is executed. * **Min. export count:**It defines the minimum number of rows exported to a file. A minimum number should be specified here so that it can prevent exporting blank files. * **Max. errors:**The maximum number of page errors allowed. **Success criteria** can be specified as absolute numbers or as a percentage of the value from the last successful agent run. For example, if **Min. data count** is set to 80% it means the agent must extract a minimum 80% of the data count from the last successful run. A Percentage criteria always succeeds if the agent has not been successfully run before. **Allowed variation** Use these fields to define the minimum and maximum allowed variation as a percentage of the previous run's values. * **Allowed page load variation (percentage):** If you set the **Allowed Page Load Variation** to 90%, the agent run will be considered successful if it loads at least 90% as many pages as the previous successful run. * **Allowed data variation (percentage):**If you set the Data Variation to 90%, the agent run will be considered successful if it extracts at least 90% as much data as the previous successful run. * **Allowed export variation (percentage):**If you set the Export Variation to 90%, the agent run will be considered successful if it exports at least 90% as many items as the previous successful run. * **Allowed error variation (percentage):**If you set the Error Variation to 10%, the agent run will be considered successful if the error count is less than 10% of the errors encountered in the previous successful run. ### **Basic Authentication \> Basic website authentication** Some websites use Basic Authentication, which prompts a login box for the user. Sequentum Cloud allows you to set the Username and Password for Basic Authentication. However, please note that this feature is only supported when the agent is configured to use the Dynamic Browser. This feature does not work in Static Browser mode. ![image-20250603-122808.png](https://cloudsupport.sequentum.com/__attachments/a_e2a067248bd212551db8abeaaa80b7a394369206e6f335d5ae2540e16a9d3377/image-20250603-122808.png?cb=ade91a870001664a61372be872004c2d) * **Username:** In this text box, users can enter the desired username if the website requires login credentials for authentication. * **Password:** In this text box, users can enter the corresponding password if the website requires login credentials for authentication. ### **Files \> Upload files** This feature allows users to upload files, making them accessible across all commands and scripts within the agent. Users can add multiple files simultaneously by either dragging and dropping them into the designated area labelled 'Drag files here...' or by selecting the Upload File option. ![image-20250603-122938.png](https://cloudsupport.sequentum.com/__attachments/a_1b63d28c015749cde48593dd0f9a3f8b863d603deedeff1d8073cc6d8114383e/image-20250603-122938.png?cb=871bd1c418b6d95e6ddb3b297ea7f24d) * **Drag and Drop Files:** Users can add multiple files simultaneously by dragging and dropping them, ensuring they are successfully uploaded, accessible and visible in the user interface. * **Upload File:** Users can add multiple files simultaneously by clicking the Upload File option, ensuring they are successfully uploaded, accessible and visible in the user interface. * **Name:** Clicking on the file name link navigates to a detailed view displaying the File Size, Last Modified date, and an Edit option. From this screen, users can also edit the file directly. * **Back to Files:** This option navigates the user back to the previous page which is "Upload files". * **Edit:** This option allows the user to modify/edit the uploaded file by clicking on it. * **Save button:** This option saves the updated file after the user has made changes. * **Cancel:** This option discards the changes made by the user, keeping the file in its original state without any modifications. * **File Size:** This column displays the actual size of the file uploaded by the user. * **Added:** This column shows the date and time when the file was uploaded by the user. * **Delete:** This option allows the user to remove the uploaded file. * **Edit:** This option enables the user to modify the uploaded file by clicking on it. Selecting the Edit option will navigate the user to a detailed view that displays the File Size, Last Modified date, and an additional Edit option. From this screen, users can directly edit the file. * **Back to Files:** This option navigates the user back to the previous page which is "Upload files". * **Edit:** This option allows the user to modify/edit the uploaded file by clicking on it. * **Save button:** This option saves the updated file after the user has made changes. * **Cancel:** This option discards the changes made by the user, keeping the file in its original state without any modifications. * **Download:** This option allows the user to download the uploaded file. ### **Runtime Data \> Runtime data retention** This feature allows runtime data to be retained, ensuring that it remains available when stopping an agent, enabling the run to be continued later. If this option is set to "Never," the user will not be able to retry the agent since no runtime data will be available. By default, this option is set to "When Errors Exist". ![image-20250603-123104.png](https://cloudsupport.sequentum.com/__attachments/a_336441c25388a4877e4d75d1fe80dbcba0a12977200b732fc6bb2a6bbfcb3d4c/image-20250603-123104.png?cb=311ce02821b25137e98cc317c5c93056) * **Always:** Selecting this option ensures that the runtime data will be retained always, regardless of whether the agent succeeds or fails. This means the data will always be available for the user if they wish to utilize the retry functionality in the agent. * **Never:** Selecting this option ensures that runtime data will never be retained and will not be available for the user during retries or any other operations. As a result, the user will not be able to utilize the retry functionality when this option is set in the Runtime Data Retention. **When Errors Exist:** Selecting this option ensures that runtime data will be retained only if an error occurs in the agent, As a result, the user will be able to utilize the retry functionality when this option is set in the Runtime Data Retention. **Fail Conditions** **Max. run time:**The agent will stop and get Failed if it doesn't get completed before the provided time span. The specified value must be in format HH:mm:ss. The default value is set to 24:00. --- language: "en" --- # AI Magic Wand Feature – Sequentum Cloud ## ++**Overview**++ Sequentum is excited to introduce its **third AI-powered capability** --- the **Magic Wand** --- for the Sequentum Cloud platform. This innovative feature leverages AI to intelligently build scraping agents from scratch. Give it a list or detail page and it will generate the extraction code for the data available **without relying on generic schemas** . Users can now perform **free-flow data extraction** quickly and effortlessly, reducing manual work and improving efficiency. ## ++**Feature Scope**++ The current release of the Magic Wand focuses on: * **Automatic generation of extraction** logic for data from list pages and detail pages. * **Schema-free extraction** eliminates the need for predefined templates. * **Simplified workflow** --- AI handles field detection and command generation automatically. ### **Supported Agent Types** The AI Magic Wand is available for the following agent types: * [++**Dynamic Agent**++](https://cloudsupport.sequentum.com/scm/ai-magic-wand-feature-sequentum-cloud.md#Dynamic-Agent) * [++**JSON Agent**++](https://cloudsupport.sequentum.com/scm/ai-magic-wand-feature-sequentum-cloud.md#JSON-Agent) * [++**XML Agent**++](https://cloudsupport.sequentum.com/scm/ai-magic-wand-feature-sequentum-cloud.md#XML-Agent) * [++**HTML Agent**++](https://cloudsupport.sequentum.com/scm/ai-magic-wand-feature-sequentum-cloud.md#HTML-agent) ## ++**Accessing the AI Magic Wand**++ You can access the AI Magic Wand directly within the Sequentum Cloud platform. ### **Steps:** 1. Log in to[++Sequentum Cloud Dashboard++](https://dashboard.sequentum.com/) using valid credentials. 2. Click **"New Agent"** on the home page or select **"New Agent"** from the top dropdown menu. ![image-20251112-125452.png](https://cloudsupport.sequentum.com/__attachments/a_b739ee0e6b0e7137f39c0a66cedc68d91ea8f2f6273131c88b47c950314633dd/image-20251112-125452.png?cb=d0bd165441be1c34c9d1dd2a196a6449) 3. A new **Agent Editor** window will open. 4. On the **top-right corner** of the editor, next to the navigation buttons, you'll see the **AI Magic Wand** icon. ![image-20251112-125531.png](https://cloudsupport.sequentum.com/__attachments/a_9567be5f73de04947ebb91cc1e7e31d154e6b743e2da25455b2eac333ca21f11/image-20251112-125531.png?cb=cd3fae6123fcde8e62e94bf7ad8c1230) 5. The Magic Wand is available in both **personal** and **shared spaces**, allowing flexibility across projects. ## ++**Using the AI Magic Wand**++ ## ++**Dynamic Agent**++ Once inside the editor: **Load a Website** * Enter the [++target++](http://www.target.com/)website's URL in the editor's built-in browser and wait for it to load completely. **Activate the Magic Wand** * Click on the **AI Magic Wand** icon once the page has fully loaded. * The AI will begin analyzing the page to detect data fields. **Automatic Extraction** * The wand automatically identifies structured and unstructured data fields on the page. **Loading Indicator** While data is being extracted, a loading icon will be displayed. ![image-20251112-125616.png](https://cloudsupport.sequentum.com/__attachments/a_e362bd74e1da95f5ca7413ca349819f01ea7efcbb5ad1a1f414267531e28dc8e/image-20251112-125616.png?cb=5c34515c393202bb8a8a8bebda472851) Once extraction is complete, the loading indicator disappears, and all extracted fields will be visible in your agent, and user will be prompted to accept or reject the AI extracted content ![image-20251112-125656.png](https://cloudsupport.sequentum.com/__attachments/a_5de0b9c986e08b5207fd3898ab54688a20631359cdf6922e928cac42965578c6/image-20251112-125656.png?cb=662a188fecf177c5cf5e51c4a52ae68f) * Upon acceptance, content extraction commands are **automatically added** to your agent configuration. ![image-20251112-125713.png](https://cloudsupport.sequentum.com/__attachments/a_14e31fe1e080844b5a71fee13379925021d2bb756c8e602c03de857ae19dce3c/image-20251112-125713.png?cb=3de4d196c4997c565a8694be17e8c93e) ## ++**JSON Agent**++ ### **1. Load a Website** * Enter the [++**Bojangles website URL**++](https://www.bojangles.com/api/v1/locations/) in the editor's built-in browser. * Wait for the website to **load completely**. * Since the site type is **HTML** , the system will automatically change the URL value to **Static** after displaying an on-screen message. ![image-20251112-125740.png](https://cloudsupport.sequentum.com/__attachments/a_868ba721effdb2683f00671f2bd20390ecd1a4ffd2055efb152931c6e4c74ab3/image-20251112-125740.png?cb=089d696089b655f9868333ce270ab4bf) #### **2. Activate the Magic Wand** * Once the site has fully loaded, **click the AI Magic Wand icon** in the toolbar. ![image-20251112-125855.png](https://cloudsupport.sequentum.com/__attachments/a_c89ecff4c7d67a37d89bfe622c3047242f18f39ee82d7963cc77983c947c0b65/image-20251112-125855.png?cb=c6399f381d8749855bde378964226f3a) * The AI will start **analyzing the webpage** to detect and identify relevant data fields. #### **3. Automatic Extraction** * The Magic Wand **automatically detects both structured and unstructured data fields** present on the page. * Detected fields are prepared for extraction without the need for manual configuration. #### **4. Loading Indicator** * During extraction, a **message comes on screen** to indicate processing. ![image-20251112-125918.png](https://cloudsupport.sequentum.com/__attachments/a_52c90ff6e1d938fcb8ea6d16ee7a9e8b7f2b261d4180dc970151fc2aaf161d5e/image-20251112-125918.png?cb=daa16af1c9c320d6111f360a0b905963) * Once extraction completes and the data is ready, the loading indicator disappears and success message comes on screen. ![image-20251112-125944.png](https://cloudsupport.sequentum.com/__attachments/a_675b040e703606b12bc0718926647638f003d1bc60608ab99a9b210dc8b2355c/image-20251112-125944.png?cb=aaf992ab4e648abc9761e3848b58ce12) * Upon confirmation, **content extraction commands are automatically added** to your agent configuration. ![image-20251112-130007.png](https://cloudsupport.sequentum.com/__attachments/a_a9ad331d8df2ee83a7cf58008020c014f301198a2b8eb4c334ac9aeee8928815/image-20251112-130007.png?cb=1729f7ebb39212ab870a77dc0c00aef4) ## ++**XML Agent**++ Load the website * Enter the [++**Nike website URL**++](https://www.nike.com/sitemap-locator-index.xml) in the editor's built-in browser. * Wait for the website to **load completely**. ![image-20251112-130041.png](https://cloudsupport.sequentum.com/__attachments/a_9320cbed893e8db876c693e38c2163b4032d8e09debf868b90a894df67777d09/image-20251112-130041.png?cb=18b315bdf9136f81099a07a3eda18541) ### **2. Activate the Magic Wand** * Once the site has fully loaded, **click the AI Magic Wand icon** in the toolbar. * The AI will start **analyzing the webpage** to detect and identify relevant data fields. #### **3. Automatic Extraction** * The Magic Wand **automatically detects both structured and unstructured data fields** present on the page. * Detected fields are prepared for extraction without the need for manual configuration. #### **4. Loading Indicator** * During extraction, a message appears on the screen to indicate processing. ![image-20251112-130108.png](https://cloudsupport.sequentum.com/__attachments/a_2b635c7cbea9c55692bef9dc6f444e5d06f76d0f2c8527ccafa86e31366dc2eb/image-20251112-130108.png?cb=ed3fa1c6a51c85fcac8421126a50ce00) * Once extraction completes and the data is ready, the loading indicator disappears. * Success message is shown on UI ![image-20251112-130125.png](https://cloudsupport.sequentum.com/__attachments/a_7317bdcf7de221672cc866c94a67c121ad0550ad73277feb015e4b18e3a07bb1/image-20251112-130125.png?cb=fa22745c0447188e26a2a24395ace2aa) ## ++**HTML agent**++ Load the website Enter the [++**thelayoff website URL**++](https://www.thelayoff.com/humana) in the editor's built-in browser. * Wait for the website to **load completely**. ![image-20251112-130200.png](https://cloudsupport.sequentum.com/__attachments/a_d11f84412e13efa252e102b567f523012fc80308a6b81fa22199736f21dff3bd/image-20251112-130200.png?cb=d599adbbecc6afff0658d7c0b2cd652f) * Change the site to Static in the browser option ### **2. Activate the Magic Wand** * Once the site has fully loaded, **click the AI Magic Wand icon** in the toolbar. * The AI will start **analyzing the webpage** to detect and identify relevant data fields. #### **3. Automatic Extraction** * The Magic Wand **automatically detects both structured and unstructured data fields** present on the page. * Detected fields are prepared for extraction without the need for manual configuration. #### **4. Loading Indicator** * During extraction, a **loading icon** appears on the screen to indicate processing. ![image-20251112-130224.png](https://cloudsupport.sequentum.com/__attachments/a_4c2a695fdcbe6aa172e43483849968dbaaf4872e66acaf2e94b045ca6c59732c/image-20251112-130224.png?cb=b4fd71e281054d4e6de43d178af7e961) * Once extraction completes and the data is ready, the loading indicator disappears. * Data is extracted in agent ![image-20251112-130244.png](https://cloudsupport.sequentum.com/__attachments/a_e611517bafa2f3fc483681a2254acd59a1b6375e4e08de05de01496a8e8c39ba/image-20251112-130244.png?cb=d96726f6c8160e3eccff2f7cb7389b0e) ## ++**Benefits**++ * **Ai Augmented Agent Creation:**Brings two decades of innovation in how best to design an editor for crafting resilient web scraping agents with generative AI simplicity. * **Multi-Agent Support:** Works seamlessly across Dynamic, HTML, JSON, and XML agents. * **Reduced Manual Effort:** Eliminates the need for manual field mapping or schema creation. * **Rapid Data Extraction:** Extracts data from list and detail pages within seconds. * **User-Friendly Experience:** Simple one-click extraction integrated directly into the Cloud Editor. ## ++**Conclusion**++ The AI Magic Wand brings **intelligence, speed, and simplicity** to Sequentum Cloud's agent creation process. Whether you're handling complex pages or high blocking sites, this feature empowers you to get started within seconds and generate your first scraping agent **--- with just one click.** --- language: "en" --- # Assembly References You can use external assemblies in your scripts by adding assembly references to your agent. Adding Assembly reference to any code is dependent on the language the code is written in. Additionally, the syntax to add any assembly is different for all. **Note:** Regular Expression and Javascript don't have any Assembly Reference. Assembly reference is only supported by C# \& Python programming languages. * **C# :** Adding assembly reference in C# is very easy, just use the below syntax and specify the name of the library you want to add in the assembly reference. Make sure that you add the C# library extension ( .dll ) at the end of the library you are adding in the assembly reference, also each library must be added with the same syntax in the new line. **Use of #r for assembly reference** In C#, the `#r` directive is used in **interactive scripting environments** to reference an external assembly. It tells the script to load a specific DLL or assembly so its classes, methods, and types can be used in the script. #r .dll #r System.IO.dll ## Example: If you want to use a library like **Newtonsoft.Json** in your C# script, you can reference the assembly like this: Here is the sample code from Data Value command. C# #r Newtonsoft.Json.dll using Newtonsoft.Json; public string GetData(RunContext context) { var json_string = JsonConvert.SerializeObject(new { Name = "Alice", Age = 30 }); return json_string; } * **Python :**Adding assembly reference in Python is very easy, just use the below syntax and specify the name of the library as listed below: * geopy * jsonpath_ng * openai * pandas * requests * scikit-learn * spacy * snowflake **Use of #@ for assembly reference** In Python, the #@ directive is used in **interactive scripting environments** to reference an external assembly from the above-provided list. It tells the script to load a specific PY or assembly so its methods, and types can be used in the script. #@ ".py" #@ "Pandas.py" ### Example: If you want to use a library like **jsonpath_ng** in your Python script, you can reference the assembly like this: Python #@ "jsonpath_ng.py" from se_scripting_utils import * import jsonpath_ng def get_data(context: RunContext): data = { "name": "John Doe", "age": 30, "address": { "street": "123 Main St", "city": "Anytown", "state": "CA" } } expression = jsonpath_ng.parse("name") results = expression.find(data) return results[0].value --- language: "en" --- # Auto Scroll Properties The Auto Scroll command allows you to automatically scroll a web page or a specific scrollable element. This is useful for loading dynamically loaded content (infinite scroll, lazy loading) before extracting data. ## Scroll Target * **Scroll Target**: Choose between scrolling the entire page or a specific element. * **Window**: Scrolls the entire browser page. Use this when content loads at the bottom of the page as you scroll down. * **Element**: Scrolls a specific scrollable container element. Use this when a particular section of the page (e.g., a div with overflow) has its own scroll behavior. ## Element Selection *Only visible when Scroll Target is set to "Element".* These settings control how the scroll element is located and what happens when it cannot be found: * **When missing**: Determines the behavior when the selected scroll element is not found on the page. * **Fail**: The command fails and reports an error. * **Warn**: A warning is logged, but the agent continues running. * **Ignore**: The missing element is silently ignored. * **When hidden or disabled**: Determines the behavior when the scroll element exists but is hidden or disabled. * **Select**: The element is selected anyway, even if hidden or disabled. * **Ignore**: The hidden/disabled element is ignored. * **Selected scroll element**: A read-only preview showing the currently selected scroll element from the page. ## Scroll Options * **Max scrolls (0 = unlimited)** : The maximum number of scroll iterations to perform. Set to `0` for unlimited scrolling --- the command will keep scrolling until it reaches the end of the page or element. * **Scroll pixels (0 = full page)** : The number of pixels to scroll per iteration. Set to `0` to scroll the full visible height of the page or element in each iteration. * **Delay between scrolls (ms)** : The number of milliseconds to wait between each scroll iteration. This delay allows time for AJAX/dynamic content to load after each scroll action. A typical value is `100`--`500` ms depending on the website's loading speed. --- language: "en" --- # Azure Storage Command Azure Storage is an available export destination under the Export commands section, allowing seamless data transfer to Azure Storage containers. The **Azure Storage** command is located under the **Export** option in the command palette (refer to the snapshot below). ![AD_4nXfiPExF--PKMw6hlLv6CDTYYQXt2s7VMsULRYAJa5zbCEjXMoJxxKAUgw__Epkp68T2u-i8ZC3GKRaWOvUz3C_xBgv9yVVo5AoTcAVkyvEPnFFMQDJxbbtNMZxfhY-FLx3J36ee?key=nJjcTtHa6VRn4qK_qUzCnw](https://cloudsupport.sequentum.com/__attachments/a_381c80a0464e43404199e3840f1a99fcfc6dd5a405933fba9b636577c22f32b7/AD_4nXfiPExF--PKMw6hlLv6CDTYYQXt2s7VMsULRYAJa5zbCEjXMoJxxKAUgw__Epkp68T2u-i8ZC3GKRaWOvUz3C_xBgv9yVVo5AoTcAVkyvEPnFFMQDJxbbtNMZxfhY-FLx3J36ee%3Fkey=nJjcTtHa6VRn4qK_qUzCnw?cb=af1b179adea6d352e2af2e689ee5d4d7) In order to make the optimum use of the **Azure Storage** command, we can configure the options as shown in the below screenshot, as per the user requirement. ![AD_4nXfOQLyDM4X4dic37DSDZcXrQPfG8_2_WTV6JuaTy635RSdxnjdH1JZTtaayiRaNWgU15xgTqjuyUAJo6XhWqQ9z979VE1KnC290DW9Rdv_19m2iSDLL9YyoGI583tCnaTiCJQ4b?key=nJjcTtHa6VRn4qK_qUzCnw](https://cloudsupport.sequentum.com/__attachments/a_2bc9d9a8202799a934c36d2532d81d555bb1ee4e251d5a7635137c53748659af/AD_4nXfOQLyDM4X4dic37DSDZcXrQPfG8_2_WTV6JuaTy635RSdxnjdH1JZTtaayiRaNWgU15xgTqjuyUAJo6XhWqQ9z979VE1KnC290DW9Rdv_19m2iSDLL9YyoGI583tCnaTiCJQ4b%3Fkey=nJjcTtHa6VRn4qK_qUzCnw?cb=f4f2341c8dfb2e7c10c1b3d430d3bbdd) ## **Command Configuration** The configuration screen for the Google Drive command has two tabs viz. Options and Text. Use the 'Options' tab to set the command name and other command properties. Use the 'Text' tab to navigate to the text of the agent where the command part is present. ![AD_4nXddp8sFva8l0o_X3HHjiLGLALnb0YxBwCpgXvij6ZojLnqK8_aN9-7txeA7dLKqKPD6MCfEchBR1np2rS1UfVF7UonZQAqOBPBQ-PBT4gKSvZJ23TxTD5hARkgBuzgqYpp1kgRRIQ?key=nJjcTtHa6VRn4qK_qUzCnw](https://cloudsupport.sequentum.com/__attachments/a_32b39b4bb1b8c676d25f7ce31e27f61f65716ff55f4ee93ca4bd6bd9971322dd/AD_4nXddp8sFva8l0o_X3HHjiLGLALnb0YxBwCpgXvij6ZojLnqK8_aN9-7txeA7dLKqKPD6MCfEchBR1np2rS1UfVF7UonZQAqOBPBQ-PBT4gKSvZJ23TxTD5hARkgBuzgqYpp1kgRRIQ%3Fkey=nJjcTtHa6VRn4qK_qUzCnw?cb=55fd4203ec75cc5b61af941ba0bbc1b5) ## **Command Properties** On the **Options** tab of the command, we have three options: ![AD_4nXePp9UBPe0mO8kfqQ4ae2QFezD9yyTkn6X2zDDp6myk_5cib9-msxdTARlzPlhWuZmZM8cI4Jn_sf5hKuxQbAgTXlYwZFI4EuxhaP0Z_GV-J0UuqlKFxqif5AeYl6zmMmG_g6PVBw?key=nJjcTtHa6VRn4qK_qUzCnw](https://cloudsupport.sequentum.com/__attachments/a_f57d10b2e300a3dcdf57530265416863fe58b30ee6a31b48d4e4d7d969ad8d97/AD_4nXePp9UBPe0mO8kfqQ4ae2QFezD9yyTkn6X2zDDp6myk_5cib9-msxdTARlzPlhWuZmZM8cI4Jn_sf5hKuxQbAgTXlYwZFI4EuxhaP0Z_GV-J0UuqlKFxqif5AeYl6zmMmG_g6PVBw%3Fkey=nJjcTtHa6VRn4qK_qUzCnw?cb=f01e160e6a2a39f185910b3227ff5123) ### **General Settings → General Command Settings** This section allows users to customize the command with the following properties: ![AD_4nXcODZfykkIXFzVFdXzLD3xXxaXSU7JiMWG0M4JTKL5KpeNpst02gBTcpE2OjMCAw-BR9EnIyYfNrRlE5Dtlxu0DggBQl-9wTrQ_IKeKq-QBiaQ3ss-_IbQ-3nl14iQ0BpCByjFSqQ?key=nJjcTtHa6VRn4qK_qUzCnw](https://cloudsupport.sequentum.com/__attachments/a_4fecf16fadc85647056b9383c42dbfab2f68e30b9bc4bee3d69b13f206429f7b/AD_4nXcODZfykkIXFzVFdXzLD3xXxaXSU7JiMWG0M4JTKL5KpeNpst02gBTcpE2OjMCAw-BR9EnIyYfNrRlE5Dtlxu0DggBQl-9wTrQ_IKeKq-QBiaQ3ss-_IbQ-3nl14iQ0BpCByjFSqQ%3Fkey=nJjcTtHa6VRn4qK_qUzCnw?cb=b5ba3ffc60b5eda31885dfa593ac304a) * **Command name:** This property specifies the name of the command. * **Comments:** Provides a field for entering metadata or a brief description regarding the command. These annotations are used internally to provide context for developers or team members. Comments are not part of the exported data and are only used for documentation purposes within the configuration. * **Disabled:** This checkbox allows the user to disable the command. When checked, the command is ignored during execution. By default, it is unchecked. ### **Azure Storage → Azure Storage Export Settings** ![AD_4nXfrbY0vLREJSh5dYP8YQosFbm2HYxEWd-2-TdkEHQ8OPWp6phAJ_OKBRmDpG8eOcbLdkrpDBCHMrGp0m6wqcmSt-KIsQFqnhqSp7S85r-Wl19eBckUPzJT8vhEz7TOgsOjj8UH5jA?key=nJjcTtHa6VRn4qK_qUzCnw](https://cloudsupport.sequentum.com/__attachments/a_b62ad15eaa6a0df586cf2a55484ffabf5a3844b4ed11e5309e07e0e7961ce49e/AD_4nXfrbY0vLREJSh5dYP8YQosFbm2HYxEWd-2-TdkEHQ8OPWp6phAJ_OKBRmDpG8eOcbLdkrpDBCHMrGp0m6wqcmSt-KIsQFqnhqSp7S85r-Wl19eBckUPzJT8vhEz7TOgsOjj8UH5jA%3Fkey=nJjcTtHa6VRn4qK_qUzCnw?cb=3081d8630c34bf368d372caf0db336e7) * **Destination name:** Specifies the Azure Storage connection, which can be created from the "Destinations" option under the "Organization" tab. Alternatively, users can also create a new connection within the command using the Destination Name set to "Custom" (the default option). ![AD_4nXexy8BjLG-16p13hyrutnB8GVGgiM8Ps5Lu04p8lY1AqXd5CPo1bTWB54-N5mqDUxy2jcmWnZoZRMVFRRjrSnubDlT4sBrt0XRXwVvg7-LQ89K0zmHitf-supb2BV9TJiWvQhLe_g?key=nJjcTtHa6VRn4qK_qUzCnw](https://cloudsupport.sequentum.com/__attachments/a_54fef3e2e7897ec1ff10bcfecf8f9a094a15d795c28bee04c0e4969294689d91/AD_4nXexy8BjLG-16p13hyrutnB8GVGgiM8Ps5Lu04p8lY1AqXd5CPo1bTWB54-N5mqDUxy2jcmWnZoZRMVFRRjrSnubDlT4sBrt0XRXwVvg7-LQ89K0zmHitf-supb2BV9TJiWvQhLe_g%3Fkey=nJjcTtHa6VRn4qK_qUzCnw?cb=8a573c08069e3aa67a37d17551d34491) * **Storage Account Name:** It is the unique identifier for your storage account in Azure. It serves as the primary name for your cloud storage space, and it must be globally unique across the entire Azure platform. This global uniqueness is necessary because the name becomes part of the public DNS hostname used to access your data objects (like blobs, files storage). * **File Share Name (optional):**This field specifies the destination service within your Azure Storage Account. * Leave the ***File Share Name*** field empty to deliver the file to**Azure Blob Storage**. * Enter a name in the **File Share Name** field to deliver the file to **Azure File Share** . The system will use an existing share with this name or create a new one if it does not exist. The name must contain only lowercase letters, numbers, and hyphens. * **Container Name (optional) :**This field specifies the container within Azure Storage where the data will be saved. * If the Container Name is left empty, the file will be delivered to the default container named default. * If you provide a name, the system will use an existing container with that name or create a new one if necessary. The container name must consist of only lowercase letters, numbers, and hyphens. * **Folder (optional) :** This field specifies a sub-directory path where the files will be stored within your chosen destination (either a blob container or a file share). This allows you to organize exports into specific folders. * **Access Key :** An Access Key for an Azure Storage Account is a high-privilege credential that grants access to all data and management operations within that account. It can be considered equivalent to a **root password** for the account. * **Test Connection:** Provide the required details to create the Azure Storage Delivery connection. Once all fields are completed, click the **Test Connection** button to verify whether the connection has been established successfully. * **Deliver Data Files:** The default setting is True, which ensures that data files such as CSV or Parquet are exported to the destination. * **Deliver Extracted Files:** By default, this is set to False. If you want to export downloaded files, such as HTML, images, or PDFs, this setting must be changed to True to deliver these files to the target destination. * **Deliver on Failure:**The default value is True, meaning that the files will be delivered even in the event of a failure, ensuring the export is completed regardless of errors during the process. --- language: "en" --- # Branch Command The Branch command executes a group of commands if a specified condition is met. The 'Branch' command is located under the 'Other' section in the command palette (refer the below snapshot) ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcmV5e00K2HEUNuly6cbmA6fYcRCtQF-VJcKpi4T-M9cOKGLR2N2nKaiD-tkUXtdWgRDJvyRiekQqVAgvzHnOmN66iA1UXlpyXStW_SdQ9KfYEQI8FV2fxTlmAbsUKAejBy5ZN8hA?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcmV5e00K2HEUNuly6cbmA6fYcRCtQF-VJcKpi4T-M9cOKGLR2N2nKaiD-tkUXtdWgRDJvyRiekQqVAgvzHnOmN66iA1UXlpyXStW_SdQ9KfYEQI8FV2fxTlmAbsUKAejBy5ZN8hA?key=jOQaYoaNITRy4hsSofPW4Q) In order to make the optimum use of the 'Branch' command, we can configure this command by applying transformations. Based on the selection of the XPath, the Branch command accepts conditions. ![image-20260405-131209.png](https://cloudsupport.sequentum.com/__attachments/a_0932c36c06250b53aef6f3bf093ad1b41c5bca864ff29f7f30bead2aca18a7bc/image-20260405-131209.png?cb=58f2a5094060eb96acf5cc96a35c37ed) **Example,** If the condition satisfies, we need to enter the name of the branch, else we need to return an empty string. ![image-20260405-131412.png](https://cloudsupport.sequentum.com/__attachments/a_df40c49c715f94714b6e9e48bc737e51f60046f558cdc6964311d7633e743d2e/image-20260405-131412.png?cb=950adbc4a2f6552187deea57a4545b16) Under the 'Branch' command, we can configure the options as shown in the below screenshot, as per user requirement. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfCcifISS-ujUfc5HkfA65FGw-o0bJ59NU0swfjfGQHsFdwMoYhTDV24aTgwesTQr2JMO9EZL2iujVfVBbkegOePNuvhxjdkKuCMWYffYlMMiH1MO14PzVXo8qOhVVDUOTqxdSj7w?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfCcifISS-ujUfc5HkfA65FGw-o0bJ59NU0swfjfGQHsFdwMoYhTDV24aTgwesTQr2JMO9EZL2iujVfVBbkegOePNuvhxjdkKuCMWYffYlMMiH1MO14PzVXo8qOhVVDUOTqxdSj7w?key=jOQaYoaNITRy4hsSofPW4Q) ## **Command Configuration** The configuration screen for the Branch command has three tabs viz. Browser, Options, and Text. Use the 'Browser' tab to select command XPath and apply selection transformations. Use the 'Options' tab to set the command name and other command properties. Use the 'Text' tab to navigate to the text of the agent where the command part is present. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfsykWEwS52qbjBcg17t6YuABgzVA2RF8_QH4qblhmrfGJwh9eaUtjCfkL8U-MQ0t3CYm6zAizsIgj60llfew9P_fm8d1H7yIrviPWRbTlmGpKTP4oI24Bd8lNIHBX1NhgJtkRXIg?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfsykWEwS52qbjBcg17t6YuABgzVA2RF8_QH4qblhmrfGJwh9eaUtjCfkL8U-MQ0t3CYm6zAizsIgj60llfew9P_fm8d1H7yIrviPWRbTlmGpKTP4oI24Bd8lNIHBX1NhgJtkRXIg?key=jOQaYoaNITRy4hsSofPW4Q) ## **Command Properties** On the **Options** tab of the command, we have two options: 1. General Settings 2. Branch 3. Export ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfUMuxxZcUrGnsBXUWxDT3bI_N2eUG-W5mIHsZ_GFxWs6V5BzBYVZQe9Xiaq1r37QJ3V88eldAPtNB_dXhRzKL9BXHlMBu_8cqfso9CalT8YjUFZnTlCTkDwKLqRp3w8RE0fIy6?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfUMuxxZcUrGnsBXUWxDT3bI_N2eUG-W5mIHsZ_GFxWs6V5BzBYVZQe9Xiaq1r37QJ3V88eldAPtNB_dXhRzKL9BXHlMBu_8cqfso9CalT8YjUFZnTlCTkDwKLqRp3w8RE0fIy6?key=jOQaYoaNITRy4hsSofPW4Q) ### **General Settings → General Command Settings** The 'General command settings' section is designed for user customization to give the command a desired name, comment to describe in brief about the usability or requirement for the command and the disabled option to not execute this command at all. ![image-20241022-064235.png](https://cloudsupport.sequentum.com/__attachments/a_236a3f4c91bc96b9526b19d0d4e8cc106de18c42ba35f768b30015f0bae15678/image-20241022-064235.png?cb=66342c1a3fe7d99d6fc0d9fd13c76c66) 1. **Command name:** This property specifies the name of the command. 2. **Comments:** Provides a field for entering metadata or a brief description regarding the command. These annotations are used internally to provide context for developers or team members. Comments are not part of the exported data and are only used for documentation purposes within the configuration. 3. **Disabled:** This checkbox allows the user to disable the command. When checked, the command is ignored during execution. By default, it is unchecked. ### **General Settings → Selected content** ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfiRDmsPXwnHH3TPsu1KY72KoU77KZ_jKhzPVrS9KclVClj74FzZnfQ1zIx6Ga0mZwidptZALfO5QcWiNgy7_fX7HDB20k6ismS-SD5xf77yuXu3f_Wo3h-VqCgCFlMiW65_DAh?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfiRDmsPXwnHH3TPsu1KY72KoU77KZ_jKhzPVrS9KclVClj74FzZnfQ1zIx6Ga0mZwidptZALfO5QcWiNgy7_fX7HDB20k6ismS-SD5xf77yuXu3f_Wo3h-VqCgCFlMiW65_DAh?key=jOQaYoaNITRy4hsSofPW4Q) **When missing:** This dropdown menu lets users define how the agent should behave when the content is not found. The default option is **Fail**, meaning the agent will stop execution or log an error and proceed to the next sibling command. The available options are: * **Fail**: The agent will stop and return an error, or if there are parallel commands, it will log the error and move to the next parallel command. * **Warn**: The agent logs a warning but continues processing further commands. * **Ignore**: The agent neither logs an error nor a warning, and it skips any child commands, moving to the next parallel command. * **Passthrough**: The agent ignores the error but continues to execute the child commands. **When hidden or disabled**: This setting controls how the agent handles element selection based on their visibility or enabled/disabled state. * **Select**: The agent will select both visible and disabled elements that match the XPath. * **Ignore**: The agent will only select elements that are present and enabled (i.e., the XPath matches and the element is interactable). **Selected content:**This shows the content selected by the command on the current page. If no content is selected or a selection is missing on the current page, then it will show the message as "No selected Content". ### **Branch → Configure branch** ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdQcyqHkXWOc2cHMHT7jyEiEiQXEJmz6IgFSYzuaXjkWVAwav4P0uaiR7diME-wWVeF_VnsWweKvs6dQU36JDaRNigxJFLfcvtdMEfZ9NwtQdGoNaTFqNI2Ht58Z0dLfXh2U8Ur6w?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdQcyqHkXWOc2cHMHT7jyEiEiQXEJmz6IgFSYzuaXjkWVAwav4P0uaiR7diME-wWVeF_VnsWweKvs6dQU36JDaRNigxJFLfcvtdMEfZ9NwtQdGoNaTFqNI2Ht58Z0dLfXh2U8Ur6w?key=jOQaYoaNITRy4hsSofPW4Q) **Basic**: A user interface view to define conditions that determine whether to enter a branch. * **Data Source:** The source of the data consumed. * Data List - This option allows you to input data from the Parent data list command. You must select the specific Data list and the name of the sub-command or column from which you wish to retrieve the data. The Transformation option is also available for further customization. * Command - This option enables you to use the Parent command or the Parent's Parent command as the source of data for the Branch command. The Transformation option is also available for further customization. * Agent Parameter - By selecting this option, you can utilize the input parameters as the data source for the Branch command. The Transformation option is also available for further customization. * Action Result - In Action Result option, you will use the various action results as the source of the input data .There are several action Results options available in this settings such as Page HTML, Page URL, Is Error etc. * Selected Content - Compares the content of a selected web element with a specified constant. * **When hidden or disabled:**This setting controls how the agent handles element selection based on their visibility or enabled/disabled state. * **Select**: The agent will select both visible and disabled elements that match the XPath. * **Ignore**: The agent will only select elements that are present and enabled (i.e., the XPath matches and the element is interactable). **Branch When Data Source**: Specifies the condition type and comparison logic: * Includes unary and binary operators such as: * Empty / Not Empty * Equals / Does Not Equal * Greater Than / Greater Than or Equal * Less Than / Less Than or Equal * Contains / Does Not Contain * Starts With / Ends With * Matches / Does Not Match * Always True / Always False ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXextDfryJMc6hi2P0Dw2iZi7KNHSjoL9C8MbaBN6_3J0qUZHy3eap7xEI6wsr4O52R7xpahoHftDnynjzIxDqHXZGp0chS0T76zCwUfmabUr5QbEdsd-14Fydr0eaqldTRaOzo2VA?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXextDfryJMc6hi2P0Dw2iZi7KNHSjoL9C8MbaBN6_3J0qUZHy3eap7xEI6wsr4O52R7xpahoHftDnynjzIxDqHXZGp0chS0T76zCwUfmabUr5QbEdsd-14Fydr0eaqldTRaOzo2VA?key=jOQaYoaNITRy4hsSofPW4Q) **Scripting:** **Language:** Allows specifying the scripting language for advanced conditions or transformations. Supported languages include: Regex, C#, Python or JavaScript. ### **Export** Please refer to the "[++Export++](https://cloudsupport.sequentum.com/scm/container-commands-export-overview.md)" section for more insight. --- language: "en" --- # Browser Properties Overview This command property consists of two sections: **Browser settings and Browser response capture**. It specifies the various types of browsers (dynamic and Static) that can be used to run an agent and indicates the web browser in which a new web page should be loaded. Users have different options available to them, including the ability to capture the URL, request, headers, cookies, and more under the browser response setting section. This information can be utilized later in action results. The below figure depicts the browser properties ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcoGnlqsoOuKuh1dWnC5WsRtzkLxPrkok72_n84F48rUOKbWa7DkHfykCwlNNHD2vFT-i-iObSk6jHlCdPIPkHa0VC85aNDyeElCJFz382DRHMGkUke4DH7Z1KVqTlsgCi4CiR4?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcoGnlqsoOuKuh1dWnC5WsRtzkLxPrkok72_n84F48rUOKbWa7DkHfykCwlNNHD2vFT-i-iObSk6jHlCdPIPkHa0VC85aNDyeElCJFz382DRHMGkUke4DH7Z1KVqTlsgCi4CiR4?key=jOQaYoaNITRy4hsSofPW4Q) **Browser settings** : **Target :** This setting specifies where the new web page will load in the browser. By default, it opens in a new browser window. By default, it opens in a new browser window and the option is set to Default. Listed below are the different options available under Target dropdown: ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXer0LrLxxGoSVCun5gglZYYHukauRcteOQDduwsAKgiHOKd60eFXKD0AScGdYdG4OAhQ0dFGsJyp_3eCYMnslzlSOyAuAm6XmiC4fBmwbvRwHaThugd9yfmJ88N15zx0crfxpSQoA?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXer0LrLxxGoSVCun5gglZYYHukauRcteOQDduwsAKgiHOKd60eFXKD0AScGdYdG4OAhQ0dFGsJyp_3eCYMnslzlSOyAuAm6XmiC4fBmwbvRwHaThugd9yfmJ88N15zx0crfxpSQoA?key=jOQaYoaNITRy4hsSofPW4Q) * **Default:**This setting attempts to automatically configure the most suitable option for loading content. Typically, it defaults to opening a new browser window or tab when following a link * **Current:**This setting specifies that a web page should be loaded in the same browser window. By using this option, users can seamlessly transition to new content without opening additional tabs. * **Parent:** This setting specifies that a web page should be loaded in the parent browser window. This means that the link command will be executed in the same window where the parent command was executed, ensuring continuity in the browsing experience * **New:** This setting specifies that a web page should be loaded in the new browser tab. * **Popup:**This setting indicates that a web page should be loaded in a popup window. By selecting this option, users can open additional content in a separate, smaller window that overlays the current one. This is useful for capturing the supplementary information, forms, or notifications without disrupting the main browser. Using popups keeps the primary page accessible while users interact with the new content. * **Async:**When using the "Async" option, a new browser instance is created that operates independently from the parent browser. This means the parent browser does not wait for the async browser to finish its tasks. The two browsers run in parallel, allowing for faster execution in workflows where the result of the async browser is not required immediately by the parent browser. **Browser Type:**This setting specifies the type of web browser that will be used to load new content. By selecting a specific browser type, users can optimize their experience based on compatibility and performance, ensuring that content is rendered correctly and efficiently. By default, the option is set to "Default". ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcdCMUJaLJU_f4gneyp_LxgPYJQEYLa2mlBsfNBo3OTn6GKTVV0ALhf5Pnjm0pgXh6U0KH1MrmyGb0AfEvPvZG5J6s_iaTNFtCyrBa3RsP381zu3vNQT3UUGZlurnHBITVoRVw9QQ?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcdCMUJaLJU_f4gneyp_LxgPYJQEYLa2mlBsfNBo3OTn6GKTVV0ALhf5Pnjm0pgXh6U0KH1MrmyGb0AfEvPvZG5J6s_iaTNFtCyrBa3RsP381zu3vNQT3UUGZlurnHBITVoRVw9QQ?key=jOQaYoaNITRy4hsSofPW4Q) Ø **Dynamic:**A fully interactive browser that seamlessly executes scripts and renders styles, providing the complete functionality you'd experience during regular web browsing. It first loads the web page into a browser, where the page is parsed, rendered, and any JavaScript is executed. This makes the execution time of agents slow in Dynamic as compared to Static. By default, this property is set to Dynamic. Ø **Static:**A lightweight browser that loads only specified file types, such as HTML or JSON, without executing JavaScript, resulting in faster performance. The HTML parser processes web pages without a web browser, completely ignoring JavaScript, which allows for much quicker execution than a standard browser. Similarly, the JSON parser efficiently handles only text-based content, making it ideal for retrieving data through HTTP APIs in JSON format. However, this approach may not function properly on websites reliant on JavaScript. In Sequentum Cloud Static mode, the system automatically selects the most appropriate browser for your agent to optimize performance. **Rotate proxy:**When enabled, this option rotates proxies before loading each link/URL, ensuring that every request uses a different proxy. This improves anonymity and reduces the chances of getting blocked. By default, the checkbox is unchecked. **Clear cookies and JavaScript storage**: When enabled, this option clears cookies and local storage before a session, preventing stored data from previous sessions from influencing the current one. This enhances privacy and ensures a fresh start for each session. By default, the checkbox is unchecked. **Ignore error codes if content is received, except for not found errors :**This option allows the system to ignore incorrect status codes as long as the server returns content. It ensures that valid data is captured even if the website returns improper codes. By default, the checkbox is checked. **Ignore not found error codes if content is received:** When enabled, this option ignores "Not Found" error codes (such as HTTP 404) if the response still contains content. This can be useful in cases where the server returns a 404 status but includes a valid response body that you still want to process. By default, this option is **unchecked**, meaning such error codes will not be ignored even if content is received. **Random delay before action :**When you select the "Random Delay Before Action" option, two additional fields appear: Minimum Delay and Maximum Delay, each pre-filled with default values. The system will then wait for a random delay before taking action, with a default minimum delay of 1000 milliseconds and a maximum delay of 5000 milliseconds. Both of these values are editable, allowing users to customize the settings according to their needs while starting with these default configurations. **Browser Response Capture:** ![image-20241023-051620.png](https://cloudsupport.sequentum.com/__attachments/a_1ab2c4d45e9ddb023798dd66f5f48b084b09f5728a81edb39840abc73dfa466e/image-20241023-051620.png?cb=24be83b01301911cefa48d24e7b07a02) **Capture Response Headers and Cookies:** This setting allows users to capture response headers and cookies for later export or use. When the checkbox is enabled, it retains important data from web responses, which can be useful for analysis and debugging. This functionality enhances the ability to track interactions effectively. By default, this checkbox is unchecked. **Capture File:**This setting allows the user to capture response files for export or further use. When the checkbox is enabled, it captures the complete response files for later analysis or reference. If the checkbox is not selected, the response files will not be captured. By default, this checkbox is unchecked. **Capture Response Content:** This setting allows users to capture the response content (as text) for export or future use. When the checkbox is checked, it enables the capture of content, requiring users to enter a RegEx filter to specify the exact information to be captured. This feature is particularly useful for extracting specific details from responses for later analysis or reference. By default, this checkbox is unchecked, and the option is disabled until the necessary filter is provided. ![image-20250604-140538.png](https://cloudsupport.sequentum.com/__attachments/a_74e98398e1c658a5a35742ee67ffedfcdb98d2c396a736a170453578c0f5ab76/image-20250604-140538.png?cb=8567a7fed2b24cd72fafdccc0ba0ec6f) **Example -\>** .\*/Dealer.\* *regex will capture the response that URL contains the substring "/Dealer" anywhere within it, with any characters before and after it.* ![image-20241023-051926.png](https://cloudsupport.sequentum.com/__attachments/a_030dd705b77833bd4c206a1b8df8ff44554a3dd29d496248128362192893df5a/image-20241023-051926.png?cb=c2e52578d853bd4f405fe3f32a943d47) **Naming Format** controls how the captured **response content** is saved and named. This helps organize multiple response files clearly during data extraction or debugging. ![image-20250604-141359.png](https://cloudsupport.sequentum.com/__attachments/a_5fbb9b63baa7016f43c8cc368635f5ac03f575805fba502c846ce6a517cc09d6/image-20250604-141359.png?cb=b616c5732bbe09628714c507e1cc6125) * **URL File Name:**Saves the response content using the last segment of the request URL as the file name. Useful when the URL structure includes meaningful identifiers, helping you recognize what the response is related to. * **Sequential:** Saves each response content with a numbered file name like `1.html`, `2.html`, etc. Ideal when URLs are dynamic or do not provide meaningful naming, ensuring each saved response is unique and ordered. **Capture Audio Stream:** This setting allows users to record audio streams for various purposes. When the checkbox is checked, it enables audio capture in two formats:**WAV and MP3.** Additionally, there is an optional feature to complete the recording after a **designated period of silence,**providing greater control over the captured content. By utilizing this setting, users can effectively capture the desired audio while minimizing unnecessary background noise. By default, this checkbox is unchecked. **Capture Requests:** This option enables users to specify regex patterns to filter and capture specific requests. When enabled, it enhances tracking by focusing on relevant data for easier analysis. This setting is unchecked by default. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXelAD1miKg2PqLFUM0CUce_KzHNrlSG4KFIGFtdiTBQAMCKINH-8i7pUvZ-dl71nE704mjEPDMq1uxzlZn57UsOrDgzP-KT5tWFOlcsnallGhia9GSLgxyGPKwcKwfuRxYg4wI771I-Youpz1Vv4bNX7gXe?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXelAD1miKg2PqLFUM0CUce_KzHNrlSG4KFIGFtdiTBQAMCKINH-8i7pUvZ-dl71nE704mjEPDMq1uxzlZn57UsOrDgzP-KT5tWFOlcsnallGhia9GSLgxyGPKwcKwfuRxYg4wI771I-Youpz1Vv4bNX7gXe?key=w6pMrdQ7HlvkdgQoN04a4w) **Dynamic browser settings** : This setting manages how the Dynamic browser loads URLs, including setting wait times for browser activities. It allows users to block specific URL requests with regular expressions and customize image and style loading settings, optimizing performance and appearance for a smoother browsing experience. * **Wait Settings:**This feature determines how long the web page should wait for all ongoing browser activities to finish before proceeding. By default, the setting is configured to "Wait For Local Content", ensuring that the page fully loads any locally stored resources before moving forward. * **Wait for Local Content:**This property instructs the browser to pause and wait for the web selections and URLs specified by the user to load completely. This setting is particularly useful in scenarios where loading times may vary, helping to create a more seamless browsing experience. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXe8a7iAaSDJhdfPunTznLs95yXJE2EE3xZnJuQChQwr08x5Li5fNPvUJsHohJRO9dBUWXedF2soK5bty-r8Q64nU3BniMWb3kLpD856WC2iBFPQ-ZouXR_EsXS2cxPWwY0Cijr7ng?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXe8a7iAaSDJhdfPunTznLs95yXJE2EE3xZnJuQChQwr08x5Li5fNPvUJsHohJRO9dBUWXedF2soK5bty-r8Q64nU3BniMWb3kLpD856WC2iBFPQ-ZouXR_EsXS2cxPWwY0Cijr7ng?key=jOQaYoaNITRy4hsSofPW4Q) * **Wait for Main Page Load Only:**This property directs the browser to pause and wait for the specified main page to load completely. By utilizing this setting, users ensure that the designated page is fully rendered before proceeding. * **Wait for All Content:**This setting determines whether the command should wait for the entire page, including dynamically loaded Ajax content, to finish loading in the browser or not. By enabling this option, users ensure that all elements of the page are fully loaded before moving forward. * **Wait for Async Loaded Content:** This setting specifies whether the browser should pause and wait for all asynchronously loaded content to finish loading or not. By enabling this option, users can ensure that elements such as images, scripts or data fetched via Ajax are fully loaded before proceeding. * **No Wait:** This setting specifies that the command should not wait for the full page to load. By selecting this option, users allow the process to continue immediately, even if some elements or resources have not yet finished loading. * **Load Images:** This property determines whether images are loaded and displayed in the web browser or not. It's important to note that an agent can still capture images even if they are not visible. Disabling image downloads can improve the agent's performance by reducing loading times. This setting applies only when the Default browser type is set to Dynamic. By default, it is configured to "Default". ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXeXdzpGKeMEJrsm5W5EDTRKkQDmyGSSct9gbz5wPHd8oz-BlEY2XkcW5cnm_cFtUY7Huroggo7fbES1SY8ycCDAJrKkMfbysPG6gZpyuvueajmJJq1GHhxKm5FEDe7LN6IMfrOC?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeXdzpGKeMEJrsm5W5EDTRKkQDmyGSSct9gbz5wPHd8oz-BlEY2XkcW5cnm_cFtUY7Huroggo7fbES1SY8ycCDAJrKkMfbysPG6gZpyuvueajmJJq1GHhxKm5FEDe7LN6IMfrOC?key=jOQaYoaNITRy4hsSofPW4Q) * There are three options available under Load Images : * **Default:**This option is selected by default. It will determine the load images based on the choice specified in the agent settings. In other words, the option chosen in the agent settings will serve as the default for load images in the link command. * **Yes:** This setting allows images to load in the browser, enabling them to be displayed as part of the web page. By selecting this option, users ensure that the visual content is fully visible. This configuration is particularly useful for agents where images play a crucial role in conveying information or engaging users. * **No:** This setting prevents images from loading in the browser, meaning they will not be displayed on the web page. By selecting this option, users can improve loading times and overall performance, especially in scenarios where images are not essential for the user. This can be particularly useful for reducing bandwidth usage or speeding up page loading time with content-heavy pages. * **Load Styles:** This property specifies when style sheets (CSS) are downloaded by the web browser. It also applies to the HTML static parser in design mode, providing users with precise control over the timing of style loading. This feature is especially beneficial in dynamic browsing environments, as it helps optimize content loading and enhances overall performance. By default, this property is set to "Default". ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcxIv9jA9bDOXavRd1ZbI09jfX__dhuQoOD1XVSzG55s4V8BtnLOrFW9U-6LHWtQkHbMG_3EdjWHj__IH9ObzNBhrK7pMgY868mH-pDV7DISJL26XV_a30VQckC1f_yz8tWOcaE?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcxIv9jA9bDOXavRd1ZbI09jfX__dhuQoOD1XVSzG55s4V8BtnLOrFW9U-6LHWtQkHbMG_3EdjWHj__IH9ObzNBhrK7pMgY868mH-pDV7DISJL26XV_a30VQckC1f_yz8tWOcaE?key=jOQaYoaNITRy4hsSofPW4Q) There are three options available under Load Styles :- * **Default:** This option is selected by default. It will determine the load styles based on the choice specified in the agent settings. In other words, the option chosen in the agent settings will serve as the default for load styles in the link command. * **Yes:** This setting allows style sheets (CSS) to load in the browser, ensuring that the visual design and layout of web pages are properly rendered. By enabling this option, users can ensure that all styling elements are visible and functional, maintaining the intended aesthetic and usability of the site. This is particularly important for Websites where design plays a crucial role in displaying data. * **No:**This setting prevents style sheets (CSS) from loading in the browser, meaning that the visual design and layout of web pages will not be applied. By selecting this option, users can improve loading times and overall performance, especially in scenarios where styling is not essential. This can lead to a more basic display of content, which may be suitable for certain websites or environments where speed is prioritized over visual appearance. * **Block Ads:** This property prevents the web page from loading content from known ad servers, such as '[http://ad.doubleclick.net](http://ad.doubleclick.net/) ' By doing so, it can slightly improve page loading speeds and enhance processing efficiency. This feature also helps create a cleaner browsing experience by reducing distractions from advertisements. By default, this property is set to "Default". * * ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXePHxgkUT_-pftAOU9_gn_fPOMy74CzmiqnhjEHt9TMAxNxJ3POwrwj2jcnhH-P10Zl5zASIgKIvH40s-0PuAl6m86ewDt0dAI5N4e_8cebMpMYib49ReP_0tYuNpFeYE8b1uFL?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXePHxgkUT_-pftAOU9_gn_fPOMy74CzmiqnhjEHt9TMAxNxJ3POwrwj2jcnhH-P10Zl5zASIgKIvH40s-0PuAl6m86ewDt0dAI5N4e_8cebMpMYib49ReP_0tYuNpFeYE8b1uFL?key=jOQaYoaNITRy4hsSofPW4Q) **Default:** This option is selected by default. It will determine the Block Ads settings based on the choice specified in the agent settings. In other words, the option chosen in the agent settings will serve as the default for Block Ads in the link command. * **Yes:**This setting blocks advertisements from loading in the browser. By enabling this option, users can prevent ads from displaying on web pages, resulting in a cleaner and more focused browsing experience. This can also lead to improved loading times and reduced clutter, making it easier to access the desired content. * **No:** This setting allows advertisements to load in the browser. By keeping this option enabled, users will see ads displayed on web pages, which can contribute to a more traditional browsing experience but may also lead to slower loading times and increased visual clutter. * **Block requests between actions:** This property controls whether network requests are blocked between automated actions like clicks or typing. Blocking these requests can help reduce interference from background activity, leading to more stable and reliable test [execution.By](http://execution.by/) default, this property is set to **"Default"**, which follows the behavior defined in the agent settings. * ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcOUORojgS9_lApwfWwBev9Z39awCX_RiTjBNLnY5Chp6aWSXzDdFPmAEsP0GbGuFk32QL9SUTKdtL2Wq1TwaUR2wghC5jLG2fKtqmkuZsc0u83TrVDq940Lc2LRzsMI6mJYBR0?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcOUORojgS9_lApwfWwBev9Z39awCX_RiTjBNLnY5Chp6aWSXzDdFPmAEsP0GbGuFk32QL9SUTKdtL2Wq1TwaUR2wghC5jLG2fKtqmkuZsc0u83TrVDq940Lc2LRzsMI6mJYBR0?key=jOQaYoaNITRy4hsSofPW4Q) **Default:** This option is selected by default. It follows the behavior specified in the agent settings. In other words, the agent's configuration will determine whether or not requests are blocked between actions in the link command. * **Yes:** This setting blocks network requests from being made between automated actions (like clicking or typing). Enabling this option helps ensure a more controlled test environment by reducing unexpected changes or background activity that could interfere with test results. It can lead to more stable and reliable test execution. * **No:** This setting allows all network requests to continue between actions without blocking. While this may reflect a more natural browsing behavior, it can introduce variability in tests due to ongoing background activity or page updates. * **Block URLs:** This feature allows you to use regular expressions to block specific requests from your server. By filtering out unwanted URLs with harmful content or risky file types, you enhance your agent's security, ensuring only legitimate requests are processed and mitigating potential threats. By default, the textbox for entering regex is empty. **Dynamic browser timeouts**: This feature allows you to adjust timeout settings based on current system conditions or user behavior. Instead of relying on static timeout values, dynamic timeouts can respond to varying page loads, agents performance. By implementing this approach, you can enhance agents optimization by reducing unnecessary delays while maintaining optimal resource management and system responsiveness. This flexibility is crucial for websites that require fluctuating demands. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXeDoTvO6n8oa_pzJJfDxWY7XwfjZ5QgRNp816ugGWnJsiOZC7FmKXBuGJ7OceUojTWsh1_-dSFSvtfUH2MTVDSj0MZSGjiIVa9TwtCPZ5Tf9RPvqEMvGAtY1VIYsud1tWQaLxEp1J32bT3xaDB_twzc1idD?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeDoTvO6n8oa_pzJJfDxWY7XwfjZ5QgRNp816ugGWnJsiOZC7FmKXBuGJ7OceUojTWsh1_-dSFSvtfUH2MTVDSj0MZSGjiIVa9TwtCPZ5Tf9RPvqEMvGAtY1VIYsud1tWQaLxEp1J32bT3xaDB_twzc1idD?key=w6pMrdQ7HlvkdgQoN04a4w) * **Timeouts:** This feature categorizes timeout settings into five distinct levels: Default, Short, Normal, Long, Very Long, and Custom. Each level addresses different needs, ensuring optimal performance of agents. By default, the value is set to Default. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcnwfxFpKbvCwfFWz9rsMoCaIsn-a4ahRH9sBHhBhv4KZYjtKeAct_dN1TkLdcy3ER7U1cYoH10JwIqZ0BYbGJi1V7JWYHPsV6bN7ebyenSWDXG8TcZPF18rOFIQbTkUVmrdWzu_Gkgc_RQPbz1yxyD8uHq?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcnwfxFpKbvCwfFWz9rsMoCaIsn-a4ahRH9sBHhBhv4KZYjtKeAct_dN1TkLdcy3ER7U1cYoH10JwIqZ0BYbGJi1V7JWYHPsV6bN7ebyenSWDXG8TcZPF18rOFIQbTkUVmrdWzu_Gkgc_RQPbz1yxyD8uHq?key=w6pMrdQ7HlvkdgQoN04a4w) Each one of the available options present in timeouts is described below: **Default:**It will wait for the duration specified by default in the options listed. **Short:**Ideal for quick interactions, minimizing wait times and enhancing user satisfaction. **Normal:**Suitable for standard requests, balancing responsiveness with processing needs for typical tasks. **Long:**Designed for operations that may take extra time, such as complex data loading or processing. **Very Long:**For tasks requiring extended durations such as large uploads, ensuring user sessions remain active. **Custom:** Allows users to define specific timeout duration values tailored to unique scenarios, providing flexibility to meet specific website requirements. * **Page Load Timeout (seconds):**This setting specifies the maximum time allowed for a web page to fully load. If the page does not load within this duration, the request is aborted, preventing users from experiencing long wait times. The default value is set to 15 seconds. * **Page Initialization Timeout (seconds):** This defines the time allowed for the initial setup of the page, during which scripts and resources are loaded. Exceeding this timeout may indicate loading issues, triggering error messages or retries. The default value is set to 5 seconds. * **Async Timeout (seconds):** This timeout governs how long the system will wait for asynchronous operations, such as API calls or data fetching. If these operations do not complete in the allotted time, they are considered failed, maintaining agent responsiveness. The default value is set to 5 seconds. * **Discover Activity Timeout (seconds):**This setting determines the maximum time for the system to search for specific activities or resources within the agent. A shorter timeout helps quickly identify discovery issues, allowing for faster user feedback. The default value is set to 1 seconds. * **Discover First Activity Timeout (seconds):** Focused on the initial interaction, this timeout measures how long the system will wait to find the first activity when a user engages with the agent. This ensures quick access to key functionalities. The default value is set to 2 seconds. * **Parse HTML Timeout (seconds):**This timeout dictates how long the system will wait while parsing the HTML content of a page. A reasonable duration helps manage delays in content rendering, enhancing user experience. The default value is set to 3 seconds. By carefully configuring these timeout settings, you can enhance agent performance and overall agents efficiency. Each timeout is crucial for ensuring timely responses while effectively managing potential delays, resulting in a smoother and more reliable data scraping. **Static browser settings** : * Static browser settings controls the behavior and appearance of a web browser. Key configurations include page load timeout (default 15 seconds), character encoding (e.g., UTF-8).These settings ensure a consistent and user-friendly browsing experience. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcKEoWINMqKT6EKFcdW7MxppgD1QVZf_gUh_FPmH0RXFCuEakgsIn26OJtVTc4dj05_WfEiuT6R_Fe_li6Q2Unn0Fj5jgarBbwhfEsqtcfJ51dkyBXLk3eO8yIouAz-XU2TH5B-OR77XZ2vSaLDRr3lAf7t?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcKEoWINMqKT6EKFcdW7MxppgD1QVZf_gUh_FPmH0RXFCuEakgsIn26OJtVTc4dj05_WfEiuT6R_Fe_li6Q2Unn0Fj5jgarBbwhfEsqtcfJ51dkyBXLk3eO8yIouAz-XU2TH5B-OR77XZ2vSaLDRr3lAf7t?key=w6pMrdQ7HlvkdgQoN04a4w) * **Page load timeout:** The page load timeout (in seconds) specifies the maximum duration the browser will wait for a page to load before generating an error. A common default value is **15 seconds.** Adjusting this timeout can help manage loading of websites, particularly for sites that may take longer to respond. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfu1RAwU-Sas6kZmAZKHzkOhGfS9t6eqz__Tioiq0aFLbBj8pESovvFjq8cv3yG3Iu1vjvzL4XsPCNNF7RJeIrgCObaVwp_POkMZJwF8RHltJ169_KLxB2xI2rl27cif6G6tmoZYmduDKxmlplF59SJd1M?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfu1RAwU-Sas6kZmAZKHzkOhGfS9t6eqz__Tioiq0aFLbBj8pESovvFjq8cv3yG3Iu1vjvzL4XsPCNNF7RJeIrgCObaVwp_POkMZJwF8RHltJ169_KLxB2xI2rl27cif6G6tmoZYmduDKxmlplF59SJd1M?key=w6pMrdQ7HlvkdgQoN04a4w) **Fixed Encoding:** This setting allows you to choose the character encoding for your web pages which is essential for displaying text correctly. The default encoding is UTF-8, known for supporting a wide variety of characters and languages. However, you can select other encodings, such as ASCII or ISO-8859-1, based on your needs. Choosing the right encoding is vital to ensure accurate representation of text especially when using special characters or symbols. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXe0Qboi04_yHF9zTXQMhVrsuJyWOJYk0ZQrLaouXCCQSgiFRhwE03goh8UVWcTI_AVABfhAtlXBkG5HmDTsU9zMhAlCNOoNfhfrTYOLXt7nGqheLrpAM4Nxn-yXHWg9aZB-XXcZGplKnBezhKyIyKmRD9Rf?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXe0Qboi04_yHF9zTXQMhVrsuJyWOJYk0ZQrLaouXCCQSgiFRhwE03goh8UVWcTI_AVABfhAtlXBkG5HmDTsU9zMhAlCNOoNfhfrTYOLXt7nGqheLrpAM4Nxn-yXHWg9aZB-XXcZGplKnBezhKyIyKmRD9Rf?key=w6pMrdQ7HlvkdgQoN04a4w) --- language: "en" --- # Browser Commands These commands handle navigation and interaction with web pages. They are essential for loading content, following links, and working with dynamic pages. Browser commands form the basis of any web scraping project by dictating how the agent moves through the web and accesses the required data. * [URL Command](https://cloudsupport.sequentum.com/scm/url-command-overview.md) * [Link Command](https://cloudsupport.sequentum.com/scm/link-command-overview.md) * [Open Page Command](https://cloudsupport.sequentum.com/scm/open-page-command.md) * [Open Content Command](https://cloudsupport.sequentum.com/scm/open-content-command.md) * [Auto Scroll Properties](https://cloudsupport.sequentum.com/scm/auto-scroll-properties.md) --- language: "en" --- # Quick Tour In this section, we'll cover the process of using Sequentum Cloud Agent Editor to create a *very simple* web data extraction agent so you can quickly familiarize yourself with the steps of writing, testing, publishing, scheduling, running, monitoring the runtime status and reviewing exported data. We'll work through each of these steps with examples matching common web data extraction scenarios, so you can get comfortable building your own agents. We have a separate tutorial for writing a more complicated agent [here](https://cloudsupport.sequentum.com/scm/building-your-first-agent.md). This section assumes that you have already created an account on Sequentum Cloud and followed the steps to login. See the [Login and Dashboard page](https://cloudsupport.sequentum.com/scm/login-and-dashboard-page) for information on those steps. The following video shows a brief animation of the steps we will walk you through. Read below for a full explanation. [20250604-1348-08.9657180.mp4](https://cloudsupport.sequentum.com/__attachments/a_6970dd48817cf46abac473317f160f374d2c86f253773fd5dac81ebc35a14cfd/20250604-1348-08.9657180.mp4.md) **Topics covered in this guide:** * [Choosing a Start URL](https://cloudsupport.sequentum.com/scm/build-your-first-agent-overview#QuickTour-ChoosingaStartURL) * [Selecting the Content to Capture](https://cloudsupport.sequentum.com/scm/build-your-first-agent-overview#QuickTour-SelectingtheContenttoCapture) * [Output Data Format](https://cloudsupport.sequentum.com/scm/build-your-first-agent-overview#QuickTour-OutputDataFormat) * [Testing the Agent](https://cloudsupport.sequentum.com/scm/build-your-first-agent-overview#QuickTour-TestingtheAgent) * [Publishing the Agent](https://cloudsupport.sequentum.com/scm/build-your-first-agent-overview#QuickTour-PublishingtheAgent) * [Scheduling the Agent](https://cloudsupport.sequentum.com/scm/build-your-first-agent-overview#QuickTour-SchedulingtheAgent) * [Running the Agent](https://cloudsupport.sequentum.com/scm/build-your-first-agent-overview#QuickTour-RunningtheAgent) Before you begin, you might want to check out the [Sequentum Cloud Editor](https://cloudsupport.sequentum.com/scm/sequentum-cloud-editor) section of the manual for a quick tour of the layout and tools in the Editor screen. ## **Choosing a Start URL** To begin, login to Sequentum Cloud and select New Agent to open the Editor. The Start URL is where data collection begins, marking the starting point for your web data extraction agent. For our example, we'll use the website. Paste the URL below into the Sequentum Cloud Address Bar and press 'Enter' to load the page. https://training.sequentum.com ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcl3vqaHLAHW3GvUINaXUsWQxK5yNo1h8kbR8-iASOUBXCoQa8Gt-_3Jc6f-80eWHeoIVZWJh1lvjDreo6buYdNL-vf0QS5wr4ScOFXEuAvJg35t2PgLQtia4ajjaroG4YS8P0teA?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcl3vqaHLAHW3GvUINaXUsWQxK5yNo1h8kbR8-iASOUBXCoQa8Gt-_3Jc6f-80eWHeoIVZWJh1lvjDreo6buYdNL-vf0QS5wr4ScOFXEuAvJg35t2PgLQtia4ajjaroG4YS8P0teA?key=jOQaYoaNITRy4hsSofPW4Q) This will load the target page in the Sequentum Cloud Agent Editor, enabling you to proceed with data extraction setup. ### **Selecting the Content to Capture** After loading the Start URL into Sequentum Cloud, you can select the data you want to capture and start building your agent. Move your mouse pointer over elements in the Agent Editor screen to see the items highlighted with a pinkish background color. This is how you can tell what will be selected when you click. (For a deeper dive, see the manual section on [Selection Techniques](https://cloudsupport.sequentum.com/scm/selection-techniques)) 1. To capture a list of all the elements present on the screen, click on the text "**Build your first Agent** " to select it. Then press and hold **Shift** and click on the next item in the list, "**Multiple Elements** ". This will select all the elements on the page that have the same XPath class. You will see that all the list elements are highlighted and the count of selected elements appears in the bottom left corner of the Editor window, as in the screenshot below. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfok2xsaOd-jKoNAOC1sK3eG5xMq70hn-38bvjsxIOHmU4J2nNgaDJKBZowbseaHzZ--bT8sC3mx_6tSGFq6kRWaEXwvAsZZNUWx0bca8oZIbIyn7SzBS7mGbNM3JKvYaHrdVT7cA?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfok2xsaOd-jKoNAOC1sK3eG5xMq70hn-38bvjsxIOHmU4J2nNgaDJKBZowbseaHzZ--bT8sC3mx_6tSGFq6kRWaEXwvAsZZNUWx0bca8oZIbIyn7SzBS7mGbNM3JKvYaHrdVT7cA?key=jOQaYoaNITRy4hsSofPW4Q) 2. Once all the elements are highlighted, look at the bottom frame as shown below and click on the **Extract** button. This will add a new **List** command along with **Content** command to capture the content. You will see these commands appear in the Agent Explorer pane on the left side of the screen. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcMHlryw8A0xRGvIYqYoTAfgVtCzafA4HDlr6Wo8VZMq0mrImtznL61vwZNYmaJKDF63p8eCxYVOBKuGF1HI808VaWYHVG1SkiE7C64J8X4RIf_Ou0j6PDShfh00BwGyew5JkHx4g?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcMHlryw8A0xRGvIYqYoTAfgVtCzafA4HDlr6Wo8VZMq0mrImtznL61vwZNYmaJKDF63p8eCxYVOBKuGF1HI808VaWYHVG1SkiE7C64J8X4RIf_Ou0j6PDShfh00BwGyew5JkHx4g?key=jOQaYoaNITRy4hsSofPW4Q) ### **Output Data Format** Now that you have your list selected, you need to define how you will export the data. Sequentum Cloud supports exporting extracted data into many formats, including **CSV** and **JSON.** You can also insert data directly into databases such as **Snowflake** . Additionally, you can configure Sequentum Cloud to deliver data to remote storage options like **S3** , **Google Sheets** , **Google Drive** , and **FTP**. 1. To view the export options, find the **Export icon** ![image-20241019-135807.png](https://cloudsupport.sequentum.com/__attachments/a_76624e686910021dd4e3d2a207a4bd4425695d19616f0620dfaf014c974b6b0d/image-20241019-135807.png?cb=9f79c219037a33d37d41188bef036b21) in the toolbar on the far left, and click it once to expand the export options. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXf7V9g7K3uBo0M2qCzIrgBNaI8_eJaFJPysc9oV2gWBVIOrfZlMYkcsZwD2uIdCgGfSkuc1b8D6lnt7Zen7YgeMe4En6lT_gBRjS5e-PDWlsM4xGN2WQkNWs1DI6ubefPKDeRE?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXf7V9g7K3uBo0M2qCzIrgBNaI8_eJaFJPysc9oV2gWBVIOrfZlMYkcsZwD2uIdCgGfSkuc1b8D6lnt7Zen7YgeMe4En6lT_gBRjS5e-PDWlsM4xGN2WQkNWs1DI6ubefPKDeRE?key=jOQaYoaNITRy4hsSofPW4Q) 2. To choose your data export type, click on any of the Export method commands to add it to the Agent Explorer pane. (If you add one by accident, you can always remove an item from the Agent Explorer by dragging it out of the agent or by right-clicking it and selecting Delete from the right-click menu.) CSV is selected by default and already appears in the Agent Explorer. For this sample agent, use CSV for the export method. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcuRybis-R9tZwJ1x3bl7a-tp4Zid0Hfc3KYqY4hqKeIyULyz6WcxROCThuZRAe9A0Y1E0vTU65kLsEUtnUvhkvuchLveqzi5MgS-45ZG5WzBvPaTJn3UM9kn6_l_jpq1pFeghM1Q?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcuRybis-R9tZwJ1x3bl7a-tp4Zid0Hfc3KYqY4hqKeIyULyz6WcxROCThuZRAe9A0Y1E0vTU65kLsEUtnUvhkvuchLveqzi5MgS-45ZG5WzBvPaTJn3UM9kn6_l_jpq1pFeghM1Q?key=jOQaYoaNITRy4hsSofPW4Q) ### **Testing the Agent** It's essential to test your agent to ensure correct data extraction. Sequentum Cloud offers debugging features to analyse agent performance and pinpoint issues. To debug: 1. Click on the Preview button. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXe5kannUXgsXCXulZTnPkl_243K1ckyRSGwgG9d6NWC5O8OpeGkrhpo4q9Sg3tJ66BC4BB48Kwwwv-GuMKxv3vmfdvq3g-6nV-zpJFJPKbSABdMvIsz2jyxpV1L55-VZ0dC10QtwA?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXe5kannUXgsXCXulZTnPkl_243K1ckyRSGwgG9d6NWC5O8OpeGkrhpo4q9Sg3tJ66BC4BB48Kwwwv-GuMKxv3vmfdvq3g-6nV-zpJFJPKbSABdMvIsz2jyxpV1L55-VZ0dC10QtwA?key=jOQaYoaNITRy4hsSofPW4Q) 2. Once you click Preview, you will see the agent execute the commands in the Agent Editor frame. In this way you can monitor the agent as it goes through each command in the sequence. You can adjust the Play Speed to speed up or slow down the rate of the playthrough. You will see the steps of the playthrough in the Preview Log in the bottom frame. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdTi0nXWNMuXwuX6cdi-JrOeTWcZwFEFeQOAq7VPm_1kK-3B6uBPKOgj_gsGGahAMeOcIuo484EdOXMlR5XUIB5BDv83Nr4RuMjBRy93d2HTZ14O9XwbUmI64mz0PPAJgFxFHRVug?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdTi0nXWNMuXwuX6cdi-JrOeTWcZwFEFeQOAq7VPm_1kK-3B6uBPKOgj_gsGGahAMeOcIuo484EdOXMlR5XUIB5BDv83Nr4RuMjBRy93d2HTZ14O9XwbUmI64mz0PPAJgFxFHRVug?key=jOQaYoaNITRy4hsSofPW4Q) 3. After the playthrough is completed, you can view the captured data from the bottom Data section or from the**Preview\>View Preview Data** and confirm the output is correct or not. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfpYt3OWgsVspoZIULL4Vkvw3YdwSjmQXqhEPNvbQRlUkZh71I2yq9_yXpmfHDYEKf8xSyns3SdZ_QLEAed10BCf0xS1T299S1he9X2tI98z8PgLeqJCDmU92QZxO0SN9EY_jBPLA?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfpYt3OWgsVspoZIULL4Vkvw3YdwSjmQXqhEPNvbQRlUkZh71I2yq9_yXpmfHDYEKf8xSyns3SdZ_QLEAed10BCf0xS1T299S1he9X2tI98z8PgLeqJCDmU92QZxO0SN9EY_jBPLA?key=jOQaYoaNITRy4hsSofPW4Q) ### **Publishing the Agent** After completing your agent, publish the agent by clicking on the Save option in the top right corner of the Sequentum Cloud Editor. You will need to give your agent a Config name and select the Space where you want to publish it. Once Published, you can configure the agent's schedule, shown in the next section. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcRTcdfB2QQS2JqQHSLd2_bhIXLV3NQPEsruqhPZUGk-YYfcDPztodAg1u6AlklWJ1qXp7gerCt94NOw0uPOStZZTdrLYBFOmDSt5OJPNrElwdaPlyYhLEvIs6CJ2azdF_cpmPj?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcRTcdfB2QQS2JqQHSLd2_bhIXLV3NQPEsruqhPZUGk-YYfcDPztodAg1u6AlklWJ1qXp7gerCt94NOw0uPOStZZTdrLYBFOmDSt5OJPNrElwdaPlyYhLEvIs6CJ2azdF_cpmPj?key=jOQaYoaNITRy4hsSofPW4Q) ### **Scheduling the Agent** Sequentum Cloud enables agent scheduling through the Control Center, allowing agents to run automatically at specified intervals. 1. Navigate to the Control Center by clicking on the Exit to Dashboard option available on the top left corner on Sequentum Cloud Editor under the Sequentum logo. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdiIVTTDUG0K-FDQCnA7xu3wJheHHnJ1H8SmY-cg9AOC_gXnposVMULyK-h0dkUs7LcrRWI1Lfsv6WzJ-Y7US6GA-OhRVt-_19sJYxQ-MEamMWZLgRxup4afWPAu8yRdZNvUoqrqQ?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdiIVTTDUG0K-FDQCnA7xu3wJheHHnJ1H8SmY-cg9AOC_gXnposVMULyK-h0dkUs7LcrRWI1Lfsv6WzJ-Y7US6GA-OhRVt-_19sJYxQ-MEamMWZLgRxup4afWPAu8yRdZNvUoqrqQ?key=jOQaYoaNITRy4hsSofPW4Q) 2. Clicking Exit to Dashboard from within the Agent loads the Agent Details page: ![image-20250604-100942.png](https://cloudsupport.sequentum.com/__attachments/a_b3c06c8450d1aefe2eb092d8ca0d6a59b13520b3e4b1df9dacdb7d3c4de7fb62/image-20250604-100942.png?cb=d9eb025a798da05a502766481f44e99f) 3. Now click on the Schedule option and enable the Schedule checkbox. Set a schedule and click on Save Schedule. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXed27P_8y65b9WBF9hG33btnHuNQSn0OCmo29ry92SGyzh321TGc_q1tCt77vKgU8R8Qk2-G4j_5dSSDfySmxBApQpejcqd3E4-S9RHap3MiIU5K-vMW_DZzMDDHq5dFXpoGAQh5w?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXed27P_8y65b9WBF9hG33btnHuNQSn0OCmo29ry92SGyzh321TGc_q1tCt77vKgU8R8Qk2-G4j_5dSSDfySmxBApQpejcqd3E4-S9RHap3MiIU5K-vMW_DZzMDDHq5dFXpoGAQh5w?key=jOQaYoaNITRy4hsSofPW4Q) 4. Note that the Schedule is added and is visible under the schedules section. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfOwdO9mpeCNxto3XQDDx7PkWyI-6OCaaU7FhMdkCNC6mfMjKZPbxqTHRXhEk84pKXdbq3ZiAJoK1qZqFZcSOFz807yLyDIziRMfiFSd0g5YMn6XlKhL0syv5pieQMuUEIlYfKd4w?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfOwdO9mpeCNxto3XQDDx7PkWyI-6OCaaU7FhMdkCNC6mfMjKZPbxqTHRXhEk84pKXdbq3ZiAJoK1qZqFZcSOFz807yLyDIziRMfiFSd0g5YMn6XlKhL0syv5pieQMuUEIlYfKd4w?key=jOQaYoaNITRy4hsSofPW4Q) 5. Here you will see the Export file and Log file and all the other details which you set previously. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfb6pi9cmoioJrtNR__svg2JMhLfqf6v9Dw4gy_APKD1OQOJHsQJ9arY4fsXuG9ZNwjgKD3Zv7v6_lyFAx6uVFOTFR1brEXHY2UL_HeyQ7ohXuxt3hzV1vEYx7XD0XjgmnGZpS7?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfb6pi9cmoioJrtNR__svg2JMhLfqf6v9Dw4gy_APKD1OQOJHsQJ9arY4fsXuG9ZNwjgKD3Zv7v6_lyFAx6uVFOTFR1brEXHY2UL_HeyQ7ohXuxt3hzV1vEYx7XD0XjgmnGZpS7?key=jOQaYoaNITRy4hsSofPW4Q) ### **Running the Agent** To run your agent: 1. Navigate to the Control Center and open the agent you created and published earlier. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdMdfANOChOQN0BcUW8U1H28-X6MRqVJHy2RAq6jm0j7opxbzL-L-lRmy0RIaYUzHBMlvTLtKhNxoUnGgYMuQHfJId5veVvB1Jwi2Fklp-xWxXqVED0dAi9PWZ58tGhFfBceX-9?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdMdfANOChOQN0BcUW8U1H28-X6MRqVJHy2RAq6jm0j7opxbzL-L-lRmy0RIaYUzHBMlvTLtKhNxoUnGgYMuQHfJId5veVvB1Jwi2Fklp-xWxXqVED0dAi9PWZ58tGhFfBceX-9?key=jOQaYoaNITRy4hsSofPW4Q) 2. Now click on 'Run'. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcrv-mXyD_yMq2UR1hTMbjXYy3Dfv4hqCxxi2mYujLAQJ-FQyy_m5q548JfR9e2D6QZZvwn-di4oJnLDEtsMxltSO4NIhoowZxZPe3NTXsEtanv03_VQ2XJQ0AzC5K0IlPnlg8sEw?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcrv-mXyD_yMq2UR1hTMbjXYy3Dfv4hqCxxi2mYujLAQJ-FQyy_m5q548JfR9e2D6QZZvwn-di4oJnLDEtsMxltSO4NIhoowZxZPe3NTXsEtanv03_VQ2XJQ0AzC5K0IlPnlg8sEw?key=jOQaYoaNITRy4hsSofPW4Q) 3. It will open the Run page where we can start the run by clicking on Run Now button. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXciDoodDak3fWCnV5w3fGLZspeuXZbPY5wigW-Lt3li7jNFlfGvg7PoYkTqI7twQCDN6Ku3DKZ4LFoQk-G23pMlNiC_Fa5axY5W67sy-KH4SNGMx9faswzUT0MyA5nQ-uEzprM5UA?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXciDoodDak3fWCnV5w3fGLZspeuXZbPY5wigW-Lt3li7jNFlfGvg7PoYkTqI7twQCDN6Ku3DKZ4LFoQk-G23pMlNiC_Fa5axY5W67sy-KH4SNGMx9faswzUT0MyA5nQ-uEzprM5UA?key=jOQaYoaNITRy4hsSofPW4Q) 4. Choose the required Proxy and click on the Run Now button. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfByLJZ3vUNWvl8P_jm2qQFMxVnYves65VuC863ar6cHAr6eAn22bLHKKmlrTqu1iAEs4lz2skjf-JTvyZsUocJ7l_WHJbyHxZxrF6BqrzwZZZkHWTk_T7WXZ-Szgt9oIUE9hdVAw?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfByLJZ3vUNWvl8P_jm2qQFMxVnYves65VuC863ar6cHAr6eAn22bLHKKmlrTqu1iAEs4lz2skjf-JTvyZsUocJ7l_WHJbyHxZxrF6BqrzwZZZkHWTk_T7WXZ-Szgt9oIUE9hdVAw?key=jOQaYoaNITRy4hsSofPW4Q) 5. You will observe that the agent starts running. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXd6TSN5fXU3Lk8imKqiQU_G4ba4VdhSqYnjBJGeewz0rQo_rXzaJyxm7v8LX0gaNyntcSiv7OvUhMgdpOE351R5bvxAPajtsxM1n-nupZQKQHbLx3fjymUhVR06x8l8jrywSH2DZg?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXd6TSN5fXU3Lk8imKqiQU_G4ba4VdhSqYnjBJGeewz0rQo_rXzaJyxm7v8LX0gaNyntcSiv7OvUhMgdpOE351R5bvxAPajtsxM1n-nupZQKQHbLx3fjymUhVR06x8l8jrywSH2DZg?key=jOQaYoaNITRy4hsSofPW4Q) 6. After the agent gets completed, click on the option "View run details and files". ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXc8o3MISEJI1ajR4aPq8Ro8xXHzK1BwFcS-14DdezDz6rPLcjzhG0Iiwt35WgV4t77EFGSrDnAB0yRiVZ5GtOsLOrku_59tgTN0wsF8mvW64rDlhqaEs7A-lWW5VRBieAn_3JN5wA?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXc8o3MISEJI1ajR4aPq8Ro8xXHzK1BwFcS-14DdezDz6rPLcjzhG0Iiwt35WgV4t77EFGSrDnAB0yRiVZ5GtOsLOrku_59tgTN0wsF8mvW64rDlhqaEs7A-lWW5VRBieAn_3JN5wA?key=jOQaYoaNITRy4hsSofPW4Q) Here you will get the Export file and Log file and all the other details previously set by the user. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXecpYFCoYL5zlJb028K_V_6j6tlnCWQ1a59Ch29EAvX9tMUQ0ElyxCSy_n04jvSctOGY5Wr33jtwMcx5mo4E_GoueG03LkDMbG2F2MhxpkpSog7cCKUA0SSUnTNEWvl8Bx1xA94Ig?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXecpYFCoYL5zlJb028K_V_6j6tlnCWQ1a59Ch29EAvX9tMUQ0ElyxCSy_n04jvSctOGY5Wr33jtwMcx5mo4E_GoueG03LkDMbG2F2MhxpkpSog7cCKUA0SSUnTNEWvl8Bx1xA94Ig?key=jOQaYoaNITRy4hsSofPW4Q) ## **Conclusion** Congratulations! You have created, scheduled, and run your first online agent! Once you're comfortable creating an agent, you can continue reading the [Sequentum Cloud Manual](https://cloudsupport.sequentum.com/scm/) learn more about using Sequentum Cloud. You can also visit the[Cloud Training](https://cloudsupport.sequentum.com/ct/) site to practice additional techniques with the Sequentum Cloud Editor. --- language: "en" --- # Build An Advanced Agent The following diagram shows the key steps for building, maintaining, scheduling, and monitoring Sequentum Cloud agents . We provide links for other topics which will explain each of these steps in further detail. ## **Basic web data extraction agent creation process** ![image (1).png](https://cloudsupport.sequentum.com/__attachments/a_7c447298138e9fff07ce1090f0db101ddc127491b1af277cffe0ed91ed2cc617/image%20(1).png?cb=350113b4656bee3e2d0a8521de5a8dee) In this section, we will cover the identification of data elements on your target website and create your first Sequentum Cloud agent. We'll work through each of the above steps with examples that match common web data extraction usage, so you can get comfortable building agents on your own and at your own pace. ### **Choosing a Start URL** The Start URL is the place where you begin data collection and corresponds to the starting point of your web data extraction agent. In the following sections, we'll use the Cruise Direct website for our example. [http://www.cruisedirect.com](http://www.cruisedirect.com/) Note: In this example, we start from the Cruise Direct home page, however, if the data you require is not located on a website home page, you can start the agent from a website sub-page. This approach will make the agent more efficient, so it's worth taking the time to be more specific. 1. We start by pasting the start web page URL from the target website ( [http://www.cruisedirect.com](http://www.cruisedirect.com/)) into the **Sequentum Cloud Address Bar**. ![image-20250604-100201.png](https://cloudsupport.sequentum.com/__attachments/a_e615f77a990724263ce99eb17a2bfeddb09b72ce42d096ea83cba602ad8c8bf5/image-20250604-100201.png?cb=112b612056d6f32926c445bf8829d05d) Sequentum Cloud with Cruise Direct home page loaded In the next section, Select the Content to Capture, we will continue to use the Cruise Direct website data for our example. ### **Select the Content to Capture** In the previous section, we selected our **Start URL** and loaded the web page into the Sequentum Cloud web editor. Next, you can select the data you want to capture and start building your first web data extraction agent. In our Cruise Direct example, we plan to search for available cruise vacations and then extract details about each cruise. 1. First, we need to perform a search to retrieve the data for the available cruises. For this we will enter in a destination and the month of departure. Click once on the "**Select Destination** " on the web page, then click the "**Selection** " tab at the bottom of the screen. Then click the "**Select** " button to pop up the drop down selections. Select "**Bermuda** " and click on "**Add Command** ". **NOTE:** Hit Enter key to ensure you save the changes after adding command(s). ![image-20250604-100806.png](https://cloudsupport.sequentum.com/__attachments/a_03e7192b57bc6d871b5b3f6738ffad3d51e3768ca8e9da8fb9303a786be55e2a/image-20250604-100806.png?cb=887c0655d78a31fdde829869e855ed51) 2. **Rename** your command to something more intuitive, such as "**Destinations**," by clicking the command name, entering the new name, and pressing the Enter key. ![image-20250604-101229.png](https://cloudsupport.sequentum.com/__attachments/a_5ef14105f9cd8a1b840948ceb8dd3c25190a4c98714e918b39cc4aa0c2ad9873/image-20250604-101229.png?cb=638e0cef2fcd5a42b234667401434af9) 3. Now click on the "**Options** " button in the center to configure some additional settings for the "**Destinations**" command. ![image-20250604-101408.png](https://cloudsupport.sequentum.com/__attachments/a_0657b37fbadb65d51ae9a3d30458e57c7cc094791b6d5ca0d0c45b47e420693b/image-20250604-101408.png?cb=65a7c8e063c977aaae19d0fdc94af762) 4. Click on the tab called "**Browser** " and scroll down to the category called "**Dynamic browser settings**". ![image-20250604-101614.png](https://cloudsupport.sequentum.com/__attachments/a_d78af5e8892263b032631df87524ce76ee85a5c8824f9753cfe4f5921e58bb8d/image-20250604-101614.png?cb=d0c37541598c21d60ed6e712411b3664) From here, we'll change the wait settings to wait for async loaded content. You can find out about what each property performs in the text manual that appears in the right pane, but for now, just know that we need to make this change since there is new async content being loaded every time we make a change on the website. ![image-20250604-101819.png](https://cloudsupport.sequentum.com/__attachments/a_1e7cdd61ab92c96c51b382c23012294feddc6634234e6a02827fcca077ee4178/image-20250604-101819.png?cb=08433b6d6b41eb73384e4e6bcfc8fcb4) 5. After pressing save, click back on the "Browser" button in the center to go back to the interactive browser screen. ![image-20250604-102002.png](https://cloudsupport.sequentum.com/__attachments/a_e8203958f7b7590737146c8f7423d85d27523b68e11a26a4d2b8ac7e0473ebf6/image-20250604-102002.png?cb=cd47a98e4b7b6a7da6d905edfc5c82fa) 6. Next hover over the "Destinations" command, and press the play icon to execute the newly generated command. ![image-20250604-102202.png](https://cloudsupport.sequentum.com/__attachments/a_89a5a6447e364c8eed662ebd9f6c5fdcfa4a0d37854dd270737f0525cd643e94/image-20250604-102202.png?cb=d412a550e6803e42ece4c1cc78dd3e6b) 7. Next, apply the same steps to the "**Select Month** " form field. Choose the latest date, rename the command to "**Months** ," and press Enter to save the new name. Update the "**Options** " settings just as you did for the **Destinations** command. Finally, click the play to run the command. ![image-20250604-102738.png](https://cloudsupport.sequentum.com/__attachments/a_d8e973f023c66d6ff7c79f43deb4780fd5df9fb1b0ec3dc4d250d214c9d63b8d/image-20250604-102738.png?cb=f377029c8551f770a5cc06af162c71f3) **NOTE:** If you are having trouble scrolling down the page to click on the "**Select Month** " field, you might need to switch to **navigation mode** first to be able to click the scroll bar. To do this click on the globe icon at the top of the screen next to the Help menu. ![image-20250604-103205.png](https://cloudsupport.sequentum.com/__attachments/a_66fc8cb4d33248eec2b41e28d1d4b253a28c2ee2d07be8365fcb87bbefe1e476/image-20250604-103205.png?cb=788070dba83a173c39b59b7b5415e9f9) Once you have Turned on Navigation Mode, scroll down the page until you can see the Month selection, then click the Globe icon again to return to Off Navigation Mode. Now you can continue with your selection. 8. Next, initiate the search to retrieve cruise details by clicking the orange "Search" button. Then, in the "**Extracted Content** " tab below, select the "**Action** " button. Rename this command to "**Search**" and press Enter key to save it. ![image-20250604-103956.png](https://cloudsupport.sequentum.com/__attachments/a_e12ec6324fa2efb1d7ace56fba33d9743c3e55fbff986dfd4fd354bcf4541d84/image-20250604-103956.png?cb=0e658d1c61a5d3f683dbc05124295483) 9. While hovering over the "**Search**" command, you'll notice a play icon. Click on the play icon to manually execute the new search command. ![image-20250604-104130.png](https://cloudsupport.sequentum.com/__attachments/a_4ca5a265354375313b7550220202e83e5d74fa3530b9ef6cbe0abccdce09e58e/image-20250604-104130.png?cb=e82853b793657e2dc3ce8029b3e96eae) 10. We are now redirected to the result page with cruises that match the filters that we previously set. To select any information from this page, we simply need to point and click to select the information we want to extract. In the bottom, click away from the default "Extracted Content" tab to the "Selection" Tab. This "**Selection**" view allows us to select elements on the page even more easily than clicking on elements on the page. ![image-20250604-105802.png](/__attachments/a_3d2f41e7ac48c47afeb5bc4868907d663f1812727e21840e2d167682c987b50c/image-20250604-105802.png?cb=365e6b5a1f726084e6b93bdbdd79ab8c) 11. Using your mouse, try clicking the object on the page which has all of the cruise information. As you click, the object on the page is highlighted and surrounded by a bounding box. On a site like this, it can be tricky to click on the whole object you want since it is running off screen so another method which might be easier in this case is to select from the page elements behind the scenes. To view these, go to the "**Selection**" tab and select a div which contains all of the information that we want to extract (e.g. Cruise name, ratings, duration, description, prices, etc). In our case, this is the div with a class of "views-row". ![image-20250604-110623.png](/__attachments/a_f2546a79ff691b517798f25cdd2108e0966fecf80a42203a3d453f017f12840b/image-20250604-110623.png?cb=466bae75dbbfdeec206a373c733fb95b) 12. Once we have selected the \
, scroll down on the page, hold down the "Shift" key, and click on the same div in the second element. If you performed this step correctly, you will notice in the selection box that there are "5 Selected" elements. ![image-20241019-221023.png](/__attachments/a_7cf7d3ec0fdb18a65fdc25ec349631df56f252a1590907933ff44d660a9bef1f/image-20241019-221023.png?cb=0b0b61cfb9589fd20e523e379b281701) 13. Click on the "Extract" command and you will notice that a new "**Selection List** " command along with a "**Section** " command gets generated. Rename the command "**Name** " and click on the name of the cruise while the command is still in edit mode and press "**Save Selection**" in the bottom right corner to save the changes. ![image-20250604-111451.png](/__attachments/a_fe17c000abb8f9c2736bf2bce03556c9ef27d2919d45203fe8a8163348adbe28/image-20250604-111451.png?cb=358f3eefbfb215379fa343db57d5b202) 14. Next, we'll add additional commands to capture more relevant details. Click on the departure location and select it. In the Selection tab, click "**Extract** " to create the command, then rename it to "**Departure**." Remember to press Enter to save your changes. ![image-20250604-111606.png](/__attachments/a_c583e5ce4b457e4ce43e580fee6f6645c388a521033495ad47537a482c294148/image-20250604-111606.png?cb=d2829fb0f046fb237474286ce640f2d6) 15. After the departure command has been generated, click back to the "Extracted Content" tab in the bottom left corner. From here, we can highlight the text that we want to extract (e.g Miami, Port Canaveral, etc, and parse out the string "Departing From"). After highlighting the text, click on the "Extract selected" button to parse out the data. A regular expression automatically got generated and parsed out the string "Departing from". \[Note: Firefox browser not currently supported for this action.\] ![image-20250604-111716.png](https://cloudsupport.sequentum.com/__attachments/a_9f882624d59b601a54c1f3b1a6fd63bd920e7588c5c672c67e57a00e5ff3b1fc/image-20250604-111716.png?cb=42ccb866ad60c385658b123073ca106e) 16. Repeat the Select, Extract, Extract Selected steps above for the fields "Duration", "Ship", "Port of Call", and "Best For" ![image-20250604-111914.png](/__attachments/a_40a489b272e9341a7bb68eff579b2a7d7266bf523a263a83920bdc381abf02df/image-20250604-111914.png?cb=00dbda1ccf657e6b88ae1aecc22b6209) 17. Now we want to extract pricing information for each cruise. Since there are multiple dates with different prices, we will need to generate a list like we previously did with the list of cruises. Find a list item on the page with multiple rows of data, then click on the first object that contains a cruise date, hold down the shift key, and select the second page object that contains a cruise date. Now click on the "Extract" button and a new sub list gets generated underneath the earlier commands. Rename the "Section" command as " Date", and click on the departure date column and press "Save Selection". ![image-20250604-133640.png](/__attachments/a_dd46034b79348c8672794882a7c3bc2637fcfdb9a665c328df2b33b2deda84b5/image-20250604-133640.png?cb=b91875355c0e9404a7e3bc21c8e79be3) 18. Click on the other columns and capture the interior, ocean view, balcony, and suite prices. Use our previously taught method of generating an automatic regular expression to parse out the "USD" part of the prices. ![image-20250604-133438.png](/__attachments/a_2c9b1785710157db507160a519ae23eadbe7f84e299022f91d38f93d45acc143/image-20250604-133438.png?cb=3992ad2cb234baeb67a4b644ea50beba) 19. We will now try to extract some information from the "Bonus". Since they are links with text, if we click on the bonus you'll notice that there is no link being returned in the extracted content section. ![image-20250604-113246.png](/__attachments/a_8d37969fff45eba0352ab9abfd9b45cc93b1f7e62e40d627dbddd1d8b9a4de65/image-20250604-113246.png?cb=598515185481589c914aa66fad0aa47b) 20. To bypass this, we simply need to change what we are extracting from the column. On the "Extracted Content" tab, click on the dropdown list labelled "Text" to see what other types of attributes you can perform. Change the selection to "Styled HTML" to get a bit more information out of the links such as the name of the links or any other specific data that might be on the backend. ![image-20241019-224011.png](/__attachments/a_5af238fdf4022a57d45a26a0acb7ccadd7cf146b627063e11ae07ef08e35c87f/image-20241019-224011.png?cb=60a58b77162c5ef3aee1c6313025c379) 21. We have now extracted all of the fields we want to extract and are almost done with creating our first agent. 22. Next let's add some pagination. To do this, we first need to determine where to add the pagination command. In this case, we want to repeat everything after the "Section List" command since on every page there is new relevant information that needs to be extracted. In order to do this, click on the parent command of the "Section List" command in the agent explorer, which is the "Search" command. ![image-20250604-114318.png](/__attachments/a_ce09456d6db74c1a33b1d979381fdd980f4c827e6066f32c55899aee0d4bbe72/image-20250604-114318.png?cb=599649b656a1b20388ef5a9a6731e8e7) Positioning the selection to the "Search" command before adding pagination From New Command , click on the "Action" command on the navigation menu to expand a list of action commands. ![image-20250604-114502.png](/__attachments/a_c04c3a6a9478fc250ea94aea41a08eda8a33a7f0a15540aeba9479ec2c79d99d/image-20250604-114502.png?cb=33ae7125b1065e6f46d66dcfabaef0a9) Mouseover the commands that are in this section to display their names and click on the one labelled "Action Repeater" : ![image-20250604-114609.png](/__attachments/a_b4b58eeaf204f344245c13df82b8e0bdf638ba29244278544d01550431adbd12/image-20250604-114609.png?cb=5dede0e3a0f964c76f1da7da3b25d367) This creates the "Action Repeater" command". Rename this command to "Pagination" and scroll down the page and select where the pagination should be (in this case, the "Next" button at the bottom of the page) and press "Save Selection" ![image-20250604-115830.png](/__attachments/a_64eecf15af44eded9c4d28ab8280dabbc34ba7d6c9d54599adfa3bc5212f77e8/image-20250604-115830.png?cb=8be044e51b0de1cb7ffecfffcbc0756e) 23. Press the icon next to the pagination command to manually execute the command and if everything is done correctly, the pagination will work and you will see the second page. ![image-20250604-115855.png](/__attachments/a_5830fc9b21a79c506e8e62ab6000d4da5eb2b4ccbd60f417d1a856db81dbe316/image-20250604-115855.png?cb=c73fc7c4e3b89325126858ba4de1684e) 24. Now that we have confirmed that the pagination command works, we will need to move the command to the correct position. Drag the pagination up above the "Row Content List" command and just below the "Search" command and drop it there: ![image-20250604-115939.png](/__attachments/a_b2e094c5bb5ef3f56be852712d5c73941cb3a58b09a6fed5a6adf832ebd794d9/image-20250604-115939.png?cb=b934d48078c43c4424d6015f04719ff5) ![image-20250604-120028.png](/__attachments/a_4481aa99300081d3c052c2aab4524d3461dc04d4733f68cbe8b3bdf3cdcd6b94/image-20250604-120028.png?cb=160fcc4a6c42251e6d904f7afd7f3e6f) 25. Then drag the "Row Content List" command onto the pagination command so that the "Row Content List" command becomes nested beneath the pagination command. ![image-20250604-120212.png](/__attachments/a_d3ce3613bacfe4e4e89bbd4a49f626c9872adbf036f8b82a1e873fa3bc474106/image-20250604-120212.png?cb=4fa94eef8a683fd9dccf618f8e602ed7) 26. If done correctly, the your pagination command will look like the following image. ![image-20250604-120254.png](/__attachments/a_cdaeda5bf2ef5f7edc55ef17e27274189135278c41637a8b71ef1182b13fd7e5/image-20250604-120254.png?cb=8351cf236d51b0d416b36615c1a6ea59) 27. We will now use the Sequentum Cloud Visual debugger to debug our agent and see if there are any errors. First, let's Save this agent before we debug it. Press the "Save" button highlighted on top. Name the agent Cruisedirect and press Save with any comments (optional). ![image-20250604-120450.png](/__attachments/a_27163ceffcd6c890a46ae50d516ba7d4e657895dee88fcd032d16926f4c9f8a7/image-20250604-120450.png?cb=263c74c38427a7f3c3e42681434c0624) 28. Now let's debug our agent! Press the "Clear Storage" button present under the **"More"** icon . Next, click on the "Preview" button to start debugging. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdSkWwMUy-z4N2F0sjL2FLRBu1kGw1kxKwJISLQQVRQNXXvKzHbQ-4FT8kfH5I2u797FL5aBm6ePkz6ZNaBOVuM69A-fkMJIGu5FSUeUDzPmxZg5ZBVWxG_axIhEp_mVj77FahBpg?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdSkWwMUy-z4N2F0sjL2FLRBu1kGw1kxKwJISLQQVRQNXXvKzHbQ-4FT8kfH5I2u797FL5aBm6ePkz6ZNaBOVuM69A-fkMJIGu5FSUeUDzPmxZg5ZBVWxG_axIhEp_mVj77FahBpg?key=jOQaYoaNITRy4hsSofPW4Q) 29. Editor screen while debugging ![image-20250604-120559.png](/__attachments/a_a9b509486bb28ff7d35158eda39c2cbd1de2c4860fb72dc9d1aeb16b25d0bd9e/image-20250604-120559.png?cb=34a6a7dc78bb8120c8ecd153250e9d34) 30. Congratulations! You have built your first agent using Sequentum Cloud! Let's stop debugging now and move onto the next step of refining your data, formatting the output and eventually running your agent and delivering the data to your specific endpoint. ### **Data Validation** Creating an agent to extract data is only the first step in your ETL process! Now we will apply data validation in our agents in the form of validation rules/success criteria to ensure that the data we are extracting every run is actually useable data. We will now click on the "Export" command in the agent explorer to pull open the settings in the command. Sequentum Cloud by default exports in csv format. You can also export in JSON format by clicking on expanding the "Export" section on the left land side of the agent explorer and selecting JSON. ![image-20250604-120809.png](https://cloudsupport.sequentum.com/__attachments/a_451a63f22ae445ea5293d93ce92ba4049d522d25ef7117623ba6ac241830be8b/image-20250604-120809.png?cb=0af90d71a1411c2c2ef03cf5de6245b6) Data schema screen From this page, we're able to view all of the fields in our schema along with any default data type requirements, null values, format styles, format type, and time zones. Please feel free to make any changes that you feel applicable. Next, we'll move onto our success criteria definitions. Click on the main agent command in the agent explorer, and then click on success criteria. Success criteria defines a successful run based on a predetermined number of criteria which can be defined as a minimum number of page loads, minimum number of data count, minimum export count, and/or a maximum number of errors. These can also be a percentage of the previous run if a number between 0-100 is inserted in the allowed page load variation column. Configure any set of success criteria and we'll move onto the next section. ![image-20250604-120921.png](https://cloudsupport.sequentum.com/__attachments/a_91a8d226e0ab8818455d5076d3f9ffa025f85cc5f4f1cf5c9fbc91c8b7206840/image-20250604-120921.png?cb=0cae37ce30f67eb77504d1a44f4fd5e3) Success criteria screen ### **Data Delivery** Now that we've set up data validation to ensure that we're extracting high quality data, we will configure our data delivery target so that we can receive data at our endpoints to use for processing later. The default export format is csv format. Click on the "Export" icon on the left hand side of the agent explorer to expand the full list of export commands. ![image-20250604-121027.png](https://cloudsupport.sequentum.com/__attachments/a_c0891c53df8dbefd5b606a938d5b283e945af3ecb9461ebec27d130777498e5a/image-20250604-121027.png?cb=c9d3cb173d6c85ba2607463aed46726d) Full list of export commands This list consist of csv, excel, parquet, json, s3, google sheets, google drive, ftp/sftp, snowflake, and export script as of version 1.19. In this example, we will export a csv file to an internal s3 bucket. S3 export needs to be configured from the main Sequentum Cloud and then used in agent. Click back to the control centre, in the bottom left corner, click on "Organization", then the "Destinations" tab, and click on "New Destination" ![image-20241018-185426.png](https://cloudsupport.sequentum.com/__attachments/a_85d8414e420ef3552ee5cbecfef87529866a0f3f887c0e535c3b670b305d78d6/image-20241018-185426.png?cb=a1fb2909be522ffc3835dc5c112d3c3e) Destinations Screen Enter in a destination name and description for the new destination. For destination type, keep as the default S3 bucket. Now enter in the bucket name and folder path in which you want to deliver the data. A policy will be generated for you which looks something like the screenshot below. ![image-20241018-195150.png](https://cloudsupport.sequentum.com/__attachments/a_6964865b6727710ff9b4a7587869b13c06e2d4b849148d9b860128289c7afc48/image-20241018-195150.png?cb=42a1b875b5ee9074590f74d15c283bbd) Configuring our bucket name and folder Scroll down on the page and let's fill out the Role ARN ![image-20241018-195241.png](https://cloudsupport.sequentum.com/__attachments/a_6bd6100cf8f901a93be7d69ec4b54d84f19e8fcda9ae82baff91145e3452faf7/image-20241018-195241.png?cb=73b946326a52e36f0da1135f15162710) Configuring our ARN Copy these policies and trust relationship policies to your external IAM role and press test connection to upload a test file to your S3 bucket. After this is finished, we can head back over to our agent, click a S3 export, and change the destination name to our newly created destination. ![image-20250604-121540.png](https://cloudsupport.sequentum.com/__attachments/a_3e323a5cf967c2ada1fae299e8ecd704391e93cbfa9524a7672ea24989238724/image-20250604-121540.png?cb=6a2406c046c2b083ab3c1fc53a9284e5) ### **Running, Scheduling, and Monitoring Your Agent** Once we are fully done configuring our export targets, we can start to run, schedule, and monitor our agent through the Sequentum Cloud Control Centre. Head back over to the control centre by clicking on the Control Centre icon in the top right corner. Once there, click on our personal directory (if that's where you saved your agent), and from that dashboard, you'll be able to view the status of all of your agents. ![image-20241016-195930.png](https://cloudsupport.sequentum.com/__attachments/a_10afe6c91491992e193f1aac472c02d22647e75c7a6d242bf64f6d814727c916/image-20241016-195930.png?cb=eaeec623f97412adfeefb5013f22f72e) Personal Dashboard The name, versions, updated date, activity date, and status of our runs can be viewed for all agents directly on this page. When we want to edit our agent, simply click on the agent name, and we'll be redirected to the runs page where we can click on "Edit Agent" in the right corner. ![image-20250604-122229.png](https://cloudsupport.sequentum.com/__attachments/a_1efee660e5f2d6aebc98e5ccc1470578bffb966c5cc3b914e89f9bf2176055a2/image-20250604-122229.png?cb=2f17c15f510f1393903a28e1e83bf3e2) Note that while the agent is running, you can see the same visual playback you saw when you pressed "Play" to test your agent. Click the "View Live Information" button: ![image-20241019-232047.png](https://cloudsupport.sequentum.com/__attachments/a_f7316c2e192610433b0ddbcbd0634bc1fa85c7513e18817550ff2059c8f9cb7a/image-20241019-232047.png?cb=ca5da658cfc04d77e7d2e7af85b92e0b) And this will show you the agent run in progress: ![image-20250604-123001.png](https://cloudsupport.sequentum.com/__attachments/a_3d7a1534a5f867c99b67c9bcf52741b00ff23f7ec0c9a1a258c1d8754ac52274/image-20250604-123001.png?cb=b1abdd81a31225acac25efa89f420efd) Toggle the Visual icon and Log icon back and forth to see the logs or visual playback in each instance. This can be viewed for as many sessions as you have running in parallel. ![image-20250604-123809.png](https://cloudsupport.sequentum.com/__attachments/a_261d1ba0003ee14dc9974147dff9ba1c839974bbcbb08c61fcec80729f4b1338/image-20250604-123809.png?cb=2619595224a98bedf5aab4ef6cd7097d) From this runs page, we're also able to click on the "Info" tab to add descriptions, documentation, icons, and view the schema of the run. ![image-20250604-123959.png](https://cloudsupport.sequentum.com/__attachments/a_b50d20aaacfe9c5edbb251dc2fbb383de82b67d80d09c3287945be31e6442051/image-20250604-123959.png?cb=500752b3edec1e1f844c4aa7fcbfe122) We can also click on the "Run History" tab to view all of our previous runs (\*Note that the "Runs" tab only shows the status of the latest run, and all previous runs before that are located in the "Run History" tab). ![image-20250604-124038.png](https://cloudsupport.sequentum.com/__attachments/a_dc10a9410006e69c081fdfc0d405bcbd651629b4143b5a4192681f9d9fb657d6/image-20250604-124038.png?cb=52cccc3961f09f2df29e428012a5fec2) The run history page also provides detailed info on the status of the run in terms of actions performed, data points extracted, errors (includes page load errors and also errors from data validation), pages loaded, dynamic pages loaded, rate of request, number of requests, and also traffic. From here, we'll now schedule our agent to run on a daily basis! Click on the "Schedule" icon on the right. ![image-20250604-124445.png](https://cloudsupport.sequentum.com/__attachments/a_9866ac5e121ba11a664a4782e7c53382025ce61b896885fb8a0ff83eacb2fee0/image-20250604-124445.png?cb=f75b8299cf71fcda0cdeaea80c32bb35) Setup run screen From here, we can set up a set of proxies to use for the run. ![image-20250604-124743.png](https://cloudsupport.sequentum.com/__attachments/a_92fb0fe1d8b2a1f725b37ecf7d4aa6eda002fb033fd28836c3cc06bbb660e46c/image-20250604-124743.png?cb=630263f15cc8199bd172eefd3dc3ad5d) From here, we're able to change the start date \& time, along with any specific schedule type (run once, run every day, or a custom CRON expression). Press the "Save Schedule" button when you are done setting up your schedule. You have now set up your first schedule and will be redirected to the "Schedules" tab where you can monitor your schedules. ![image-20250604-125233.png](https://cloudsupport.sequentum.com/__attachments/a_b02ad65ad67b4b6f161f192b287c507d751f3f8438778587d268d4ee7e328fdb/image-20250604-125233.png?cb=d0fabbb6eba8de2d27f02e2caa7d9431) You can also press the "Run" button if you simply want to run the agent once instead of setting up a schedule. ![image-20250604-125423.png](https://cloudsupport.sequentum.com/__attachments/a_b10a8932ab8ebd1f68e401c539708a25e51088ce8a5d12dfa53c139428b9789d/image-20250604-125423.png?cb=61c01a9151a544bdcfee70cf02daf61a) Congratulations, you have fully completed your first agent! In this guide, we learned how to build our first agent, setup our data validation schemas to ensure we're extracting high quality data, configured our export target configuration so that we're receiving data in our s3 bucket, and finally scheduled our agent to run on a daily basis! If you have any additional questions, please reach out to us at [support@sequentum.com](mailto:support@sequentum.com) --- language: "en" --- # Build Your First Agent In this section, we will walk you through the steps to create an agent in Sequentum Cloud to extract data from a [books](https://books.toscrape.com/) website, run the agent, and review the exported data. ## **Choosing a Start URL** Start by login to [Sequentum Cloud](https://dashboard.sequentum.com/login) and selecting **New Agent** to open the Agent Editor. The Start URL is the place where you begin data collection and corresponds to the starting point of your web data extraction agent. In the following sections, we will use the Book Site website for our example. 1. We start by pasting the start web page URL from the target website ( ) into the **Sequentum Cloud Address Bar** . ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfnhvq33E6xSOc-76W6SKjYhG_wTsroTl3ySytxX1H5ZveLiVGNw8ZZphNpWuTBqtM1T1hwflND2W6j5chBHSD8qfRce7wKCZXk4dlV3mLl3pw5C5rgxKTe7pPSqsE77D5-TgyIGA?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfnhvq33E6xSOc-76W6SKjYhG_wTsroTl3ySytxX1H5ZveLiVGNw8ZZphNpWuTBqtM1T1hwflND2W6j5chBHSD8qfRce7wKCZXk4dlV3mLl3pw5C5rgxKTe7pPSqsE77D5-TgyIGA?key=jOQaYoaNITRy4hsSofPW4Q) In the next section, Select the Content to Capture, we will continue to use the [Books to Scrape](https://books.toscrape.com/) website data for our example. ### **Select the Content to Capture** After loading the Start URL into Sequentum Cloud, you can begin selecting the data you want to capture and building your agent. Move your mouse pointer over elements on the webpage in the Agent Editor to see items highlighted with a pinkish background color, indicating that they can be selected. (For a deeper dive, see the manual section on [Selection Techniques](https://cloudsupport.sequentum.com/scm/selection-techniques)) 1. To capture a list of items, such as all the books on the page, click on the first book to select it. Then, hold the **Shift** key and click on the next item in the list. This action will automatically select all the books that share the same XPath class, and you will see all the items highlighted on the page. Additionally, the count of selected elements will appear in the bottom left corner of the Editor window, confirming your selection as shown in the screenshot below. For more advanced techniques, refer to the manual section on [**Selection Techniques**](https://cloudsupport.sequentum.com/scm/selection-techniques). ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcT7ET2dLaa1fF9WK9KeG-Nu27qtmls6ytuTdJ-5Mh4zmvq_OAsRpYDqOa06qPpG6-b5e9tIbWaPOEjQ_FBXASCL43udXdzLeJg3s0dWvM5h46BdgBd2m4U9g6OzJMFT-7TPR55Vw?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcT7ET2dLaa1fF9WK9KeG-Nu27qtmls6ytuTdJ-5Mh4zmvq_OAsRpYDqOa06qPpG6-b5e9tIbWaPOEjQ_FBXASCL43udXdzLeJg3s0dWvM5h46BdgBd2m4U9g6OzJMFT-7TPR55Vw?key=jOQaYoaNITRy4hsSofPW4Q) 2. Once all the books are highlighted, look at the bottom frame as shown below and click on the **Extract** button. This will add a new **List** command along with **Content** command to capture the selected content. These commands will then appear in the **Agent Explorer** panel on the left side of the screen, allowing you to manage and review the extraction process. **NOTE:** Hit Enter key to ensure you save the changes after adding command(s). ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcGkGuRyN7FnQZelsccOGBErUv9EC0ayYhARSLhJFbInzMF3rmyFBZrycROK13Q-hjayCejWJJrhx71xPst4hgCn6XeEoT8Qc_5pyXAOHa4uVtvxGmWaY-CR9PqUy99IIjR_bEH?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcGkGuRyN7FnQZelsccOGBErUv9EC0ayYhARSLhJFbInzMF3rmyFBZrycROK13Q-hjayCejWJJrhx71xPst4hgCn6XeEoT8Qc_5pyXAOHa4uVtvxGmWaY-CR9PqUy99IIjR_bEH?key=jOQaYoaNITRy4hsSofPW4Q) 3. We can now assign meaningful names to the List and Extract commands. In this example, rename "**List Text List** " to "**Books** " and "**List Text** " to "**Title** " to better represent the captured data. Remember to press Enter key to save your changes. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcaNEolnelBD763y4iJrbj3gFyObaMjdxQ3L4sf7A5itKBQW2LFZcgzhUIRxhJL3WtEQ0bIwHXVUsbXVCFnHNhtNHJwcSByknipq7m2wD1GkqqXPNLUMZW0o0VADGy8ZmkXOhSeYA?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcaNEolnelBD763y4iJrbj3gFyObaMjdxQ3L4sf7A5itKBQW2LFZcgzhUIRxhJL3WtEQ0bIwHXVUsbXVCFnHNhtNHJwcSByknipq7m2wD1GkqqXPNLUMZW0o0VADGy8ZmkXOhSeYA?key=jOQaYoaNITRy4hsSofPW4Q) 4. Moving forward with the extraction process, we will now capture the price. Simply click on the price text and then click on the **Extract** button. You will notice that the extracted price is displayed along with the selection count. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXc5e6jyept_w2FwK4sPZJJY88y1R1up451rRmncK2CT9dXqVxv78eLCAzFNEqu14VZPmoG_xrnzBOhYVUhYLPq0EGWJjPjLGKC0Gnge4ysyBK4JfTDR2cLYE0KCQoGQqU-NCeEX?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXc5e6jyept_w2FwK4sPZJJY88y1R1up451rRmncK2CT9dXqVxv78eLCAzFNEqu14VZPmoG_xrnzBOhYVUhYLPq0EGWJjPjLGKC0Gnge4ysyBK4JfTDR2cLYE0KCQoGQqU-NCeEX?key=jOQaYoaNITRy4hsSofPW4Q) 5. Clicking the **Extract** button will add a new Extract command to the Agent Explorer panel. Rename this command to "**Price** " for better clarity and press Enter key to save the change. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdsuiVzDqVu2WWyhxEDNA8TTrQzdXSyCBbfB2pjKh01tfLPoGCuKFIBnz89Vcr82vLah3xMncPpy-lxVASTrarpSNEa7nh5ybYkS2_SdfAzm3gaUgwizl1lK9sMDC_WcZeKeRvz?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdsuiVzDqVu2WWyhxEDNA8TTrQzdXSyCBbfB2pjKh01tfLPoGCuKFIBnz89Vcr82vLah3xMncPpy-lxVASTrarpSNEa7nh5ybYkS2_SdfAzm3gaUgwizl1lK9sMDC_WcZeKeRvz?key=jOQaYoaNITRy4hsSofPW4Q) 6. Here we see that the **Price** text contains the currency symbol, which we can exclude using a Regular Expression. To apply this transformation, first select only the price text and click on **Extract Selected** , then click on **Save** **Selection** to confirm the selection. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXeazA-8719nmMJIb7REnxEq1ZYzdEoV5et2Qt8JB7otBgR522MKyQg9Y2K_QJf6VpP7IPrevogPW3jcPh6vMgEaefhe8bi_M6gUWQm489wqk9CG_9gMt1GwR-6pSvGeCuwM_YnwWA?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeazA-8719nmMJIb7REnxEq1ZYzdEoV5et2Qt8JB7otBgR522MKyQg9Y2K_QJf6VpP7IPrevogPW3jcPh6vMgEaefhe8bi_M6gUWQm489wqk9CG_9gMt1GwR-6pSvGeCuwM_YnwWA?key=jOQaYoaNITRy4hsSofPW4Q) 7. Next, we will extract the **Stock** information. Simply click on the stock value to select all the listed elements, then click on the **Extract** button. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdeeJ4L8ZlYlXX3sIBLKugp0_auANEvx8pGY5SMHEkmnUW4TUNHZYIp2HsAavv2WbOk5eMBbaZZg2Ql8F8dV5S6duXQs0Q80nJqPmWNaIuSb3KnDpGctKBa_YeIcUoqYWDXfaCZpA?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdeeJ4L8ZlYlXX3sIBLKugp0_auANEvx8pGY5SMHEkmnUW4TUNHZYIp2HsAavv2WbOk5eMBbaZZg2Ql8F8dV5S6duXQs0Q80nJqPmWNaIuSb3KnDpGctKBa_YeIcUoqYWDXfaCZpA?key=jOQaYoaNITRy4hsSofPW4Q) 8. After the Extract command for **Stock**is added, rename it to "Stock" and press Enter key to save the change. Sample values for the selected elements will also be displayed. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdXB1PQy1-JkFuxD8SwDVP5SYOIbnExpKfDEC-d3g00dGPdFD3NVoFPj7GyYiIcHDaxkhaLZpjc-o9uJdlOymXW0LZ_nXd5XWo7bIJP9p2d3LAf8lPw_Pj8okmMEvEA_V4qOocd?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdXB1PQy1-JkFuxD8SwDVP5SYOIbnExpKfDEC-d3g00dGPdFD3NVoFPj7GyYiIcHDaxkhaLZpjc-o9uJdlOymXW0LZ_nXd5XWo7bIJP9p2d3LAf8lPw_Pj8okmMEvEA_V4qOocd?key=jOQaYoaNITRy4hsSofPW4Q) 9. To extract the **Image URL** , repeat the steps from step 8: click on the image to select it, then choose **Extract** . After extraction, rename the command to "Image URL" and press Enter key to save the change. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfBeCmuIHDwi7lgbldsorTR3sUFEEpLj7tSes92B33L43R3TsHq6D9iT8WNrH09XxldSalukYSQihyXWbPrhixwGAC61LsSn-PLchy2ym070_u_wvf7TqkMNg3ZDZobNxyBmdA8QA?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfBeCmuIHDwi7lgbldsorTR3sUFEEpLj7tSes92B33L43R3TsHq6D9iT8WNrH09XxldSalukYSQihyXWbPrhixwGAC61LsSn-PLchy2ym070_u_wvf7TqkMNg3ZDZobNxyBmdA8QA?key=jOQaYoaNITRy4hsSofPW4Q) 10. Now, to add **pagination** for extracting the next pages, scroll down to the **next** page button, click on it, and then click on the **Pagination** command. Finally, click on the **Save** **Selection** option to save the pagination settings. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdGyUGsO-ht3A2vUi3E_xPCIObnCbTcyX8a3z5xnAZvV_n2_yvjyb30qcBQiW70l38J81x-v7qCYTFQxUdE8H5ogXyK9afHACc1F-0WaebD1Jtp2xQMPFe_d9XWQS5MBeUUW0NydQ?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdGyUGsO-ht3A2vUi3E_xPCIObnCbTcyX8a3z5xnAZvV_n2_yvjyb30qcBQiW70l38J81x-v7qCYTFQxUdE8H5ogXyK9afHACc1F-0WaebD1Jtp2xQMPFe_d9XWQS5MBeUUW0NydQ?key=jOQaYoaNITRy4hsSofPW4Q) 11. The **Pagination** command is now added above the **Books List** in the Agent Editor. This ensures that the agent will follow the pagination and continue extracting data from the next pages. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXeMozeifWqVxwi6gSJsIoOAkEmM550Wp0FRmRli9KY5IR3MU1h5Lyx52ziv6HNpYMHnZ05KjOTiWzrP_X6B26aDKHhv9HmUByhjwB-gnyM6k80I7HfnodnTRuHbMO15mpFxlAJa8Q?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeMozeifWqVxwi6gSJsIoOAkEmM550Wp0FRmRli9KY5IR3MU1h5Lyx52ziv6HNpYMHnZ05KjOTiWzrP_X6B26aDKHhv9HmUByhjwB-gnyM6k80I7HfnodnTRuHbMO15mpFxlAJa8Q?key=jOQaYoaNITRy4hsSofPW4Q) 12. We have captured all the required fields. Now, to ensure that the agent is capturing the data correctly, click on the **Preview** button to start the agent's execution and verify the extracted data ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXeeOXfL-ejc-Kw-3by8kU6AC4D5O3At2CGqUXwQ-CIDRNqw6ga8mssDxtdCdZv27m3SRZaA3TnphwAxa_WBCMbAnf36o09RHhN4K7_OzIoN369qu7Cb_vyScbTnSo5Kl9CeW-3L?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeeOXfL-ejc-Kw-3by8kU6AC4D5O3At2CGqUXwQ-CIDRNqw6ga8mssDxtdCdZv27m3SRZaA3TnphwAxa_WBCMbAnf36o09RHhN4K7_OzIoN369qu7Cb_vyScbTnSo5Kl9CeW-3L?key=jOQaYoaNITRy4hsSofPW4Q) 13. During the agent's Play, you can control the speed according to your preference. The logs are visible at the bottom, providing real-time information on the agent's actions. You can click the **Stop** button, to stop the play execution. ![image-20250110-084614.png](/__attachments/a_2ff9fa588315d0ad9a21d5234be907c2ae8fa23e27852d1d1d241dd7d53134e1/image-20250110-084614.png?cb=28755f3968591f56817045e901d86a9c) 14. Once the Play stops, you can view the extracted data at the bottom under the **Data** section. This will display the results from the agent's play, allowing you to verify that the data was captured correctly. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfpJ86imuDo6mcuSW7x5rr07awiNsSOZOylrzPCwEuCMOxCDjyCzY8P3_6AS9qE3PyCTdsOWb4tBZbqjAm_qAxdPneGDPb_TqG-w7XpK-kZJtJMlUlP5jg1uLXlTHVnts2GuUCP?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfpJ86imuDo6mcuSW7x5rr07awiNsSOZOylrzPCwEuCMOxCDjyCzY8P3_6AS9qE3PyCTdsOWb4tBZbqjAm_qAxdPneGDPb_TqG-w7XpK-kZJtJMlUlP5jg1uLXlTHVnts2GuUCP?key=jOQaYoaNITRy4hsSofPW4Q) 15. Now, we can set **Success Criteria** to ensure that if the agent extracts fewer records than the specified minimum count, the agent will fail. After configuring this, we can **publish the agent** and execute a full run. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdWthx8X7b-YvT4ND5SPU7R9uIJDRiSYhzAmgB1drNksknYD82xNyjJQ4O57JT1TrokJxY5oEveCgM8UpUg2EU04P1n76LPlj8RBcCdmnCHj6PXgeqTLQ8DooTtg2l2srye4Zh2?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdWthx8X7b-YvT4ND5SPU7R9uIJDRiSYhzAmgB1drNksknYD82xNyjJQ4O57JT1TrokJxY5oEveCgM8UpUg2EU04P1n76LPlj8RBcCdmnCHj6PXgeqTLQ8DooTtg2l2srye4Zh2?key=jOQaYoaNITRy4hsSofPW4Q) 16. Click on the **Save** button in the right side panel and provide a name for your agent. After entering the name, click on the **Save** button in the popup to finalize the process. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXe4VJEe0vMZwVPilgWxATR3Jd7uQvmpaJkb6rd4cELszT8t-5AWRHaCD3uJQPWpcGRDgpwPKaXXWi3ykntFZIHwpsgw3H6ZdR1v7dOmeeq9AOYRwLwXUf60-OG1ohxsWkAEl1Lc8Q?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXe4VJEe0vMZwVPilgWxATR3Jd7uQvmpaJkb6rd4cELszT8t-5AWRHaCD3uJQPWpcGRDgpwPKaXXWi3ykntFZIHwpsgw3H6ZdR1v7dOmeeq9AOYRwLwXUf60-OG1ohxsWkAEl1Lc8Q?key=jOQaYoaNITRy4hsSofPW4Q) 17. Click on **Control Center** , where you can start a run for the agent. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfxWNrX1jtlxAJ5rTxrP-HrPGabUCOne8QRPegfNlx--KZ-4ydr1TkJwRnTQsXWFTlkVPnTa5mAz7K2bbhLQWgoLH2fS5gpTWsdp3oenVJB9yHFjMhcRlXKs_SCRc4D0ZrC5E_E?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfxWNrX1jtlxAJ5rTxrP-HrPGabUCOne8QRPegfNlx--KZ-4ydr1TkJwRnTQsXWFTlkVPnTa5mAz7K2bbhLQWgoLH2fS5gpTWsdp3oenVJB9yHFjMhcRlXKs_SCRc4D0ZrC5E_E?key=jOQaYoaNITRy4hsSofPW4Q) 18. Click on the **Sequentum** icon dropdown menu and select the **Exit to Dashboard**  option. From the dashboard, you can start a run for the agent. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfZMcjgyOcV9P0C_Vd8df0pckCKPbgRmvaz__eq955CO6dQankzxVl-kryu6tjpCcZ2IgPMBU5lt_I4j-Yyuot1FCqmKOgdUdOrD0lgUWkcKzrOz5nzZSU-s1bRSPC97HEuw-_BiA?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfZMcjgyOcV9P0C_Vd8df0pckCKPbgRmvaz__eq955CO6dQankzxVl-kryu6tjpCcZ2IgPMBU5lt_I4j-Yyuot1FCqmKOgdUdOrD0lgUWkcKzrOz5nzZSU-s1bRSPC97HEuw-_BiA?key=jOQaYoaNITRy4hsSofPW4Q) 19. Click on **Run** to configure the parameters for running the agent. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXciLcdRijC5hmhiDYSxr_aKy_3F5pDJiFsxrm7dGptrt3-d5b1C2_KhP3p_40sWU4XO4KFN7mKisXPiNwXCERM_1m5vl0DAce4WGhIgr9_aR7nFXWelk4yd0dTPW56DaEs-q-8bQg?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXciLcdRijC5hmhiDYSxr_aKy_3F5pDJiFsxrm7dGptrt3-d5b1C2_KhP3p_40sWU4XO4KFN7mKisXPiNwXCERM_1m5vl0DAce4WGhIgr9_aR7nFXWelk4yd0dTPW56DaEs-q-8bQg?key=jOQaYoaNITRy4hsSofPW4Q) 20. Click on **Run Now** to trigger the agent run immediately. This will start the extraction process based on the configured settings and parameters. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfwB2M3FoewU6keka42jcUMa2CoP-69ID-YhSreb-JNzktx1-J9s6qfxwHaw3UR8uRP5iHgid19RlYWgJD09yU60Zurdj28AzYhTrixyNTh0Rq3Wve0JyIXtD7O6PRUqeWc0FZiXg?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfwB2M3FoewU6keka42jcUMa2CoP-69ID-YhSreb-JNzktx1-J9s6qfxwHaw3UR8uRP5iHgid19RlYWgJD09yU60Zurdj28AzYhTrixyNTh0Rq3Wve0JyIXtD7O6PRUqeWc0FZiXg?key=jOQaYoaNITRy4hsSofPW4Q) 21. Once the run is completed, click on the **Square icon** on the right side to view the output file. This will allow you to access the data extracted by the agent during the run. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdWd1y3PzCd2Xno5X-kyCD4C-Jyu0ztLF3C6m6h83rJ0LSZZjc4GFGLEliUWtgCZLXpMX8Xv8yYI086jAMKxI8q2Q6719gIyOAabxQRsg64GxHUDrfsQ0JImRMPVS-FUtOUrscTfQ?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdWd1y3PzCd2Xno5X-kyCD4C-Jyu0ztLF3C6m6h83rJ0LSZZjc4GFGLEliUWtgCZLXpMX8Xv8yYI086jAMKxI8q2Q6719gIyOAabxQRsg64GxHUDrfsQ0JImRMPVS-FUtOUrscTfQ?key=jOQaYoaNITRy4hsSofPW4Q) 22. Click on the CSV file link to view the data in a new browser window, or you can click on the **Download icon** to download the file to your local machine for further use. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXc_B_Ta1-ei-3VtV_AxNp_zAhLlzPNrz2CGAVA0O6m7WTc-ABhmOVpNH2EVNTZBm2ssHIi9APZ1C7Yl3MCu73_YV9G1lO9LlWpOXQ-E9VdT_R0ScTDSbIStT-4fRVKjHhk2rLQaLg?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXc_B_Ta1-ei-3VtV_AxNp_zAhLlzPNrz2CGAVA0O6m7WTc-ABhmOVpNH2EVNTZBm2ssHIi9APZ1C7Yl3MCu73_YV9G1lO9LlWpOXQ-E9VdT_R0ScTDSbIStT-4fRVKjHhk2rLQaLg?key=jOQaYoaNITRy4hsSofPW4Q) 23. Here, we can see the output results of the agent run, displaying the extracted data as expected. This confirms that the agent has executed correctly and successfully captured the necessary information. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXd2BYnao9iVdzVo20WxRsvewouxgwuktt53KVkncPEDAhg5R5WkEz33cdwLakIXfk9WiDxMNFH1xB9scOM-xMAtIzfBM4AycNhiQGtgHW4SGZ_uujs1HnEX5Aesnzn6qolyBbWfGw?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXd2BYnao9iVdzVo20WxRsvewouxgwuktt53KVkncPEDAhg5R5WkEz33cdwLakIXfk9WiDxMNFH1xB9scOM-xMAtIzfBM4AycNhiQGtgHW4SGZ_uujs1HnEX5Aesnzn6qolyBbWfGw?key=jOQaYoaNITRy4hsSofPW4Q) Congratulations, you have fully completed your first agent! In this guide, we learned how to build our first agent, setup a run. If you have any additional questions, please reach out to us at [support@sequentum.com](mailto:support@sequentum.com) --- language: "en" --- # Captcha Handling with Sequentum Cloud Sequentum Cloud provides an excellent feature for bypassing CAPTCHAs encountered during web scraping, making it a highly effective solution for overcoming common website blocking issues. CAPTCHAs are often implemented by websites to prevent automated scraping activities, posing a significant challenge for data extraction processes. However, with Sequentum Cloud, these challenges are efficiently addressed. ## **Key Features of Sequentum Cloud's CAPTCHA Bypassing:** 1. **Automated CAPTCHA Handling**: Sequentum Cloud integrates advanced techniques for automatically recognizing and resolving CAPTCHAs, ensuring uninterrupted data extraction. 2. **Seamless Integration**: The CAPTCHA bypass functionality is seamlessly embedded into the scraping workflows, allowing users to extract data without manual intervention. 3. **Support for Various CAPTCHA Types**: Whether it's image-based, text-based, modern reCAPTCHA v2/v3 challenges, slider captcha, press and hold captcha and many more, Sequentum Cloud is designed to tackle different CAPTCHA formats with ease. 4. **High Success Rate**: Sequentum Cloud consistently provides a high success rate in resolving CAPTCHAs, ensuring that even heavily protected websites can be scraped effectively. 5. **Time Efficiency**: By automating the CAPTCHA bypass process, Sequentum Cloud significantly reduces the time and effort required for manual CAPTCHA solving, improving the efficiency of web scraping projects. 6. **Scalability**: The platform's CAPTCHA-handling capabilities make it scalable for larger projects, where multiple CAPTCHAs may need to be resolved simultaneously. Sequentum Cloud's CAPTCHA bypassing functionality sets it apart as a robust solution for data extraction in today's environment, where websites increasingly implement complex security measures to prevent automated access. With its advanced CAPTCHA resolution techniques, it ensures reliable, uninterrupted access to valuable data. In addition to its CAPTCHA-bypassing capabilities, Sequentum Cloud also offers a wide range of other powerful features tailored to advanced web scraping needs. These include sophisticated data extraction workflows, support for large-scale operations, and customizable automation tools, making it a comprehensive solution for web scraping. Whether dealing with e-commerce websites, news portals, or data-rich platforms, Sequentum Cloud ensures seamless data extraction with minimal disruptions. Moreover, Sequentum Cloud's intuitive interface and user-friendly design make it accessible for both technical and non-technical users. The platform offers robust documentation and support to help users make the most out of its CAPTCHA-solving and scraping functionalities. By addressing both technical challenges and usability, Sequentum Cloud stands out as a leading tool for overcoming web scraping roadblocks efficiently and reliably. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXc2lXp0irS-NBQw_7rwlWMp-RoUPATC5gr0QXHYwXuFR5lv1boLsnMWBcl3aqoBCki3cwA8Hrq-6cKk1yYy5xbkaLd9ZUBybi4LzPVIPimNPB80ci8AuAD53dQn1K6RPB1b5NJM16P5R-0cxBLooNunaJRN?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXc2lXp0irS-NBQw_7rwlWMp-RoUPATC5gr0QXHYwXuFR5lv1boLsnMWBcl3aqoBCki3cwA8Hrq-6cKk1yYy5xbkaLd9ZUBybi4LzPVIPimNPB80ci8AuAD53dQn1K6RPB1b5NJM16P5R-0cxBLooNunaJRN?key=w6pMrdQ7HlvkdgQoN04a4w) Sequentum Cloud provides robust support for CAPTCHA handling through the **"Convert Command"** feature, which is integrated into the Sequentum Cloud Editor. This powerful tool offers multiple ways to handle various CAPTCHA challenges that websites implement to block automated bots during scraping. The Convert Command simplifies the process of resolving CAPTCHAs by allowing users to configure settings and pass appropriate arguments for CAPTCHA resolution, ensuring smooth data extraction even from sites with complex security measures. ### **Types of CAPTCHA Handled by the Convert Command:** 1. **Image to Text**: Converts image-based CAPTCHAs into text, making them easy to process and resolve. 2. **Voice to Text**: Handles audio-based CAPTCHAs by converting voice inputs into text. 3. **Google reCAPTCHA V2**: Handles Google's commonly used CAPTCHA system, solving challenges presented by V2 implementations. 4. **Google reCAPTCHA Invisible V2**: Designed to handle invisible CAPTCHAs, which operate in the background without user input. 5. **Google reCAPTCHA Enterprise V2**: Provides support for enterprise-level Google reCAPTCHA V2 challenges. 6. **Google reCAPTCHA V3**: Supports the more sophisticated V3 version of Google reCAPTCHA, which monitors user behavior for CAPTCHA resolution. 7. **Google reCAPTCHA Enterprise V3**: Extends support to Google's enterprise-grade version of V3 CAPTCHAs. 8. **H Captcha**: A security CAPTCHA widely used to block bots on websites, supported seamlessly by the Convert Command. 9. **Cloudflare Turnstile**: A CAPTCHA system used by Cloudflare to secure websites, efficiently handled by the platform. 10. **Geetest Captcha V3**: A Chinese CAPTCHA system that poses various challenges, including drag-and-drop puzzles. 11. **Geetest Captcha V4**: The latest version of Geetest Captcha is also supported, ensuring wide compatibility with evolving CAPTCHA systems. As shown in the screenshot, users can select the CAPTCHA type within the **Converter Settings \> Converter** section of the Sequentum Cloud Editor. Additionally, in the **API Key** field, users can integrate third-party CAPTCHA solving services like **2Captcha** by entering their API key, which allows Sequentum Cloud to outsource CAPTCHA resolution when needed. This integration provides flexibility, ensuring a wide range of CAPTCHA types can be solved with minimal manual effort. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXddLG52ABMAwRuuRkus8vWizgu3IvEBAQW3Nu-LNO0-6Isz3IaYWuU7qBDm7kOMNEDPTTVQy0uDGLgx1mgU-189kvs9KJs98cZsuUuffxpM5B1Fn73gQ71xOekP4U7wrFTHhgB2Ww6bWISe_fc5RQVkAbtb?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXddLG52ABMAwRuuRkus8vWizgu3IvEBAQW3Nu-LNO0-6Isz3IaYWuU7qBDm7kOMNEDPTTVQy0uDGLgx1mgU-189kvs9KJs98cZsuUuffxpM5B1Fn73gQ71xOekP4U7wrFTHhgB2Ww6bWISe_fc5RQVkAbtb?key=w6pMrdQ7HlvkdgQoN04a4w) Furthermore, users can pass additional arguments such as **file names** or **commands** in the **Arguments** field to customize how the CAPTCHA is processed. This feature ensures users have precise control over how CAPTCHA challenges are handled, depending on the specific requirements of the website being scraped. For example, parameters can be used to reference files that contain CAPTCHA images or audio or to direct the Convert Command to execute a particular command for bypassing CAPTCHAs. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcX4bNocd1IccqnvfaPu9t91-LCd0OMM7DMQlcM0c-bMxXbdzYPzt9IpmK9tOq5gcURcSNXZx2pd9tY_AQTrK6JA-Z0Vzycph8IyENTTW47Y2E-y7SQdPRpmcuQVh0f5lW4KnthmfknNNT5JS_dkRuQvD9p?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcX4bNocd1IccqnvfaPu9t91-LCd0OMM7DMQlcM0c-bMxXbdzYPzt9IpmK9tOq5gcURcSNXZx2pd9tY_AQTrK6JA-Z0Vzycph8IyENTTW47Y2E-y7SQdPRpmcuQVh0f5lW4KnthmfknNNT5JS_dkRuQvD9p?key=w6pMrdQ7HlvkdgQoN04a4w) With this comprehensive CAPTCHA handling capability, Sequentum Cloud ensures that even the most complex CAPTCHA challenges are effectively managed, allowing web scraping projects to run smoothly and without interruptions. The flexibility of the Convert Command combined with third-party service integrations makes it a powerful tool for overcoming CAPTCHA roadblocks and achieving efficient as well as scalable data extraction. --- language: "en" --- # Tracking Changes An agent can keep track of the latest changes that have been made to extracted data. The agent will mark extracted data as deleted, updated or added. If data is deleted but later returned in a modified state, the data will be marked as "reappeared". An agent can also be configured to only export data that has changed since the last successful run or only export data that has changed since a specified number of days. Data will be marked as deleted if it was extracted last time the agent ran, but not during the current run. Data will only be marked as deleted if an agent completes successfully. This prevents data from being incorrectly marked as deleted if an agent fails halfway through a run. Default change tracking can be enabled on the Export container command which is available on the command menu in Sequentum Cloud. ![image-20260405-122544.png](https://cloudsupport.sequentum.com/__attachments/a_428cb2fb561174b34312156763b58ce6e9f7466454cadc6040a6f622a63f9976/image-20260405-122544.png?cb=90cd49828664f274899072899d942d3e) The following advanced change tracking options are available: |----------------------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | **Operation** | **Description** | | Enable change tracking | Enables or disables change tracking. | | Track deletes | Specifies if an agent should track deleted data. If an agent does not track deleted data, the last change status will not change for data that was not found in the last successful agent run. If an agent is tracking deleted data, the last change status will be set to Deleted for data that was not found in the last successful agent run. | | Export | **All Data -** Exports all data no matter if the data has changed or not. **Changed Data Only -** Exports all data that has changed since the last successful run. | | Unique data identification | Determines the object identifier used in the internal database. This value uniquely identifies the data row and will not change unless the internal database is recreated. The name of the data column where the object identifier is stored. | | Last Change | Exports the type of change that was last made to a data row. The name of the data column where the type of change is stored. The following are values that are possible in this column: **Added -** A data row has been added. **Updated -** A data row has been modified from its previous run. **Deleted -** A data row has been deleted. **Reappeared -** A data row that was once marked as deleted has been seen with some columns updated. | | Columns Effected | Exports a column that contains the names of columns affected by a change. The name of the data column where the columns affected value is stored. | | Change Date | Exports the date a data row was last changed. The name of the data column where the change date is stored. | | Insert Date | The name of the data column where the insert date is stored. Exports the date a data row was first inserted. This is the date the data was first extracted. | | Last Seen | A data row will be marked as deleted if it hasn't been seen in the past number of days specified. The default value of 0 will mark the data row as deleted if the data row is not found in the next run. | | Changed Last Run | The name of the data column to store the value indicating if a data row changed the last time an agent was run. Exports a value indicating if a data row changed last time the agent was run. | **Unique data identification** When an agent exports data, it compares extracted data with existing data to see if the data has been added, changed or deleted. In order to see if a data entry has changed, the agent needs to be able to uniquely identify a data entry. By default, an agent uses all the captured data to identify a data entry, but this means that every time any data changes, a data entry is always identified as a new data entry because it never matches any existing data entry. To get the change tracking working properly, the agent correctly identifies modified data entries and it's important to mark capture commands that extract data that uniquely identifies a data entry. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfRCJfNPDvXPTyQe_lMW_YmMEUyiDlUGZAh6tw5DZnqPhsODE3xdUB2S2S_tUNY9ifCB59Xdej6IcbsPha0d8nOcYrddXraRP0sPO0IuUWZncI5_BD9RWan9HU-gzWpUH_7bmb1qoUI_rveZYPaiH0rvMt8?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfRCJfNPDvXPTyQe_lMW_YmMEUyiDlUGZAh6tw5DZnqPhsODE3xdUB2S2S_tUNY9ifCB59Xdej6IcbsPha0d8nOcYrddXraRP0sPO0IuUWZncI5_BD9RWan9HU-gzWpUH_7bmb1qoUI_rveZYPaiH0rvMt8?key=w6pMrdQ7HlvkdgQoN04a4w) **Reset Change Tracking** In order to reset change tracking, a user gets the option in the 'Info' tab (refer attached snapshot) on the Agent Control Center. ![image-20260405-122656.png](https://cloudsupport.sequentum.com/__attachments/a_b156588ac3304d758507100e15e000668de9872fd52a146a9fac4467f48d8715/image-20260405-122656.png?cb=08b71339a77c3fa8c50cac56886336e6) --- language: "en" --- # Content Transformation Scripts A Content Transformation script can be used to change Content properties at runtime. It's only safe to modify agent Contents in Content Transformation scripts. It's not safe to modify sub-Contents in a Content Transformation script. You should only modify the current Content. **Content Transformation is available on the Extracted Content Tab.** ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfb2HlPFkLWi9ErGRoeezbkdkcOdYhbkjcU4PnP7j4-z71qGQSiW9FwlSdGWDVeoHDSVOY-ZNWoNrUL6nbsjOxc_UOBNs4Elb6ddTZV5c1RVrrmui5jOt8d273GNQKwuIhtV27rQY5LYNYH9JsYB3N7Owqg?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfb2HlPFkLWi9ErGRoeezbkdkcOdYhbkjcU4PnP7j4-z71qGQSiW9FwlSdGWDVeoHDSVOY-ZNWoNrUL6nbsjOxc_UOBNs4Elb6ddTZV5c1RVrrmui5jOt8d273GNQKwuIhtV27rQY5LYNYH9JsYB3N7Owqg?key=w6pMrdQ7HlvkdgQoN04a4w) **Content Transformation Provide Various Languages for Transformation.** ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXeb4sYRwB1uNppUlMlF-LKGaA3CLsgxH9mQpGSYjGblJ8RiGUXVxFPOfHAd2KgrVF-Ye-ftcHqgK7HE794o5rCIYeO4dyIM7QKqunhdDvsuiGN2dUHcGESj-kSG5_DMSYR9RPgO9pNuzlv545iG9-zGVRku?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeb4sYRwB1uNppUlMlF-LKGaA3CLsgxH9mQpGSYjGblJ8RiGUXVxFPOfHAd2KgrVF-Ye-ftcHqgK7HE794o5rCIYeO4dyIM7QKqunhdDvsuiGN2dUHcGESj-kSG5_DMSYR9RPgO9pNuzlv545iG9-zGVRku?key=w6pMrdQ7HlvkdgQoN04a4w) **Content Transformation also provides the option to open a Full-Size Editor Window for easy scripting.** ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcl9S7r8os6Svb9UYjNsZaq7452mL0OQVD2HPRWALQRMzjljjwkwsThAlNONVNMjagTiNXoACEmlnY5awS03sdHrJyFq9UAeHdKzxWRHDfuAQNdWz8BINvE28twErBizWpoYfnMwXAvtPGLB9Jo8rcfj50e?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcl9S7r8os6Svb9UYjNsZaq7452mL0OQVD2HPRWALQRMzjljjwkwsThAlNONVNMjagTiNXoACEmlnY5awS03sdHrJyFq9UAeHdKzxWRHDfuAQNdWz8BINvE28twErBizWpoYfnMwXAvtPGLB9Jo8rcfj50e?key=w6pMrdQ7HlvkdgQoN04a4w) Once you click on the Button "Open Full Sized Editor" it will open the Editor in the Full Sized window. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcnNihTmeMi8rSpCjjG5WJNUChbhklhJprh7bRSg94PRZL7tAqAzNA61lKErj_H5wR3z1jfjSQC-VH-viQ6OIS399l4DLfzNbinn3EdOuH6RdFtpanPKlHba4N2r6m4eUkQxfwPSwrUvma2Lz_AuZmBzeKW?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcnNihTmeMi8rSpCjjG5WJNUChbhklhJprh7bRSg94PRZL7tAqAzNA61lKErj_H5wR3z1jfjSQC-VH-viQ6OIS399l4DLfzNbinn3EdOuH6RdFtpanPKlHba4N2r6m4eUkQxfwPSwrUvma2Lz_AuZmBzeKW?key=w6pMrdQ7HlvkdgQoN04a4w) The following are examples for Transforming the content using different scripting languages in the Transformation window. **Regex** Here's an example script that extracts the first word of a content using a regular expression (Regex): ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdb8yOrl9Exp_tlgCnv_kpkMUdov4lI69qBLNfj_2pUdzfPiuSkILXNab6xvHrV9vPKGK1WmNWrOzOC7tBa-m2reASr4hFeTdZ9HG8B7IHvPonwIbFSnVb6mbIOIcii8gvjLO0wY_bd0LEaSJCMssqfdKU?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdb8yOrl9Exp_tlgCnv_kpkMUdov4lI69qBLNfj_2pUdzfPiuSkILXNab6xvHrV9vPKGK1WmNWrOzOC7tBa-m2reASr4hFeTdZ9HG8B7IHvPonwIbFSnVb6mbIOIcii8gvjLO0wY_bd0LEaSJCMssqfdKU?key=w6pMrdQ7HlvkdgQoN04a4w) Interestingly the Sequentum Cloud Provides the feature to Auto Generate Regex for you. Follow the below steps to generate the Regex from the Extracted content. * Select the content you want from the extracted content. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdHTuBke9RuEJTTRU18jiwfE_1aMI78htkAPjPZRJ99fMXlV0r0MmmyNoeZX_Ka8fiw38qfENBJKzUxjC9dok3q0hujRixF-E1FGy-z5KdJ4VbO_qeloz2ZRbr5TJVIYt1_AJCvJ-Fk73VOvSDgH_A-9C8x?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdHTuBke9RuEJTTRU18jiwfE_1aMI78htkAPjPZRJ99fMXlV0r0MmmyNoeZX_Ka8fiw38qfENBJKzUxjC9dok3q0hujRixF-E1FGy-z5KdJ4VbO_qeloz2ZRbr5TJVIYt1_AJCvJ-Fk73VOvSDgH_A-9C8x?key=w6pMrdQ7HlvkdgQoN04a4w) * Once the required content is selected the "Transform" button will change to "Extract Selected". ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXeF30hYqKeFSwRnBExnJxB9lNxOeNByP_HPoTaLKgc3sXd9Dk-ofPoj-Imb6w2m--u3UYf9Mu7szvdtwS5E6ed1pq75fWE7muBwUhT8En5vWrvJkb-2RfAaOuWfSyBV40NOwTbVscEEXT7yKKBnBEkwPruv?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeF30hYqKeFSwRnBExnJxB9lNxOeNByP_HPoTaLKgc3sXd9Dk-ofPoj-Imb6w2m--u3UYf9Mu7szvdtwS5E6ed1pq75fWE7muBwUhT8En5vWrvJkb-2RfAaOuWfSyBV40NOwTbVscEEXT7yKKBnBEkwPruv?key=w6pMrdQ7HlvkdgQoN04a4w) * Click on the "Extract Selected" button and it will generate the Regex for you and will show the result on the right side. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcL3_o4opUJe-c4JXS8gMIuQ-PffasjpT8H4MjmyrZISXQ8BLyd7B0KJYtyvxJcBhdzE57lboMlBUpgUTv5k2YjC46PW32-EXZFr4Osyu0qgnbIhcqFLuyyipatgVA_KV0AcLBcoY0O07peHAcB1uN0pd9i?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcL3_o4opUJe-c4JXS8gMIuQ-PffasjpT8H4MjmyrZISXQ8BLyd7B0KJYtyvxJcBhdzE57lboMlBUpgUTv5k2YjC46PW32-EXZFr4Osyu0qgnbIhcqFLuyyipatgVA_KV0AcLBcoY0O07peHAcB1uN0pd9i?key=w6pMrdQ7HlvkdgQoN04a4w) * Click on the "Transformation" button and it will open the Transformation scripting window where you can see the "Auto Generated" Regex. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfNcKJHQOwDsmIWShNsgnUFfa107OwhsykCyX8iLITBv4jkeAPUUj9IrzWTPJvEbLoFMkfWNtzH0hjOPp6zKJjrpnris__htAoFkBL_pktbnX6wo9tKho7wiz6NJniSgD-vJkj5QvkxP8KJLJT7w0IKZzUL?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfNcKJHQOwDsmIWShNsgnUFfa107OwhsykCyX8iLITBv4jkeAPUUj9IrzWTPJvEbLoFMkfWNtzH0hjOPp6zKJjrpnris__htAoFkBL_pktbnX6wo9tKho7wiz6NJniSgD-vJkj5QvkxP8KJLJT7w0IKZzUL?key=w6pMrdQ7HlvkdgQoN04a4w) * **C#** The following example extracts the first word of the extracted content. public string TransformContent(string content, RunContext context) { // Extract the first word from the extracted content. return content.Split(" ")[0]; } The script above uses the "content" Content which is of "string" type and returns the extracted content only. Most importantly it can't be updated by scripting. However, the "content" Content has some string methods that can be used on the extracted content for modifying the content as per the need. The above script uses the "Split" method to split the content with " " as a separator and then uses index "0" to get the first word. The below code shows the example of getting the Cookies or Proxy, etc. public string GetData(RunContext context) { return context.ActionResult.GetReturnValue("cookie"); } Note: Please enable the option "Capture response headers and cookie" from the "Browser" property of "URL \& link" Contents. To get the value of the cookie. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdCTWlTODfB6qzWWzoh8I4an7kZCNvLAmjBl6VFUVHs-8mhuxafijaIZ-kMBZPiPlks94R2SfP07t1zXywvbTZuyXZwvD5O5E9sO4vINZQaimEqi_iBg5YJG4SpmFHpovx23JCr6KBO6_p_hbFxHuTi3rM?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdCTWlTODfB6qzWWzoh8I4an7kZCNvLAmjBl6VFUVHs-8mhuxafijaIZ-kMBZPiPlks94R2SfP07t1zXywvbTZuyXZwvD5O5E9sO4vINZQaimEqi_iBg5YJG4SpmFHpovx23JCr6KBO6_p_hbFxHuTi3rM?key=w6pMrdQ7HlvkdgQoN04a4w) The above code used the "context" Content to use the methods to get the "Cookies". ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdRH6b0ZeX7oH3ihuo_nTM7AK53OyMsA_7TzqogU4Yr7cxZ23YozTOjXpRhKZZi7O6k-XK6rbffSMtrP3TbsehgfEpGs-NmQ7KjMHyiVHMkAwd0YiA8wd1GbwFuh0seN8npiyUilIbtwXtGkfb9GS25ye0?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdRH6b0ZeX7oH3ihuo_nTM7AK53OyMsA_7TzqogU4Yr7cxZ23YozTOjXpRhKZZi7O6k-XK6rbffSMtrP3TbsehgfEpGs-NmQ7KjMHyiVHMkAwd0YiA8wd1GbwFuh0seN8npiyUilIbtwXtGkfb9GS25ye0?key=w6pMrdQ7HlvkdgQoN04a4w) * **Python:** The following example extracts the first word of the extracted content. from se_scripting_utils import * def transform_content(content: str, context: RunContext): return content.split(" ")[0] The script above uses the "content" Content which is of "string" type and returns the extracted content only. Most importantly it can't be updated by scripting. However, the "content" Content has some string methods that can be used on the extracted content for modifying the content as per the need. The above script uses the "Split" method to split the content with " " as a separator and then uses index "0" to get the first word. The below code shows the example of getting the Cookies or Proxy, etc. Note: Please enable the option "Capture response headers and cookie" from the "Browser" property of "URL \& link" Contents. To get the value of the cookie. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXefPZDcY0Gfwfc_W_XgGpqVZ9Z-gqhC6Md2HIxmyhgcUvydnlXnXoMga29ccRId_H2NJEX-ZKWwjBw-rYEtx_E1KtSx54VDxttRXx3y_XwgujkfZmXGMFu_gW5AxXGD56N2D4x7WFiSIdqBGrWI8Qod2u1R?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXefPZDcY0Gfwfc_W_XgGpqVZ9Z-gqhC6Md2HIxmyhgcUvydnlXnXoMga29ccRId_H2NJEX-ZKWwjBw-rYEtx_E1KtSx54VDxttRXx3y_XwgujkfZmXGMFu_gW5AxXGD56N2D4x7WFiSIdqBGrWI8Qod2u1R?key=w6pMrdQ7HlvkdgQoN04a4w) from se_scripting_utils import * def get_data(context: RunContext): return context.action_result.get_return_value("cookie") --- language: "en" --- # Condition Scripts A condition script can be used by the commands that use a condition to determine a particular outcome, such as commands that control execution flow. The Condition script is also used in Branch, Retry \& Exit. The following script is an example of a condition script: * [Python](https://sequentum.atlassian.net/wiki/spaces/VEUD/pages/edit-v2/508297235?draftShareId=616b285f-9d6a-425f-aafb-0ad1dc475524#Python) * [C#](https://sequentum.atlassian.net/wiki/spaces/VEUD/pages/edit-v2/508297235?draftShareId=616b285f-9d6a-425f-aafb-0ad1dc475524#C%23) * [Regex](https://sequentum.atlassian.net/wiki/spaces/VEUD/pages/edit-v2/508297235?draftShareId=616b285f-9d6a-425f-aafb-0ad1dc475524#Regex) The following Example uses the Branch Command and the condition scripts are written in the transformation option. ## **Python** from se_scripting_utils import * def transform_content(content: str, context: RunContext): if len(content) == 10: return "Branch" else: return "" ### **C#** public string TransformContent(string content, RunContext context) { if (content.Length == 10) { return "Branch"; } else { return ""; } return content; } The above example uses the Branch command and returns the name of the Branch command which is "Branch". As per the requirement, the condition can either allow us to enter the Branch command or disallow Agent flow to enter the Branch and return "" blank. ### **Regex** if empty return "Branch" else return "" The above command checks whether the extracted content is empty or not. If empty, it will allow the "Agent" to enter the "Branch" command but if not, it will not allow the Agent to enter the Branch command. --- language: "en" --- # Configuring Agent Email Alerts with Sequentum Cloud Sequentum Cloud is a robust web data extraction and automation platform that offers customizable **Email Alert Settings** to optimize user experience. This feature provides **real-time alerts** , keeping users informed about the status of their **automated agents and data workflows** without the need for constant manual monitoring. Through **Email Alert Settings** , users can configure alerts based on specific events, including agent **run initiation, run failure, run completion, and even error counts** . This customization ensures that users receive **timely updates on critical system activities** , such as **scraping job completions, failures, system errors, or scheduled task executions**. For instance, if an agent encounters more errors than the predefined threshold, an email alert is automatically sent to all relevant users. This flexibility enhances operational efficiency and allows users to stay informed without being inundated by excessive notifications. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXcOZzcxCkCIj15LZfOKwbqMc-Io5W3r0hAdhXf9fMj07qzNbVeOjEdCW0d2aB2joQgEtDLGzRnjBAJDxGIZHfb9971N-FZz_JD8laS_acYxeh9vKygCM-ibqKqsA6wQnr4VV6RwrQ?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcOZzcxCkCIj15LZfOKwbqMc-Io5W3r0hAdhXf9fMj07qzNbVeOjEdCW0d2aB2joQgEtDLGzRnjBAJDxGIZHfb9971N-FZz_JD8laS_acYxeh9vKygCM-ibqKqsA6wQnr4VV6RwrQ?key=jOQaYoaNITRy4hsSofPW4Q) ## Email Alert Settings The Email Alert Settings are disabled by default. To configure alerts, check the **Enabled** checkbox located in the **Alerts** tab of the agent detail page. Kindly note, the email alert settings are specific to a particular agent. ### Alert Options * **Send alerts to these email addresses (separate with semicolon):** * Contains the primary recipient email addresses, separated by semi-colons (;) if there are multiple. * Functions as the "To" field in an email. * **CC these email addresses (optional):** * Contains CC recipient email addresses, separated by semi-colons (;) if there are multiple. * Functions as the "CC" field in an email. * This field is optional. * **BCC these email addresses (optional):** * Contains BCC recipient email addresses, separated by semi-colons (;) if there are multiple. * Functions as the "BCC" field in an email. * This field is optional. * **Only send alerts when the agent is run by the scheduler:** * When checked, email alerts are only sent for scheduled tasks if conditions are met. If unchecked, an email alert is sent for an unscheduled run that meets the specified conditions. * This option is checked by default. * **Alert when agent runs fail:** * Sends an email alert to the listed email addresses if the agent run fails. * This option is checked by default. * **Alert when the first agent run fails after successful runs:** * Sends an email alert only if an agent fails after a successful run. ![AD_4nXeeY-gcxTXe6r95ct9HTYpvr29OQrM-Vn-mIRHSQqbTeK9k8QWSWHtdcdPeQhVXaq2jHNQJWFw8ScV793uLjYtLscCI2RA21hQm3VjROfdErVNPoXzDgSfIh4QaQykMhTW2ur3Y?key=yDfxdCr5-wIUT94iupecYQ](https://cloudsupport.sequentum.com/__attachments/a_1d3efc547c464036c546f3bc42efc0f8f8c40198f8e2d19e5ecacb9e63e09da0/AD_4nXeeY-gcxTXe6r95ct9HTYpvr29OQrM-Vn-mIRHSQqbTeK9k8QWSWHtdcdPeQhVXaq2jHNQJWFw8ScV793uLjYtLscCI2RA21hQm3VjROfdErVNPoXzDgSfIh4QaQykMhTW2ur3Y%3Fkey=yDfxdCr5-wIUT94iupecYQ?cb=25db992464681eccdc76b51738d20714) * **Alert when agent runs are successful:** * Sends an email alert if the agent run completes successfully. * **Alert when the first agent run is successful after failed runs:** * Sends an email alert only for the first successful agent run after one or more failed runs. ![AD_4nXdp-ow_2uq0-rI1ihkYom2lHATbpIP510EkERY6iraHjU7SAIR0lfktnW8NDy7AnnLqI4kao9RdJJzGD2LAk1b197nJOENUiugW4Wq8Wn4gNPR7DJdcOHKcKwfbw-xtK1GpKOb4?key=yDfxdCr5-wIUT94iupecYQ](https://cloudsupport.sequentum.com/__attachments/a_f1c800e345a381d578460951987087b1cf0184a233dad7331e82e2b4d14d36f1/AD_4nXdp-ow_2uq0-rI1ihkYom2lHATbpIP510EkERY6iraHjU7SAIR0lfktnW8NDy7AnnLqI4kao9RdJJzGD2LAk1b197nJOENUiugW4Wq8Wn4gNPR7DJdcOHKcKwfbw-xtK1GpKOb4%3Fkey=yDfxdCr5-wIUT94iupecYQ?cb=5777b90ba26e7ac03b2e01bc1f1cddfb) * **Alert when agent runs start:** * Sends an email alert as soon as the agent run starts. ![AD_4nXeqf7by2ahv4NtdBm7gE5Lzak-DnLnfVJzx0lS9uxpVHWNyxFckph47KG1QpM-Rr1byVgPiML8qFUROtSYcZ0jG8-zmUoD2dDqyuk1YRplc4bVEJrh8dg32HRKPOXMcMaW5zEy9?key=yDfxdCr5-wIUT94iupecYQ](https://cloudsupport.sequentum.com/__attachments/a_9baf00cf5d0187a19e33bf39e4ddeb455879fd8ddf2e97d42f5c4eed9f56a815/AD_4nXeqf7by2ahv4NtdBm7gE5Lzak-DnLnfVJzx0lS9uxpVHWNyxFckph47KG1QpM-Rr1byVgPiML8qFUROtSYcZ0jG8-zmUoD2dDqyuk1YRplc4bVEJrh8dg32HRKPOXMcMaW5zEy9%3Fkey=yDfxdCr5-wIUT94iupecYQ?cb=81bbc569d81122661a9cc3b98dd90b09) * **Alert when agent runs have run for the specified number of minutes:** * Sends an email alert if the agent run exceeds the specified number of minutes. * The default value is 1440 minutes (24 hours). ![AD_4nXfTmuveTnKDvu4VubLoBVxYaonnxOpNU9mL41oEzcJ3Qku4rfYD_3K56P9EoT636AlhLXB5pSKEuAdjDwi8nkOKoQZD5SK6nxm2dH87gqVphu16hIdRLnFgu2BybHqHSssGnNye?key=yDfxdCr5-wIUT94iupecYQ](https://cloudsupport.sequentum.com/__attachments/a_23b5857cb0f953d7b6788c5e87a580ebade57da942adf62c41814b341f31a197/AD_4nXfTmuveTnKDvu4VubLoBVxYaonnxOpNU9mL41oEzcJ3Qku4rfYD_3K56P9EoT636AlhLXB5pSKEuAdjDwi8nkOKoQZD5SK6nxm2dH87gqVphu16hIdRLnFgu2BybHqHSssGnNye%3Fkey=yDfxdCr5-wIUT94iupecYQ?cb=8b9797c6e3aac21f8f77bfb2065fa698) * **Alert when agent runs have encountered the specified number of errors:** * Sends an email alert when the error count reaches the specified threshold. ![AD_4nXciQepE1iXD8EX_JgfLLJ6e5wiNj2CiUeNc9khrLP0nOG-ib1_j9GTW5Si6-usTmVZjnIs6aRJ3V94wXTc40OU1iBWC04idFqDgVMar5vNP6w-vfEHf5frOyBfy8OgzwCT52Wgx?key=yDfxdCr5-wIUT94iupecYQ](https://cloudsupport.sequentum.com/__attachments/a_32b4072b69c484b0569d326c21dcb71fcb60d9eec85037b73e182ef82c441ed6/AD_4nXciQepE1iXD8EX_JgfLLJ6e5wiNj2CiUeNc9khrLP0nOG-ib1_j9GTW5Si6-usTmVZjnIs6aRJ3V94wXTc40OU1iBWC04idFqDgVMar5vNP6w-vfEHf5frOyBfy8OgzwCT52Wgx%3Fkey=yDfxdCr5-wIUT94iupecYQ?cb=75925578ef6f74a9a19b098b0a07daf9) **NOTE:** A user must be a part of the organization in order to receive email alerts. ![AD_4nXc4e5q4TRP_RbdsiOJyK5QVFKQBjtN11tYbVn0USy5clnynqqzx-0laf8_bXcDzTXtDHjdx69l5C4UM6dweo1KJL628lEEgaKPim5ct7LMvw4ZpIoURm7tX1WJFNg3w3TDdlQRQ?key=yDfxdCr5-wIUT94iupecYQ](https://cloudsupport.sequentum.com/__attachments/a_acbd5d7c77d889914707ea3a3106bf958589e3364088181c429c1d07394b96ad/AD_4nXc4e5q4TRP_RbdsiOJyK5QVFKQBjtN11tYbVn0USy5clnynqqzx-0laf8_bXcDzTXtDHjdx69l5C4UM6dweo1KJL628lEEgaKPim5ct7LMvw4ZpIoURm7tX1WJFNg3w3TDdlQRQ%3Fkey=yDfxdCr5-wIUT94iupecYQ?cb=ac38c48f4d3e1bcf78d511d513257849) A user who is a part of the organization will appear in the drop-down while entering the email address of the concerned user. Else it may return an error message as follows: ![AD_4nXcTukiSPm-PJEczuYgV8noPr49GLaFizoitRtzJ0TqcpzEiaSFoP1CcxlnhyuxtO2GCcSappLCBefAawxeGgYu5HZwVxYn-FgldRRUyyJn16_7OPozspha_UfVet4esbhuc0uMV?key=yDfxdCr5-wIUT94iupecYQ](https://cloudsupport.sequentum.com/__attachments/a_b5de0e6de064a366b6adf5a70f90342a803cadb4e7a5ec7d4656806a605c06b5/AD_4nXcTukiSPm-PJEczuYgV8noPr49GLaFizoitRtzJ0TqcpzEiaSFoP1CcxlnhyuxtO2GCcSappLCBefAawxeGgYu5HZwVxYn-FgldRRUyyJn16_7OPozspha_UfVet4esbhuc0uMV%3Fkey=yDfxdCr5-wIUT94iupecYQ?cb=599e95eae2621779633a17eb4c542bc3) --- language: "en" --- # Configuring Multi-Session with Sequentum Cloud Sequentum Cloud provides a highly efficient feature that allows agents to run in multiple or parallel sessions. This capability significantly reduces the runtime of agents, enabling them to complete their tasks more quickly. By executing agents concurrently, Sequentum Cloud ensures that large-scale data extraction and processing operations can be handled with greater speed and efficiency, which is particularly beneficial for businesses with tight data delivery deadlines. The ability to run agents in parallel sessions means that the workload is distributed across multiple resources, allowing for faster data collection, transformation and delivery. This not only optimizes the performance of data operations but also minimizes delays, ensuring that businesses can meet their data-driven goals in a timely manner. Additionally, this feature is highly scalable, making Sequentum Cloud an ideal solution for businesses of all sizes that require flexible and reliable data extraction capabilities. Whether the task is to handle massive datasets or to meet real-time data delivery requirements, Sequentum Cloud's parallel session feature empowers users to achieve high performance and consistent results with minimal downtime. In summary, Sequentum Cloud's parallel session feature is a game-changer for companies seeking to streamline their data extraction processes. By allowing agents to operate simultaneously, it not only accelerates the workflow but also enhances operational efficiency, ensuring that critical data is delivered on time and with precision. In Sequentum Cloud, sessions enable you to run multiple instances of the same agent simultaneously. This feature is particularly useful for breaking down large web scraping tasks, allowing several instances of an agent to work in parallel on different portions of the task. Sequentum Cloud efficiently divides large tasks by splitting list entries into smaller subsets. Each instance of the agent is then assigned to process one of these subsets. For example, if you are scraping data from a long list of starting URLs, Sequentum Cloud can split the list into smaller chunks, enabling one instance of the agent to handle the first subset while another instance works on the next, and so on. This parallel processing significantly speeds up data extraction, especially when dealing with large datasets. Although Sequentum agents already use multithreading to distribute work internally, running multiple sessions often provides an even greater performance boost. This is because, while multithreading can efficiently divide tasks, it sometimes requires threads to wait for each other to complete before moving on to the next stage. For example, when scraping through paginated data, some threads may finish processing one page faster than others, but the agent must wait for all threads to complete before moving to the next page. With Sequentum Cloud's multiple session feature, each instance of the agent operates independently. This means that one instance does not need to wait for another to finish its task, providing a more seamless and faster data extraction experience. Furthermore, these parallel sessions can be distributed across multiple servers, maximizing performance by leveraging multiple computing resources at once. In summary, Sequentum Cloud's session capability offers a powerful solution for businesses dealing with large-scale data extraction. By allowing multiple instances of an agent to work independently, it enables faster and more efficient processing, especially for time-sensitive or high-volume web scraping tasks. Note: We can use parallelism option/process list in parallel only when using a list like Data List or Page Area List. Below is the detailed explanation for the same: 1. **Using Data List** - For Example, if we are having a data list of 100 inputs and we are willing to run it in parallel sessions for faster execution, then firstly we need to go to the **Options** tab in Data List command, then to the **List** menu, then we need to check the **Process List in Parallel**checkbox(refer to below screenshot) ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXeVi4xMovjn1DjPNAX4QDnbuW83qgCxJGw-po8lfH-0GR-LFWJiXS3Q-v7ssG_07uKt95H-jeNNqF0ylMOUoHAK4wy1I5C_oBMSEf99Jh1fYAZ_5jSM-1Blz_ZT-fnxjaty_BTd8g?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeVi4xMovjn1DjPNAX4QDnbuW83qgCxJGw-po8lfH-0GR-LFWJiXS3Q-v7ssG_07uKt95H-jeNNqF0ylMOUoHAK4wy1I5C_oBMSEf99Jh1fYAZ_5jSM-1Blz_ZT-fnxjaty_BTd8g?key=jOQaYoaNITRy4hsSofPW4Q) By using above properties, inbuilt multithreading will automatically work and will split the inputs into multiple desired chunks automatically. 2. **Using Page Area List -** For Example, if we are having a data list of 100 selections and we are willing to run it in parallel sessions for faster execution, then firstly we need to go to the **Options** tab, then to the **List** menu, then we need to check the **Process List in Parallel** checkbox(refer to below screenshot) ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdiSbh-IS6sZXv9fUdbBCG9giTodoCyVfEVqNhR7wDk2pVC1ZQygBqr3Enq8lnYREpm00dplSFTV0kxeuJhTUL0YMpdfymqwn1pckSqL5OTTxIZQNExaE0p-T4YXXf13QlVFKK7JQ?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdiSbh-IS6sZXv9fUdbBCG9giTodoCyVfEVqNhR7wDk2pVC1ZQygBqr3Enq8lnYREpm00dplSFTV0kxeuJhTUL0YMpdfymqwn1pckSqL5OTTxIZQNExaE0p-T4YXXf13QlVFKK7JQ?key=jOQaYoaNITRy4hsSofPW4Q) 3. **Scheduling Parallel Run Task** Users also have the option to split inputs and execute them in parallel. This feature allows users to divide large inputs and process them concurrently for more efficient execution. By checking the 'Split up inputs and process in parallel' checkbox, users can configure handling of larger inputs for parallel processing. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXf3sayCN5bKy1C_3WVSOgGjdLUzEc2aPY2tBm7h8QtTeYZaSmhzQUrLtXABO0IDFbVfrTrVdvYpGpvH-CmKNY8fx_h5aNBOJqCrDVbJUnzzTaKysF8LggwIF_Qd8_wtoXXJTTu_2A?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXf3sayCN5bKy1C_3WVSOgGjdLUzEc2aPY2tBm7h8QtTeYZaSmhzQUrLtXABO0IDFbVfrTrVdvYpGpvH-CmKNY8fx_h5aNBOJqCrDVbJUnzzTaKysF8LggwIF_Qd8_wtoXXJTTu_2A?key=jOQaYoaNITRy4hsSofPW4Q) 1. **Parallel Processing :** By enabling the Parallel Processing option, users can configure how the input data is divided and processed concurrently. 2. **Total Runs**: Specifies the total number of splits for the input data. 3. **Concurrency**: Defines the number of executions that will run simultaneously 4. **Export**: Allows users to choose whether to export the data as a combined output or separately for each session. * **Monitoring Runs in Progress** Once the agent is in execution, navigate to the agent details page where the status will be displayed as 'Running.' To monitor the live execution, click the 'View Live Information' button, as shown below: ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfYB5qtIAWHaI4cuNRMMb2G8zw8BLEm1EKmwDAAj3_aPqjXEQpouvKb2_hoc8Km81lA2vR_TZy2CG7oFJvCO5D7CTI4GOSNOa37VBqBWRq13GsFbheaSj-QTXSzjhVFTfxMTkPE?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfYB5qtIAWHaI4cuNRMMb2G8zw8BLEm1EKmwDAAj3_aPqjXEQpouvKb2_hoc8Km81lA2vR_TZy2CG7oFJvCO5D7CTI4GOSNOa37VBqBWRq13GsFbheaSj-QTXSzjhVFTfxMTkPE?key=jOQaYoaNITRy4hsSofPW4Q) After selecting the option mentioned above, a live stream of the agent's execution will be shown, enabling users to monitor progress in real-time. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdFzlkw9Au371m7lrUERmdbEIj1qTjNgvql2RHBOKzFHPfWlJM6EsKIAnQbnRaqFnhkOpizY1H1ZHqUSwHlFq1fWRKs_T-aogSsCo22aZ19D-oZtI1jHnGKjYN0ltxlInGerr-3dA?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdFzlkw9Au371m7lrUERmdbEIj1qTjNgvql2RHBOKzFHPfWlJM6EsKIAnQbnRaqFnhkOpizY1H1ZHqUSwHlFq1fWRKs_T-aogSsCo22aZ19D-oZtI1jHnGKjYN0ltxlInGerr-3dA?key=jOQaYoaNITRy4hsSofPW4Q) * **Stopping a Run** Users can stop a running execution at any time by clicking the 'Stop' button. When this happens, the status will be updated to 'Stopped' in the 'Status' column on the Runs page as shown below: ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXdPnYtkkGBFgSccMdV-IsOxPfqPQa2aazgr9wy2BiFg1bZC3bu0Hckgr1pPtwo6uga2MwHcwa9nKa1zLegjqw3Ukf-k1RE49g4AucNPypaYwFlw3EiiA-AkRZox_EX9zx_BYFyMHcwIvqa3YpPplrsB6pqV?key=w6pMrdQ7HlvkdgQoN04a4w](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdPnYtkkGBFgSccMdV-IsOxPfqPQa2aazgr9wy2BiFg1bZC3bu0Hckgr1pPtwo6uga2MwHcwa9nKa1zLegjqw3Ukf-k1RE49g4AucNPypaYwFlw3EiiA-AkRZox_EX9zx_BYFyMHcwIvqa3YpPplrsB6pqV?key=w6pMrdQ7HlvkdgQoN04a4w) * **Reviewing Run History** This option allows you to view the Run History of the agent. Run history page displays the complete run history of the agent job schedule. You can navigate to the Run history page via the below option: ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXfsdS-DIGHxbsAkrAVYUUBncQxSuG8KFIL25sbnBcnSClWQ79wQQlxhdGCpoLgLROi04MOJsykjZ2RJomhXsOV0OxtCSswyDRKaTA6N8oiMDRuMpD7aw_OvdM5Sr5NQwXfWSiSrhQ?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfsdS-DIGHxbsAkrAVYUUBncQxSuG8KFIL25sbnBcnSClWQ79wQQlxhdGCpoLgLROi04MOJsykjZ2RJomhXsOV0OxtCSswyDRKaTA6N8oiMDRuMpD7aw_OvdM5Sr5NQwXfWSiSrhQ?key=jOQaYoaNITRy4hsSofPW4Q) Users can view the details of a specific agent execution by clicking the 'View Run Details and Files' button. On this page, users will find the historical logs and output files tailored to their requirements. ![https://lh7-rt.googleusercontent.com/docsz/AD_4nXeCMYNWIlVzUnds7MWgbyPTKuZXhUZd5FzcJZ3bfqrkIl2tPsLTCCVo1QyI3XckNsaNSSeKXEgvmm2Kf6EIq7tPbYtj8US3ViYlgX9MYjpB6NsNe7geOoXjwGiQRdxlK1G0P4I7Gw?key=jOQaYoaNITRy4hsSofPW4Q](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeCMYNWIlVzUnds7MWgbyPTKuZXhUZd5FzcJZ3bfqrkIl2tPsLTCCVo1QyI3XckNsaNSSeKXEgvmm2Kf6EIq7tPbYtj8US3ViYlgX9MYjpB6NsNe7geOoXjwGiQRdxlK1G0P4I7Gw?key=jOQaYoaNITRy4hsSofPW4Q) [Next Page](https://cloudsupport.sequentum.com/llms-full.txt/1)