CRM automation / n8n Automation - API Data Loader
Workflow Steps
Purpose
This workflow is designed to automatically fetch data from an external API, enrich it with keywords, split and process the items, and then insert the results into a database. It also manages global variables (such as tokens and page numbers), updates them when necessary, and keeps logs for monitoring.
Workflow Steps
1. Trigger
* Schedule Trigger: launches the workflow on a regular schedule (e.g., every X minutes/hours/days).
2. Retrieve Global Variables
* get global vars (get: row): retrieves current values (e.g., authorization token, page number).
* If3: checks conditions (such as token validity).
3. API Request
* Prepare request: builds the request payload (includes token, page number, and parameters).
* Get data from API: sends a request to the external API.
* On success → proceeds to data enrichment.
* On error → refreshes the token and retries.
* update token in global vars: updates the stored token in global variables when expired.
4. Data Processing & Filtering
* enrich items with keywords (manual): adds or enriches items with keywords.
* If2: checks if items are available.
* True → go to Split Out2.
* False → update page number and log.
5. Splitting & Iteration
* Split Out2: splits the array of data into individual items.
* Loop Over Items2: processes each item separately.
6. Data Insertion
* Aggregate: collects processed items after looping.
* Insert rows in a table1: inserts the processed data into a PostgreSQL table.
7. Global Variables Management
* get global vars1 → update page number in global vars: retrieves and updates the page number for the next run.
8. Logging
* log: records events (such as empty responses or errors) for monitoring and debugging.
Key Features
1. Automatic scheduling and execution.
2. Dynamic token management (refresh on expiration).
3. Step-by-step data enrichment.
4. Paged API data retrieval.
5. Automatic database insertion.
6. Logging for debugging and monitoring.
Purpose
This workflow is designed to automatically fetch data from an external API, enrich it with keywords, split and process the items, and then insert the results into a database. It also manages global variables (such as tokens and page numbers), updates them when necessary, and keeps logs for monitoring.
Workflow Steps
1. Trigger
* Schedule Trigger: launches the workflow on a regular schedule (e.g., every X minutes/hours/days).
2. Retrieve Global Variables
* get global vars (get: row): retrieves current values (e.g., authorization token, page number).
* If3: checks conditions (such as token validity).
3. API Request
* Prepare request: builds the request payload (includes token, page number, and parameters).
* Get data from API: sends a request to the external API.
* On success → proceeds to data enrichment.
* On error → refreshes the token and retries.
* update token in global vars: updates the stored token in global variables when expired.
4. Data Processing & Filtering
* enrich items with keywords (manual): adds or enriches items with keywords.
* If2: checks if items are available.
* True → go to Split Out2.
* False → update page number and log.
5. Splitting & Iteration
* Split Out2: splits the array of data into individual items.
* Loop Over Items2: processes each item separately.
6. Data Insertion
* Aggregate: collects processed items after looping.
* Insert rows in a table1: inserts the processed data into a PostgreSQL table.
7. Global Variables Management
* get global vars1 → update page number in global vars: retrieves and updates the page number for the next run.
8. Logging
* log: records events (such as empty responses or errors) for monitoring and debugging.
Key Features
1. Automatic scheduling and execution.
2. Dynamic token management (refresh on expiration).
3. Step-by-step data enrichment.
4. Paged API data retrieval.
5. Automatic database insertion.
6. Logging for debugging and monitoring.
Харьков 
Свободен для работы