LinkedIn Scraper on n8n + Google Custom Search + Google Sheets
Data Parsing
In this project, I implemented a fully automated process for collecting LinkedIn profiles using:
n8n (no-code/low-code automation platform)
OpenAI GPT-4o-mini for generating search queries
Google Programmable Search Engine (CSE) for scraping Google results
Google Sheets for storing the obtained data
What has been done:
Input chat: the user sends a message with the search topic (e.g., "Marketing managers in Berlin").
AI formatting: a precise search query for Google CSE is generated via GPT-4o prompt.
Pagination: a JavaScript script divides the query into pages to collect up to 500 results.
API request to Google CSE: requests are sent to Google to obtain profiles.
Filtering results: only links to LinkedIn profiles are extracted from the Google JSON response.
Saving: all unique links are added to Google Sheets (with duplicate checking).
Result:
Automatically collected over 40 unique LinkedIn profiles
Data neatly stored in the spreadsheet
Fully managed from one chat or API integration
n8n (no-code/low-code automation platform)
OpenAI GPT-4o-mini for generating search queries
Google Programmable Search Engine (CSE) for scraping Google results
Google Sheets for storing the obtained data
What has been done:
Input chat: the user sends a message with the search topic (e.g., "Marketing managers in Berlin").
AI formatting: a precise search query for Google CSE is generated via GPT-4o prompt.
Pagination: a JavaScript script divides the query into pages to collect up to 500 results.
API request to Google CSE: requests are sent to Google to obtain profiles.
Filtering results: only links to LinkedIn profiles are extracted from the Google JSON response.
Saving: all unique links are added to Google Sheets (with duplicate checking).
Result:
Automatically collected over 40 unique LinkedIn profiles
Data neatly stored in the spreadsheet
Fully managed from one chat or API integration