B2B — a system for automatic collection and preparation of client databases.

Project Description
A desktop system has been developed for the automatic search, collection, processing, and preparation of B2B client databases from open sources.
The project was created to form ready-made databases of potential clients in various niches: vape shops, tobacco stores, supermarkets, beer shops, gas stations, and other sectors.
The main goal is to automate the process of searching for companies, collecting contacts, and preparing a quality database for the sales department or CRM systems.
Implemented Functionality
Automatic Company Search
The system performs searches using:
Google Maps;
Google Search;
Bing Search;
official company websites;
Instagram;
Telegram;
open directories and catalogs.
Contact Information Collection
For each company, the system automatically collects:
the company name;
address;
phone numbers;
e-mail;
website;
Instagram;
Telegram;
Facebook;
LinkedIn;
cities of presence;
number of retail locations.
Intelligent Network Merging
A deduplication and branch merging module has been implemented.
The system automatically identifies:
same brands;
common websites;
same phone numbers;
related retail locations;
duplicate records.
As a result, instead of hundreds of separate locations, a single network card is formed.
Data Quality Verification
For each record, the following is performed:
contact verification;
e-mail validation;
phone verification;
social media verification;
information completeness assessment;
automatic assignment of quality status.
Flexible Search Management
The program implements:
a niche system;
presets for search scenarios;
keyword management without code editing;
custom sets of search queries;
settings for search depth by cities;
Global AI keyword generation mode.
The user sees all search queries before launching and can edit them through the interface.
Analytics and Statistics
The system generates real-time statistics:
records found;
retail locations found;
nets found;
percentage of duplicate merging;
number of records ready for managers;
number of records requiring verification.
Data Export
Several export modes are supported:
Excel;
CSV;
CRM format;
data preparation for import into NetHunt CRM.
Technologies
Python
PyQt6
SQLite
Pandas
OpenPyXL
Requests
BeautifulSoup
Google Maps Data Processing
Multithreading
AI-assisted Query Generation
Result
A fully functional system for the automatic collection of B2B databases has been created, allowing for the acquisition of ready-to-use company contacts, automatic duplicate cleansing, data quality verification, and preparation of information for further loading into CRM or transfer to the sales department.
The project significantly reduces the time for manual client search and allows for the formation of large quality databases of potential partners in almost automatic mode.