There is data, it is collected and updated daily (stored in files) - all registered domains across 1500+ zones (about 270 million items).
There are 2 types of software (Windows and Linux), specifically created for collecting server responses for each domain.
There is a separate server with PostGreSQL for storing this data.
The software's task is to collect all server responses for all domains, as well as record all redirect chains.
The goal is to repeat this process weekly, at most 2 weeks.
Your task: run the software on multiple VPS, periodically monitor the data collection speed on the VPS and the database server, and when the software crashes or stops, identify the cause - check for memory overflow, memory leaks, ghost processes, load distribution between threads/processes, etc.
Describe this cause to the software developer (debugging and fixing the software is not your task).
