Parser for https://www.sahibinden.com
Implemented a parser for ads on the website https://www.sahibinden.com
Link to the video of the bot's operation: https://photos.app.goo.gl/yUsjtdKWBC3QHtdQ6
The bot fully imitates a user: periodic user-agent changes have been implemented, as well as periodic account changes using a saved profile. The site often requires two-factor authentication confirmation, which has been bypassed by receiving an email from Gmail via the Google API.
Bypass of the anti-bot protection called PerimeterX has been implemented.
PerimeterX is a website protection system against bots and suspicious activity that analyzes user behavior in real-time and determines whether it is a human or an automated script. It collects many signals: IP address, browser fingerprint (user-agent, plugins, settings), presence and operation of JavaScript, as well as behavioral factors - mouse movements, clicks, page navigation speed. Based on this data, algorithms create a "profile" of the request and compare it with typical human behavior; if the activity seems suspicious (for example, actions that are too fast, use of proxies, or headless browsers), the system may restrict access, show a captcha, or completely block the user.
Link to the video of the bot's operation: https://photos.app.goo.gl/yUsjtdKWBC3QHtdQ6
The bot fully imitates a user: periodic user-agent changes have been implemented, as well as periodic account changes using a saved profile. The site often requires two-factor authentication confirmation, which has been bypassed by receiving an email from Gmail via the Google API.
Bypass of the anti-bot protection called PerimeterX has been implemented.
PerimeterX is a website protection system against bots and suspicious activity that analyzes user behavior in real-time and determines whether it is a human or an automated script. It collects many signals: IP address, browser fingerprint (user-agent, plugins, settings), presence and operation of JavaScript, as well as behavioral factors - mouse movements, clicks, page navigation speed. Based on this data, algorithms create a "profile" of the request and compare it with typical human behavior; if the activity seems suspicious (for example, actions that are too fast, use of proxies, or headless browsers), the system may restrict access, show a captcha, or completely block the user.