Browser Automation / Web Scraping for Ahrefs UI
557 USD 
It is necessary to implement stable automated data extraction from the Ahrefs UI without using the Ahrefs API, through controlling a real browser.
It is required to obtain SEO data available in the Ahrefs interface after authorization, including:
- anchors
- backlinks
- referring pages
- and other related link data
The solution must work stably under high load (up to ~10,000 domains per day) and support concurrency without blocking and bans.
🛠 General Requirements
- Automation of a real browser (headless or headful)
- Stable operation with Cloudflare / anti-bot protection
- Work with authorized sessions
- Ability to automate login and 2FA (email or TOTP)
- Run in a Docker container
- Support for concurrency and controlled throughput
- Clean, maintainable code (Python or Node.js)
🎯 Selection Criteria
Preference will be given to candidates who already have working solutions or confirmed experience with the Ahrefs UI or similar protected services.
The presence of a PoC, demo, or production experience will be a significant advantage. After confirming relevant experience, we are ready to provide a complete technical specification and consider long-term cooperation.
📩 In your response, it is desirable to indicate:
- Experience with the Ahrefs UI or similar platforms
- Tools and approaches used (Playwright, Puppeteer, CDP, stealth, etc.)
- Availability of demos, PoCs, or code examples
- Experience with high load and concurrency
- Experience in automating login and 2FA
-
Технически реализуемо, но есть серьёзные красные флаги.
10,000 доменов/день — это огромный объём. Понадобится минимум 5-10 аккаунтов Ahrefs для ротации, каждый стоит $99-999/мес. Баны аккаунтов - вопрос времени, не "если", а "когда".
По защите: Ahrefs использует Cloudflare Enterprise, fingerprinting браузера, поведенческий анализ. При таких объёмах детектят быстро.
Поддержка будет постоянной — Ahrefs регулярно обновляет защиту. То что работает сегодня, может сломаться через неделю. Это не "сделал и забыл".
Юридически - прямое нарушение ToS Ahrefs. При таких объёмах уж тем более.
По экономике: разработка + аккаунты + поддержка + риск банов — скорее всего выйдет дороже чем официальный API.
-
Доброго дня. Готовий виконати вчасно.
-
Current freelance projects in the category Data Parsing
Data parsing through mobile APILooking for a person with experience in data parsing through mobile API, for parsing e-commerce, rozetka and similar sites. Tasks: 1. Intercepting traffic from the mobile application (Android), setting up a proxy, analyzing requests. 2. Identifying the necessary API endpoints… Python, Data Parsing ∙ 5 hours 27 minutes back ∙ 16 proposals |
Looking for a programmer or vibe coding Automation scraping data 2https://drive.google.com/file/d/14tP5XWJB9acV4gn_cJrFwMpihUj3EbQz/view?usp=sharing I accidentally sent that link Web Programming, Data Parsing ∙ 7 hours 48 minutes back ∙ 25 proposals |
Create a dashboard in https://airtable.com/ for the performance of advertising creatives from Facebook ads.Full specification https://docs.google.com/document/d/1_n_oYRNZWYxalUA---DM5AD1b5ZSrtePw5J4G42svGw/edit?usp=sharing Databases & SQL, Data Parsing ∙ 5 days 2 hours back ∙ 19 proposals |
Creation of an Excel file for uploading products to the websites of other partners.I am interested in creating an Excel table with all parameters. Here is the website - https://heiztechnik.com.ua/ And the positions I am interested in to be transferred: Manual boilers: 1) TIS UNI 15-95 kW (10) pcs 2)TIS HARD 150-500 kW (7) pcs Pellet boilers: 1)TIS PELLET… Data Parsing ∙ 5 days 6 hours back ∙ 36 proposals |
A developer is required for parsing the catalog and automating data import.Detailed technical specifications in the attached document Please indicate the estimated cost and timeline in your response Do you have experience working with parsing large catalogs What possible difficulties or limitations do you see in this task Databases & SQL, Data Parsing ∙ 5 days 9 hours back ∙ 41 proposals |
Kyiv