Fix 403 [Parsing OLX]
Good day, esteemed audience.
I have a parser for OLX written in Python.
I use aiohttp and aiohttp_socks
The essence of the parser is simple:
- Go to the OLX search page (*link*).
- Filter by relevance of time.
- Filter by number of views (request to link to get the number of views for a specific ad).
- If everything is good, then go to the specific ad page and get the necessary info.
- After obtaining, send it to Telegram.
I used without proxies for about 2 months, everything worked fine. Then I got banned (403 Request Blocked), started using proxies (automatic rotation with 10 IP addresses from the file proxie.json) and connecting through ProxyConnector. Everything worked exactly 2 weeks, now it’s a definite ban.
The current problem is that even at the first stage I get blocked (
I have already changed proxies to new ones, user-agent(-s) changed, and nothing.
I thought there was a block by guid, also replaced it - and still no result.
Access to the server will not be provided, nor will the parser file.
Solution: you provide me with a ready .py file, which I run on my server and check the connection to *link*.
If everything is okay, we close the project.
P.S. There are very many requests, keep that in mind. I do not use and will not use Selenium
-
78 This is a task to set up anti-ban bypass: proxy, headers, possible anti-bot protections. If necessary, a headless browser (for example, undetected_chromedriver) can be used, but it is not mandatory for now.
2. What will be in the solution:
– One .py file that:
loads the OLX page through the specified proxy
inserts working User-Agent, cookies (if needed)
… logs the status (for example, successful bypass or 403)
3. No server access is needed — everything will be implemented locally.
later, this bypass can be integrated into your main parser
-
3853 24 0 Good afternoon! I am interested in the project with the parser for OLX. I have experience in data parsing and automation using various libraries. I can adapt your current Python script to bypass blocking, make necessary adjustments for efficient operation without using Selenium. I have ideas for optimizing requests and changing access parameters to minimize the risk of ban.
My rate is $16 per hour. I will propose a solution that can be run on your server to test the effectiveness of the new approach.
-
236 1 0 Good day
I can offer a technical solution with 2 components:
* proxy service under Linux (will explain in more detail)
* scraper setup (working logic is not needed except for a couple of points I will suggest to check)
-
188 Good day!
Your case is well understood — blocking of OLX even with proxies has significantly increased recently, especially during intensive parsing.
🔧 I can develop a .py file that:
works through aiohttp + aiohttp_socks
automatically rotates proxies from your proxie.json
… replaces User-Agent, headers, and other traces (including cookies, headers, referer)
maximally mimics requests from a regular browser (browser fingerprint equivalent)
checks access to the required link
❗ Keep in mind that Selenium is not used, and there are many requests. I will set up adaptive delay + behavioral pseudo-randomness to reduce the risk of blocks.
💬 If you have a log of an OLX response (403/429 or others), it will be helpful for more precise tuning.
Ready to provide a .py for testing — only after I ensure its functionality. If it works — we close the project.
Write in PM — we will discuss details and select the optimal solution for your parser.
-
3392 84 0 So where is the technical assignment? This is a development from scratch if we consider that you said you won't provide the code.
-
336 Hello! We are SolidWay company, and we are ready to help with your OLX parsing project. We have experience working with Python, including the libraries you mentioned, so we can find solutions to bypass the blocks you are facing.
We understand that the blocking issue may require creative approaches to working with proxies and user-agent, so we are ready to try different methods to ensure the necessary functionality of the parser. Our team has already implemented similar projects, so we know what to do.
Details related to terms and budget will be discussed after we clarify all the nuances of your request. So, let's discuss how we can help solve your problem!
-
Доброго дня.
Покажіть скрін того, як ви реалізуєте коннект. -
За вашими посиланнями
"Сторінку не знайдено"
-
deleted by moderator
-
Current freelance projects in the category Data Parsing
Car RIA website parser
33 USD
Need a contact parser for the auto ria website. Collect phone numbers / car (make, model, year) (into a table, for future SMS mailings) Data Parsing ∙ 3 hours 8 minutes back ∙ 25 proposals |
Svitlahata
17 USD
It is necessary to import 1819 products from the XML/YML feed of Prom.ua to OpenCart 3. A ready XML file is available, which contains product names, descriptions, prices, photos, specifications, manufacturers, and categories. Requirements: import all products to OpenCart… Content Management Systems, Data Parsing ∙ 13 hours 55 minutes back ∙ 28 proposals |
Data parsing through mobile APILooking for a person with experience in data parsing through mobile API, for parsing e-commerce, rozetka and similar sites. Tasks: 1. Intercepting traffic from the mobile application (Android), setting up a proxy, analyzing requests. 2. Identifying the necessary API endpoints… Python, Data Parsing ∙ 2 days 8 hours back ∙ 30 proposals |
Looking for a programmer or vibe coding Automation scraping data 2https://drive.google.com/file/d/14tP5XWJB9acV4gn_cJrFwMpihUj3EbQz/view?usp=sharing I accidentally sent that link Web Programming, Data Parsing ∙ 2 days 11 hours back ∙ 39 proposals |
Create a dashboard in https://airtable.com/ for the performance of advertising creatives from Facebook ads.Full specification https://docs.google.com/document/d/1_n_oYRNZWYxalUA---DM5AD1b5ZSrtePw5J4G42svGw/edit?usp=sharing Databases & SQL, Data Parsing ∙ 7 days 5 hours back ∙ 20 proposals |


