Budget: 600 PLN Deadline: 4 days
Hello!
I have reviewed your request for creating a parser for ads from OLX and a Polish website to extract phone numbers. I understand that the task requires consideration of the specifics of dynamic data loading on OLX and the possible use of Selenium or similar tools.
With 15 years of experience in web development, including data parsing using Selenium and modern Python libraries, I am confident that I can implement this project efficiently and effectively.
Proposed approach:
Website analysis:
Thorough analysis of the structure of OLX and the Polish website to determine the optimal parsing method.
Assessment of the complexity of dynamic data loading and the need for Selenium.
Technology selection:
Determining the optimal approach: Bearer (if possible) or Selenium/other libraries.
Choosing suitable Python libraries (e.g., Beautiful Soup, Scrapy) for HTML parsing.
Parser development:
Developing a parser that will automatically click the "show phone" button on OLX.
Implementing logic to extract phone numbers from both websites.
Handling possible errors and exceptions.
Data storage:
Choosing a data storage format (e.g., CSV, JSON, database).
Implementing functions to save extracted phone numbers.
Testing and optimization:
Thorough testing of the parser on various pages and scenarios.
Optimizing the speed of the parser and data processing.
