Development of a parser/scraper in Python + Selenium
250 USD Develop an automated parser in Python + Selenium for collecting data on advertising campaigns from the following websites:
The collected data must be aggregated, the number of unique links counted, a ranking of the popularity of advertised pages created, and the results sent to Notion via API.
We will provide access to the existing codebase, which already implements basic functions of authorization, parsing, and integration with Notion API for AdHeart.me. The code performs other tasks but can be used as a basis or to simplify the development of the current parser.
Detailed technical specifications:
https://www.notion.so/sirka-cpa/Python-Selenium-209a01e1b37180749184c3d30ca4e97e?source=copy_link
With AdHeart.me code, we have it almost ready, just need to refine it to obtain the required data. (Currently, it pulls video links, but we need links to the advertised funnels)
По AdHeart.me код у нас практически готов, нужно только доработать его для получения нужных данных. (Сейчас он вытягивает ссылки на видео, а нам нужны ссылки на рекламируемые воронки)
Applications 5
Client's review of cooperation with Oleh Ovchynnykov
Development of a parser/scraper in Python + SeleniumWe underestimated the complexity of the project. Both I, as the client, and Oleg, as the specialist. As a result, the project that was supposed to take 5 days took 2 months.
However, despite everything, Oleg finished the job and was able to deliver a working parser.
Apart from the deadlines, the only thing I can complain about is attentiveness and adherence to the provided technical specifications. After 50 times, I lost count of how many times I had to check the parser and send it back for revisions.
Freelancer's review of cooperation with Kirill Ivannyk
Development of a parser/scraper in Python + SeleniumGood downloader
Completed the project
I will be happy to cooperate
-
5 days300 USD5 days300 USD
Hello Kirill,
I have thoroughly reviewed your technical specifications and the recent update regarding the AdHeart.me codebase. Understanding that this part of the project now requires refinement rather than building from scratch allows me to propose a more efficient timeline.
This project is a perfect match for my skills. As a PCAP™ Certified Python Programmer with direct experience in Selenium Automation and, crucially, Docker, I can deliver the robust, containerized solution you require.
I am confident in handling all specific technical challenges outlined, including:
Modifying the existing AdHeart.me code to parse funnel links.
… Implementing the new parser for the Facebook Ads Library with infinite scroll.
Structuring the data with Pandas and integrating seamlessly with the Notion API.
Delivering a clean, optimized Docker image for easy deployment, as per your non-functional requirements.
My portfolio is available at www.revazgoguadze.com. I am ready to deliver a high-quality, reliable tool for your team.
Best regards,
Revaz Goguadze
-
Winning proposal4 days250 USD
3482 50 0 Winning proposal4 days250 USDGood afternoon
ready to complete this work
Write, I will be happy to help
I will complete your task, we have already communicated with you
-
1 day400 USD
3893 24 0 1 day400 USDGood afternoon,
I am ready to undertake the development of an automated parser. I have experience working with Python and Selenium, as well as the ability to integrate data into Notion via API. Considering the provided code and the need for modifications for AdHeart.me, I believe I can effectively adapt existing functions and develop new ones for the successful completion of the project.
My rate is $16 per hour.
-
3 days300 USD
192 1 0 3 days300 USDHello. I have extensive experience in developing bots for parsing in Python using Selenium. The work can be divided into 3 stages:
1) Data parsing from websites (Selenium, BeautifulSoup)
2) Processing and sorting (Pandas)
3) Sending the result to Notion
I am ready to discuss each step with you to have a general understanding of your task's solution. I will be happy to help, feel free to write!
P.S. The language of communication is at your discretion (Russian, English)
-
4 days400 USD
2558 37 0 4 days400 USDHello!
I will gladly take on your project!
Extensive experience in this.
Write in PM and check the portfolio
-
7 days500 USD
1616 8 0 7 days500 USDHello
I am a developer in the field of ML/DL & Web Scraping. Ready to complete your project. Write to me, let's discuss.
-
11 days300 USD
720 6 1 11 days300 USDMoving on to the essence of the project:
I plan to write my own parsing mechanism, and improve the authorization mechanism from the existing repository.
Briefly describing the robot's algorithm:
1 - Connection to the cloud server and checking session overflow for AdHeart.me (Need to clarify details regarding item 12.5 in the technical specification);
2 - Checking connection to the specified sites;
3 - Collecting information from Notion tables;
3 - Parsing sites using the algorithm specified in the technical specification. Uploading preliminary results to cache (Redis);
4 - Processing and aggregating data;
… 5 - Uploading to a local database (Planning to use PostgreSQL, your preferences are also considered);
6 - Checking Notion API availability;
7 - Uploading from the database to Notion.
I plan to create two versions of the repository (prod & dev) to simplify deployment and containerization. I will write in Python 3.12 (possibly 3.13).
Proposed project structure:
-d services (main algorithms and custom libs)
--d scrape
---Facebook (functions and modules for interacting with Facebook)
---AdHeart (functions and modules for interacting with AdHeart)
---scrape_main (main script for parsing)
--d Notion
---NotionAPI (interaction with Notion)
-d models (models for the database)
-d db
--postgresql (main database)
--redis (cache)
-d .venv (internal environment)
-d requirements (folder with .txt files containing dependencies)
- pyproject.toml (project configuration file)
- docker-compose
- README.md
- .env (environment variables)
- main.py (main project file)
It is necessary to clarify fine details and agree on execution and control procedures. I also want to discuss project stages and their deadlines.
-
7 days500 USD
93843 1268 1 10 7 days500 USDHello. I have extensive experience in developing parsers. Is it necessary to parse FB Ads? They have an API.
-
5 days250 USD
1412 4 0 5 days250 USDHello. I have practical experience with Python, Selenium, data aggregation, and API integrations, including Notion. I'm ready to adapt to the provided codebase and extend it to meet the current requirements efficiently. I focus on stability, maintainability, and clean implementation.
I’d be glad to discuss the technical details further.
-
15 days250 USD
8867 60 0 1 15 days250 USDHello! We are SolidWay and ready to assist with developing an automated parser in Python using Selenium. We have extensive experience in creating such solutions and are confident that we can build an effective parser for collecting data on advertisements.
Our team has already worked with API integration and data parsing, so we have the necessary expertise to complete the tasks. We are prepared to use the existing codebase provided and modify it to achieve your goals.
Let's discuss the project details to determine the scope of work required and how it aligns with your expectations. We will also clarify the timeline and budget after a more in-depth discussion of the task.
-
14 days240 USD
1850 46 3 14 days240 USDHello!
I am interested in your project. I have extensive experience in automation and emulation of user actions (JavaScript, Selenium, Playwright), asynchronous and multi-threaded parsing (Requests, WebSockets, HTTPX, BS4), information processing (Openpyxl, JSON, MySQL, MongoDB, Google Sheets API), as well as in the development of Telegram bots of varying complexity (Telethon, Pyrogram, Aiogram).
Contact me to discuss the details and deadlines for the project.
Current freelance projects in the category Data Parsing
Create a dashboard in https://airtable.com/ for the performance of advertising creatives from Facebook ads.Full specification https://docs.google.com/document/d/1_n_oYRNZWYxalUA---DM5AD1b5ZSrtePw5J4G42svGw/edit?usp=sharing Databases & SQL, Data Parsing ∙ 1 day 3 hours back ∙ 16 proposals |
Creation of an Excel file for uploading products to the websites of other partners.I am interested in creating an Excel table with all parameters. Here is the website - https://heiztechnik.com.ua/ And the positions I am interested in to be transferred: Manual boilers: 1) TIS UNI 15-95 kW (10) pcs 2)TIS HARD 150-500 kW (7) pcs Pellet boilers: 1)TIS PELLET… Data Parsing ∙ 1 day 7 hours back ∙ 34 proposals |
A developer is required for parsing the catalog and automating data import.Detailed technical specifications in the attached document Please indicate the estimated cost and timeline in your response Do you have experience working with parsing large catalogs What possible difficulties or limitations do you see in this task Databases & SQL, Data Parsing ∙ 1 day 10 hours back ∙ 39 proposals |
Find a product feed (Google Merchant XML) for a website on OpenCart
16 USD
It is necessary to find a direct link to the active product feed (XML) of a competitor for Google Merchant Center Platform (CMS): OpenCart / ocStore Find the original feedRequirements for the result: Working link to the XML file Python, Data Parsing ∙ 1 day 15 hours back ∙ 21 proposals |
Parsing products from supermarketsNeed a specialist (parsing + Google Sheets + automation). Goal: Create a system for automatic retrieval and updating of food prices from Silpo and NOVUS supermarkets with data output to Google Sheets. What needs to be implemented: Create a main Google Sheets table with a product… Data Parsing, Information Gathering ∙ 1 day 23 hours back ∙ 46 proposals |
Manhattan