Website parsing, python
It is necessary to write a site parser, two main tasks:
1. Find the current sitemap (it is definitely present there)
2. Bypass Cloudflare, retrieve data (optionally playwright)
Retrieve 300 rows of data for testing, to start
https://docs.google.com/document/d/10IbXTXdaOu_H4CBhNCTER28ns_eM8komSmef_53UzAk/edit?usp=drivesdk
-
3305 70 1 Hello.
Contact me, I will offer a JavaScript (Puppeteer) solution.
-
792 9 1 Hello! I offer a solution specifically on playwright.
Write to me, we will discuss the details. We will do it in a short time, there is successful experience in parsing various websites/marketplaces.
-
1388 4 0 Good day.
I have completed the test task. How would you prefer to demonstrate the result?
-
3447 28 0 Hello, ready to work with you on a permanent basis. Here are 300 pieces.
Google Drive
-
4154 123 0 For the current task, do you need a parser or just the data? The price in the bid is for 300 lines of parsed data.
-
582 37 0 Hello.
Unfortunately, it is not possible to fully automate parsing through Python due to Cloudflare protection, but a convenient solution can be implemented through a browser script.
How it works:
You open the page in Google Chrome:
https://casinobonusesfinder.de/online-casinos
The script automatically:
Goes through all pages via pagination
Collects data
The result is saved in CSV format:
… URL Title License Rating
https://.../book-of-bet-casino | Book of Bet Casino | Curacao | 10
https://.../axe-casino | Axe Casino | Curacao | 10
https://.../coolzino-casino | Coolzino Casino | Curacao | 10
https://.../duospin-casino | DuoSpin Casino | Anjouan | 9.9
https://.../dragon-slot-casino | Dragon Slot Casino | Curacao | 9.7
-
8753 60 0 1 Good day. I am ready to execute.
I have extensive experience in developing parsers.
I write in Python, I am ranked 2nd on the platform.
I will develop a parser to collect information from the website. I will implement all necessary functionality.
I will find the sitemap. I will configure the bypass for Cloudflare. I will create a user-friendly interface for management.
I will optimize. I will conduct testing and provide documentation.
My portfolio:Freelancehunt
… Write to me, we will discuss the details and I will start working.
-
645 8 1 Good day, I have extensive experience working with parser bots, message me privately to discuss the details, I promise to do everything quickly, and most importantly, with quality!
-
726 9 1 Hello! Your project looks wonderful. I am ready to start working immediately and complete it at a high level.
Current freelance projects in the category Python
AI Commenting Platform for TikTok and Instagram.Project Goal Develop a system that allows managing a large number of TikTok and Instagram accounts and automatically posting relevant comments under selected videos using AI. Main Functionality1. Account Management It is necessary to implement the ability to connect accounts:… AI & Machine Learning, Python ∙ 12 hours 40 minutes back ∙ 13 proposals |
Build a customer classification model1. There is client data in Mongo/SQL (approximately 20,000 entries with raw data). 2. It is necessary to build features and a classification model of clients into behavioral groups based on this data. 3. The project should be completed in Python. AI & Machine Learning, Python ∙ 2 days 6 hours back ∙ 33 proposals |
IT Automation of VAT Reporting
223 USD
It is necessary to develop a system for automating the transfer of sales data from the CRM to the accounting system Wafeq. The system should import bank and payment reports, automatically reconcile payments with invoices, generate invoices for VAT reporting, and minimize manual… AI & Machine Learning, Python ∙ 2 days 12 hours back ∙ 44 proposals |
Account reconciliation tool with the bank, cards, and accountantTechnical Assignment: Tool for Reconciling Accounts with Bank, Cards, and AccountantGeneral Goal A local tool (script/small application in Python) is needed, which is manually run once every 1-2 months on my computer and performs reconciliation between: Invoices I issued to… Python, Desktop Apps ∙ 3 days back ∙ 42 proposals |
Automatic video posting on social media according to a scheduleTechnical Assignment (TA) Automatic video publication on social media according to a scheduleProject Description A script/bot (Python preferred, or any other solution of your choice — the main thing is stability and ease of maintenance) is needed, which automatically publishes… Python, Bot Development ∙ 3 days 12 hours back ∙ 59 proposals |