Website parsing, python
It is necessary to write a site parser, two main tasks:
1. Find the current sitemap (it is definitely present there)
2. Bypass Cloudflare, retrieve data (optionally playwright)
Retrieve 300 rows of data for testing, to start
https://docs.google.com/document/d/10IbXTXdaOu_H4CBhNCTER28ns_eM8komSmef_53UzAk/edit?usp=drivesdk
-
3336 70 1 Hello.
Contact me, I will offer a JavaScript (Puppeteer) solution.
-
792 9 1 Hello! I offer a solution specifically on playwright.
Write to me, we will discuss the details. We will do it in a short time, there is successful experience in parsing various websites/marketplaces.
-
1424 4 0 Good day.
I have completed the test task. How would you prefer to demonstrate the result?
-
3469 28 0 Hello, ready to work with you on a permanent basis. Here are 300 pieces.
Google Drive
-
4200 123 0 For the current task, do you need a parser or just the data? The price in the bid is for 300 lines of parsed data.
-
575 37 0 Hello.
Unfortunately, it is not possible to fully automate parsing through Python due to Cloudflare protection, but a convenient solution can be implemented through a browser script.
How it works:
You open the page in Google Chrome:
https://casinobonusesfinder.de/online-casinos
The script automatically:
Goes through all pages via pagination
Collects data
The result is saved in CSV format:
… URL Title License Rating
https://.../book-of-bet-casino | Book of Bet Casino | Curacao | 10
https://.../axe-casino | Axe Casino | Curacao | 10
https://.../coolzino-casino | Coolzino Casino | Curacao | 10
https://.../duospin-casino | DuoSpin Casino | Anjouan | 9.9
https://.../dragon-slot-casino | Dragon Slot Casino | Curacao | 9.7
-
8867 60 0 1 Good day. I am ready to execute.
I have extensive experience in developing parsers.
I write in Python, I am ranked 2nd on the platform.
I will develop a parser to collect information from the website. I will implement all necessary functionality.
I will find the sitemap. I will configure the bypass for Cloudflare. I will create a user-friendly interface for management.
I will optimize. I will conduct testing and provide documentation.
My portfolio:Freelancehunt
… Write to me, we will discuss the details and I will start working.
-
670 8 1 Good day, I have extensive experience working with parser bots, message me privately to discuss the details, I promise to do everything quickly, and most importantly, with quality!
-
738 9 1 Hello! Your project looks wonderful. I am ready to start working immediately and complete it at a high level.
Current freelance projects in the category Python
Development of software with AIIt is necessary to develop software for automatic detection, capturing, and tracking of an object using a video camera and a rotating mechanism.Output data: Video camera with optics. Rotating device on two axes (azimuth/elevation angle). Servomotors controlled via Modbus… AI & Machine Learning, Python ∙ 26 minutes back ∙ 4 proposals |
Technical Specification for Refinement of AI Bot for Generating Personalized SongsTECHNICAL TASK FOR IMPROVING THE AI PERSONAL SONG GENERATOR BOTMAIN GOAL Create a stable premium product that: generates the highest quality personal songs; does not fabricate facts about the client; works stably under load; is easily scalable; allows for analysis and… Python, Bot Development ∙ 1 hour 31 minutes back ∙ 13 proposals |
Excel Specialist / Process Automation (Excel + preferably programming)We are looking for a specialist with ADVANCED knowledge of Excel to optimize the existing file and automate processes. It will be a great advantage if you also have programming skills / VBA / Power Query / Power Automate or experience in creating complex logic in Excel. Project… Python, Databases & SQL ∙ 4 hours 30 minutes back ∙ 24 proposals |
Automation of processes through API and PythonBelow I described the current process and the result I would like to achieve. I also attach files of the real process to better understand how it looks in reality Current process Currently, the entire process is performed manually: uploading/downloading files, transferring… AI & Machine Learning, Python ∙ 5 hours 31 minutes back ∙ 29 proposals |
A bot needs to be created in Telegram for subscription payment.
45 USD
A bot needs to be created in Telegram where users can subscribe for access to the webcams located in the yard. Organize payment for two types of subscriptions (monthly and daily) in the bot. The bot should automatically check the payment and then provide access links. Python, Bot Development ∙ 18 hours 17 minutes back ∙ 71 proposals |