Data Scraper and Automation Specialist Project Overview
100 USDWe're seeking a skilled developer to create an automated system that scrapes car information from a password-protected website based on criteria from a Google Sheet, and posts the results to a specified platform.
Key Responsibilities
Develop a script to read search criteria (make, model, grade, year) from a Google Sheet.
Implement automated login to the website. Create a web scraping solution to search for and extract car information based on the provided criteria.
Develop functionality to post the scraped information to a specified platform or update the Google Sheet with results.
Set up the entire process to run automatically on a scheduled basis.
Required Skills and Experience
Proficient in Python programming
Experience with web scraping libraries (e.g., Selenium, Playwright, or BeautifulSoup)
Familiarity with Google Sheets API
Experience in automating web interactions, including handling logins and session management
Knowledge of best practices for web scraping, including ethical considerations and rate limiting
Ability to implement robust error handling and logging
Experience with scheduling automated tasks
Nice-to-Have Skills
Familiarity with car industry terminology
Experience scraping Japanese websites
Knowledge of CAPTCHA solving techniques
Project Deliverables
A fully functional Python script that accomplishes all steps of the automation process
Documentation on how to set up and run the script, including any necessary API credentials
A guide on how to modify the script for different car criteria or websites in the future
Additional Notes
The successful candidate must be willing to sign a non-disclosure agreement due to the nature of the data being handled.
The solution must be developed with scalability and maintainability in mind.
Regular updates and communication throughout the development process are expected.
Please include in your application your experience with similar projects and your approach to handling potential challenges such as website structure changes or anti-scraping measures.
-
1 day100 USD1 day100 USD
Good day. The task listed above drew my attention, and I am willing to be involved in the process of completing it. I am an experienced python developer with great knowledge of Selenium library, which will most probably be the main one used in the upcoming code. I have completed numerous of tasks from other clients using this library and have a whole other bunch of smaller programmes which I wrote for personal use. Furthermore, I am acknowledged in bypassing different types of CAPTCHA, handling browser sessions, cookies and proxies. I believe that I possess all the necessary skills for this job. I will only be able to evaluate the task after doing research of the exact website. I am looking forward to hearing from you
-
3 days100 USD
814 14 2 3 days100 USDGreetings!
I'm really interested in your project! I have a strong background in Python programming and web scraping, and I've worked a lot with Playwright. Here are a couple of my previous projects (on Ukrainian) that are relevant here:
https://freelancehunt.com/project/napisat-skript/1304561.html
https://freelancehunt.com/project/bot-dlya-marketpleysa/1369556.html
I've done a lot of work involving automated logins, data extraction, and using Google Sheets API. I'm also skilled in managing web interactions and ensuring everything runs smoothly with good error handling and logging.
I'd love to learn more about the specifics of your project, especially the website we'll be working with.
Looking forward to hearing from you!
-
14 days700 USD
956 14 0 14 days700 USDGood day. I have been involved in automating processes on the internet for many years. I solve tasks of increased complexity, tasks requiring interaction between multiple systems. I have extensive experience in scraping, overcoming protections and recaptchas. For an accurate project assessment, details are needed, so the assessment is conditional for now.
-
7 days500 USD
1993 12 0 7 days500 USDGood day
I have extensive experience in developing automation scripts for collecting information, including the ability to authenticate in accounts
Write to me
Current freelance projects in the category Python
Setting up two-way integration of WhatsApp with Odoo CRMHello! We are looking for a specialist to implement a technical task for setting up a two-way integration of the WhatsApp messenger with the Odoo CRM system. ⚠️ Important technical clarification: The official WhatsApp Business API (WABA) is not considered. It is necessary to… Python, Web Programming ∙ 6 hours 48 minutes back ∙ 19 proposals |
Data parsing through mobile APILooking for a person with experience in data parsing through mobile API, for parsing e-commerce, rozetka and similar sites. Tasks: 1. Intercepting traffic from the mobile application (Android), setting up a proxy, analyzing requests. 2. Identifying the necessary API endpoints… Python, Data Parsing ∙ 2 days 3 hours back ∙ 30 proposals |
Find a product feed (Google Merchant XML) for a website on OpenCart
16 USD
It is necessary to find a direct link to the active product feed (XML) of a competitor for Google Merchant Center Platform (CMS): OpenCart / ocStore Find the original feedRequirements for the result: Working link to the XML file Python, Data Parsing ∙ 7 days 12 hours back ∙ 29 proposals |
Development of a TikTok farm (content factory)It is necessary to develop a system for centralized management of multiple TikTok accounts with automatic content publishing, using individual proxies and simulating natural account activity. Functional Requirements1. Account Management Adding and removing TikTok accounts.… Python, Bot Development ∙ 8 days back ∙ 22 proposals |
Improve the performance of Claude Code and work on software development.I am currently developing CRM and Analytics software. I am using Claude Code, but I understand that the results are not the best in terms of changes. There are 2 tasks - Need help creating a preset for skills, MD, and so on to improve quality. Take verified ones that have been… AI & Machine Learning, Python ∙ 8 days 6 hours back ∙ 28 proposals |