Data parsing from Coinmarketcap | Python | Senior Specialist
Good afternoon.
We are looking for a Senior specialist or higher with extensive experience in data parsing, preferably in Python, as there is old code written by another developer.
We need to continuously parse data from approximately twenty different resources.
These resources include CoinMarketCap.com, Coingecko.com, Coinsniper.net and export them to Google Sheets and a database.
I would like to know the answers to three questions:
1. Have you ever worked with data parsing in multithreading?
2. Will you be able to parse data and bypass the protection on the site Coinsniper.net (this is an important resource for us)?
For example, such as Cloudflare "Verify yourself as a human," which appears on Coinsniper.net on this site, or other protections against parsing.
3. Have you ever worked with the Google Sheets API?
-
1 day582 USD1 day582 USD
Hello, how often do we need to parse the data?
1. Yes, I can provide examples
2. I have experience bypassing Cloudflare, but I need to study a specific resource further, because websites may have different settings/protection rules
3. Yes, but the Google Sheets API has limits; if we are talking about a large amount of data, we should consider a database
We can discuss further details in private messages. I would be happy to collaborate.
-
5 days582 USD5 days582 USD
Hello!
I will be happy to work on your project.
I will create a bot and fill it with the necessary functionality. I will work until full approval.
Message me privately, and we will discuss the details.
The cost of services is not a dogma, but a reason for discussion. -
7 days582 USD
953 5 0 7 days582 USDHello, Vitalina.
I would be happy to take on your project. I have extensive experience in creating parsers using python+selenium. I have been programming in python for over 4 years and have been involved in data parsing for about 3 years.
1) I have 2 of my multiprocess parsers under constant maintenance.
The first parser has been in existence for 3 years and collects data from 18 B2B portals.
Multiprocessing is implemented through a process manager, which provides high stability and speed of the parser.
I suggest you use a multiprocess parser rather than a multithreaded one.
2) Selenium simulates a real user, checking a box for it is not a problem. More complex protections, such as Google reCAPTCHA, are bypassed through third-party services; I have had to solve such tasks as well.
…
3) I have not worked with the Google Sheets API; it is a standard REST API, and I do not see any difficulties in using it. I have experience with pandas for data cleaning and sorting and creating reports in xlsx format, utilizing all the advantages of spreadsheets - color highlighting, data formatting, etc.
4) I can connect a proxy pool to the parser.
5) The parser can run on a remote server, and the parsing process is not quick. A convenient solution, especially for a team or group, would be to use notifications in a Telegram channel about the parser's operation.
-
7 days581 USD
484 0 1 7 days581 USDHello, Vitalina!
I am an experienced Fullstack developer with extensive experience in data parsing using Python. I will solve your task by optimizing the old code and implementing multithreading to increase the speed of data collection. I will bypass the protection on Coinsniper.net using solutions to circumvent Cloudflare. I also have experience working with the Google Sheets API for convenient export. I guarantee quality and speed of execution!
I look forward to your response!
-
7 days582 USD
445 28 1 7 days582 USDHello, I am ready to implement this project!
I look forward to collaborating!
-
7 days582 USD
1806 34 3 7 days582 USDGood afternoon, I already have experience working with CoinMarketCap and Coingecko.
Write to me in private messages, we will discuss what you need to export to the table.
I have experience working with Google Sheets.
-
7 days582 USD
489 3 1 1 7 days582 USDGood day!
I am interested in your project for data parsing from various resources. Allow me to briefly present my proposal:
Experience and competencies:
Multithreaded parsing: I have significant experience in developing multithreaded and asynchronous parsers in Python using asyncio, aiohttp, and threading, which ensures high speed and efficiency in data collection.
Bypassing protections: I have successfully worked on bypassing various protective mechanisms, including Cloudflare "Verify yourself as a human". I use tools such as Selenium, Playwright, and specialized libraries (cloudscraper) to ensure stable access to protected resources.
…
Integration with Google Sheets API: I have repeatedly implemented integration with Google Sheets through gspread and the official API, ensuring automated data export and updates in spreadsheets.
Approach to the project:
Analysis of existing code: I will familiarize myself with the current codebase to understand its structure and features.
Development and optimization: I will create/improve parsers for 20 resources, ensuring stability and efficiency.
Integration and automation: I will set up automatic data export to Google Sheets and a database on a specified schedule.
Support and monitoring: I will ensure monitoring of parsing processes and quick response to possible failures or changes on the websites.
I would be happy to discuss the details of your project and offer an optimal solution. Please contact me for further discussion!
-
12 days582 USD
2923 26 0 12 days582 USDHello!
I am ready to take on the project. I have experience in data parsing from various resources using Python, including working with multithreading. I can set up data parsing from the list of websites you provided, bypass protection (for example, Cloudflare), and also integrate the export into Google Sheets and a database.
Yes, I have worked with multithreading to speed up parsing.
Bypassing Cloudflare protection — I have experience solving such tasks using anti-captcha or proxy servers.
I have worked with the Google Sheets API, integrating data exports into spreadsheets.
I am ready to start immediately.
-
7 days582 USD
8867 60 0 1 7 days582 USDGood afternoon. I am ready to complete the task.
I have extensive experience in creating parsers.
I code in Python and hold 3rd place on the platform.
I will implement a parser for working with data in multithreading. I will be able to bypass the protection on the required website. I will connect the necessary integrations. I will create a user-friendly interface and optimize it.
My portfolio:Freelancehunt
Write to me, we will discuss the details and I will get started on the work.
-
1 day1164 USD
344 23 1 1 day1164 USDGood evening, I have extensive experience in parsing, sniffing, and reverse engineering, write to me — we will make it happen :)
-
1 day582 USD
3482 50 0 1 day582 USDGood evening
Write to me, I am ready to discuss the details
I reply:
1. Yes, I have worked with multithreading, both in parsing and in other areas
2. Yes, I will be able to bypass it
3. Yes, I have worked with the Google Sheets API
… Write to me
I am ready to work
-
30 days1164 USD
1069 10 0 30 days1164 USDI have extensive experience in scraping and a lot of completed projects using requests (requests, aiohttp) and automation with browsers (playwright, pyppeteer, selenium), bypassing various types of protection (akamai, cloudflare) and captchas (reCAPTCHA, image captcha, geetest icon captcha, geetest v3/v4 slide captcha, hCAPTCHA, tiktok captcha, funcaptcha, worldfirstcaptcha, cloudflare captcha), performing login and data collection under authorization (using cookies, tokens, and sessions).
-
10 days582 USD
6396 74 1 10 days582 USDGood day. I have extensive experience in various parsing, interacting with different APIs, including Google Sheets. I am interested in learning more details about the technical specifications. I would be happy to collaborate.
-
20 days582 USD
342 1 0 20 days582 USDGood day!
I am ready to take on your order. I have experience with multithreaded data parsing, bypassing protections (including Cloudflare), and integration with the Google Sheets API. I can ensure stable data extraction from the specified resources into Google Sheets and a database.
I am ready to discuss the details and get started.
-
13 days582 USD
2731 76 1 13 days582 USDGood evening.
1. I have worked with parsing in multithreading.
2. I bypassed protection but not everywhere. On the site Coinsniper.net, I need to study and test.
3. I am familiar with the Google Sheets API, but I haven't worked with it.
-
Старый парсер работает или нет? Я к тому, что надо решать проблемы с анти-бот системами или дорабатывать функционал?
-
Уже пора перестать страдать хернёй с обходом капчи, и использовать api сервисов.
-
Current freelance projects in the category Data Parsing
Create a dashboard in https://airtable.com/ for the performance of advertising creatives from Facebook ads.Full specification https://docs.google.com/document/d/1_n_oYRNZWYxalUA---DM5AD1b5ZSrtePw5J4G42svGw/edit?usp=sharing Databases & SQL, Data Parsing ∙ 4 hours 2 minutes back ∙ 5 proposals |
Creation of an Excel file for uploading products to the websites of other partners.I am interested in creating an Excel table with all parameters. Here is the website - https://heiztechnik.com.ua/ And the positions I am interested in to be transferred: Manual boilers: 1) TIS UNI 15-95 kW (10) pcs 2)TIS HARD 150-500 kW (7) pcs Pellet boilers: 1)TIS PELLET… Data Parsing ∙ 8 hours 10 minutes back ∙ 23 proposals |
A developer is required for parsing the catalog and automating data import.Detailed technical specifications in the attached document Please indicate the estimated cost and timeline in your response Do you have experience working with parsing large catalogs What possible difficulties or limitations do you see in this task Databases & SQL, Data Parsing ∙ 11 hours 3 minutes back ∙ 29 proposals |
Find a product feed (Google Merchant XML) for a website on OpenCart
16 USD
It is necessary to find a direct link to the active product feed (XML) of a competitor for Google Merchant Center Platform (CMS): OpenCart / ocStore Find the original feedRequirements for the result: Working link to the XML file Python, Data Parsing ∙ 16 hours 20 minutes back ∙ 19 proposals |
Parsing products from supermarketsNeed a specialist (parsing + Google Sheets + automation). Goal: Create a system for automatic retrieval and updating of food prices from Silpo and NOVUS supermarkets with data output to Google Sheets. What needs to be implemented: Create a main Google Sheets table with a product… Data Parsing, Information Gathering ∙ 1 day back ∙ 41 proposals |