Switch to English?
Yes
Переключитись на українську?
Так
Переключиться на русскую?
Да
Przełączyć się na polską?
Tak
Post your project for free and start receiving proposals from freelancers within minutes after publication!

Data parsing from Coinmarketcap | Python | Senior Specialist

Translated582 USD

  1. 9532
     25  0

    1 day582 USD

    Hello, how often do we need to parse the data?

    1. Yes, I can provide examples
    2. I have experience bypassing Cloudflare, but I need to study a specific resource further, because websites may have different settings/protection rules
    3. Yes, but the Google Sheets API has limits; if we are talking about a large amount of data, we should consider a database

    We can discuss further details in private messages. I would be happy to collaborate.

  2. 480
     4  0

    5 days582 USD

    Hello!
    I will be happy to work on your project.
    I will create a bot and fill it with the necessary functionality. I will work until full approval.
    Message me privately, and we will discuss the details.

    The cost of services is not a dogma, but a reason for discussion.

  3. 953    5  0
    7 days582 USD

    Hello, Vitalina.
    I would be happy to take on your project. I have extensive experience in creating parsers using python+selenium. I have been programming in python for over 4 years and have been involved in data parsing for about 3 years.

    1) I have 2 of my multiprocess parsers under constant maintenance.
    The first parser has been in existence for 3 years and collects data from 18 B2B portals.
    Multiprocessing is implemented through a process manager, which provides high stability and speed of the parser.
    I suggest you use a multiprocess parser rather than a multithreaded one.

    2) Selenium simulates a real user, checking a box for it is not a problem. More complex protections, such as Google reCAPTCHA, are bypassed through third-party services; I have had to solve such tasks as well.

    3) I have not worked with the Google Sheets API; it is a standard REST API, and I do not see any difficulties in using it. I have experience with pandas for data cleaning and sorting and creating reports in xlsx format, utilizing all the advantages of spreadsheets - color highlighting, data formatting, etc.

    4) I can connect a proxy pool to the parser.

    5) The parser can run on a remote server, and the parsing process is not quick. A convenient solution, especially for a team or group, would be to use notifications in a Telegram channel about the parser's operation.

  4. 484    0  1
    7 days581 USD

    Hello, Vitalina!

    I am an experienced Fullstack developer with extensive experience in data parsing using Python. I will solve your task by optimizing the old code and implementing multithreading to increase the speed of data collection. I will bypass the protection on Coinsniper.net using solutions to circumvent Cloudflare. I also have experience working with the Google Sheets API for convenient export. I guarantee quality and speed of execution!

    I look forward to your response!

  5. 445    28  1
    7 days582 USD

    Hello, I am ready to implement this project!
    I look forward to collaborating!

  6. 1806    34  3
    7 days582 USD

    Good afternoon, I already have experience working with CoinMarketCap and Coingecko.
    Write to me in private messages, we will discuss what you need to export to the table.
    I have experience working with Google Sheets.

  7. 489    3  1   1
    7 days582 USD

    Good day!

    I am interested in your project for data parsing from various resources. Allow me to briefly present my proposal:

    Experience and competencies:

    Multithreaded parsing: I have significant experience in developing multithreaded and asynchronous parsers in Python using asyncio, aiohttp, and threading, which ensures high speed and efficiency in data collection.

    Bypassing protections: I have successfully worked on bypassing various protective mechanisms, including Cloudflare "Verify yourself as a human". I use tools such as Selenium, Playwright, and specialized libraries (cloudscraper) to ensure stable access to protected resources.

    Integration with Google Sheets API: I have repeatedly implemented integration with Google Sheets through gspread and the official API, ensuring automated data export and updates in spreadsheets.

    Approach to the project:

    Analysis of existing code: I will familiarize myself with the current codebase to understand its structure and features.
    Development and optimization: I will create/improve parsers for 20 resources, ensuring stability and efficiency.
    Integration and automation: I will set up automatic data export to Google Sheets and a database on a specified schedule.
    Support and monitoring: I will ensure monitoring of parsing processes and quick response to possible failures or changes on the websites.
    I would be happy to discuss the details of your project and offer an optimal solution. Please contact me for further discussion!

  8. 2923    26  0
    12 days582 USD

    Hello!
    I am ready to take on the project. I have experience in data parsing from various resources using Python, including working with multithreading. I can set up data parsing from the list of websites you provided, bypass protection (for example, Cloudflare), and also integrate the export into Google Sheets and a database.
    Yes, I have worked with multithreading to speed up parsing.
    Bypassing Cloudflare protection — I have experience solving such tasks using anti-captcha or proxy servers.
    I have worked with the Google Sheets API, integrating data exports into spreadsheets.
    I am ready to start immediately.

  9. Mykhailo Pavlov SolidWay
    8867    60  0   1
    7 days582 USD

    Good afternoon. I am ready to complete the task.
    I have extensive experience in creating parsers.
    I code in Python and hold 3rd place on the platform.

    I will implement a parser for working with data in multithreading. I will be able to bypass the protection on the required website. I will connect the necessary integrations. I will create a user-friendly interface and optimize it.

    My portfolio: Freelancehunt
    Write to me, we will discuss the details and I will get started on the work.

  10. 344    23  1
    1 day1164 USD

    Good evening, I have extensive experience in parsing, sniffing, and reverse engineering, write to me — we will make it happen :)

  11. 3482    50  0
    1 day582 USD

    Good evening

    Write to me, I am ready to discuss the details

    I reply:
    1. Yes, I have worked with multithreading, both in parsing and in other areas
    2. Yes, I will be able to bypass it
    3. Yes, I have worked with the Google Sheets API

    Write to me
    I am ready to work

  12. 1069    10  0
    30 days1164 USD

    I have extensive experience in scraping and a lot of completed projects using requests (requests, aiohttp) and automation with browsers (playwright, pyppeteer, selenium), bypassing various types of protection (akamai, cloudflare) and captchas (reCAPTCHA, image captcha, geetest icon captcha, geetest v3/v4 slide captcha, hCAPTCHA, tiktok captcha, funcaptcha, worldfirstcaptcha, cloudflare captcha), performing login and data collection under authorization (using cookies, tokens, and sessions).

  13. 6425    74  1
    10 days582 USD

    Good day. I have extensive experience in various parsing, interacting with different APIs, including Google Sheets. I am interested in learning more details about the technical specifications. I would be happy to collaborate.

  14. 342    1  0
    20 days582 USD

    Good day!

    I am ready to take on your order. I have experience with multithreaded data parsing, bypassing protections (including Cloudflare), and integration with the Google Sheets API. I can ensure stable data extraction from the specified resources into Google Sheets and a database.

    I am ready to discuss the details and get started.

  15. 2737    76  1
    13 days582 USD

    Good evening.
    1. I have worked with parsing in multithreading.
    2. I bypassed protection but not everywhere. On the site Coinsniper.net, I need to study and test.
    3. I am familiar with the Google Sheets API, but I haven't worked with it.

  16. Another 7 proposals concealed
  • Vitaly T.
    6 January 2025, 21:33 |

    Старый парсер работает или нет? Я к тому, что надо решать проблемы с анти-бот системами или дорабатывать функционал?

  • Profile blocked
    6 January 2025, 21:45 |

    уже год не включался
    думаю, надо будет дорабатывать 
    решать сложности, да 

  • Vitaly T.
    6 January 2025, 21:50 |

    ну эти, считай, делать с нуля)

  • Vladimir B
    6 January 2025, 22:01 |

    Уже пора перестать страдать хернёй с обходом капчи, и использовать api сервисов.

  • Aleksey Avdiyenko
    7 January 2025, 13:20 |

    из 3 два дают айпи, а 1 не дает, думаю в этом весь вопрос

Current freelance projects in the category Data Parsing

Create a bot for checking links on FB

225 USD

There is a Google Doc with links uploaded on FB. It is needed for the bot to analyze the doc for published posts and provide a daily report.

Data ParsingBot Development ∙ 2 hours 39 minutes back ∙ 34 proposals

Creation of an Excel file for uploading products to the websites of other partners.

I am interested in creating an Excel table with all parameters. Here is the website - https://heiztechnik.com.ua/ And the positions I am interested in to be transferred: Manual boilers: 1) TIS UNI 15-95 kW (10) pcs 2)TIS HARD 150-500 kW (7) pcs Pellet boilers: 1)TIS PELLET…

Data Parsing ∙ 3 hours 20 minutes back ∙ 18 proposals

A developer is required for parsing the catalog and automating data import.

Detailed technical specifications in the attached document Please indicate the estimated cost and timeline in your response Do you have experience working with parsing large catalogs What possible difficulties or limitations do you see in this task

Databases & SQLData Parsing ∙ 6 hours 13 minutes back ∙ 27 proposals

Find a product feed (Google Merchant XML) for a website on OpenCart

16 USD

It is necessary to find a direct link to the active product feed (XML) of a competitor for Google Merchant Center Platform (CMS): OpenCart / ocStore Find the original feedRequirements for the result: Working link to the XML file

PythonData Parsing ∙ 11 hours 29 minutes back ∙ 19 proposals

Parsing products from supermarkets

Need a specialist (parsing + Google Sheets + automation). Goal: Create a system for automatic retrieval and updating of food prices from Silpo and NOVUS supermarkets with data output to Google Sheets. What needs to be implemented: Create a main Google Sheets table with a product…

Data ParsingInformation Gathering ∙ 19 hours 19 minutes back ∙ 38 proposals

Client
Profile blocked


Project published
1 year back
293 views
Tags
  • python
  • Google Sheets