Parsing restaurant menus from websites like UberEats to our site on WP

Budget: 500 UAH Deadline: 1 day

Hello!

I am interested in your project, I have extensive experience in asynchronous/multithreaded parsing using proxies (Requests, Websockets, AioHTTP, HTTPX, BS4) and emulating user actions (Selenium/Playwright).

I also use my own proxy pool for seamless parsing.

Contact me to discuss the details and deadlines for this project!
The cost is discussed individually.

Budget: 10000 UAH Deadline: 10 days

Send what needs to be received, I will make an example, take a look and then we will discuss further. Thank you. Also Puppeteer. We will discuss the cost if it suits.

Budget: 20000 UAH Deadline: 20 days

Good day, I am ready to engage in your interesting project.
To solve the task of parsing menus from Doordash and UberEats websites, considering that they block standard methods.

Here is an example of an algorithm that can be used:

1. Headless browser (for example, Puppeteer or Playwright):

These tools emulate user actions by loading pages with frontend and content. This allows bypassing the blocks used to protect against bots (for example, dynamic content loading via JavaScript).

2. Parsing algorithm:

Step 1: Load the restaurant page using Puppeteer/Playwright. This allows waiting for the full loading of all elements, including the menu, which may be dynamically loaded.

Collect data about the restaurant (name, address, etc.) using DOM selectors.

Extract the menu (dish names, prices, dish categories, and descriptions). This can be done by analyzing the HTML structure of the page, as menus on these sites are usually dynamically loaded via JavaScript.

Convert the data into the required JSON format that you will provide!!!!

Save the results locally or send them to your server.

3. Optimization and parallelization:

Since this involves 50,000 restaurants, the process needs to be parallelized (for example, running several Puppeteer/Playwright sessions simultaneously).

It is important to control the number of requests per second to avoid IP blocking. You can also use a proxy server to distribute the load and mask requests.

4. Issues that may arise:

CAPTCHA blocking or Rate Limiting at the site level, which may appear after several requests from one IP.

The HTML structure of the sites may change, which may require adapting the parser.

5. Additional technologies:

Bypassing CAPTCHAs: services like 2Captcha can be used to automatically solve CAPTCHAs if they appear.

Using proxies: to reduce the risk of account blocking and to distribute the load for parsing, dynamic or rotating proxies can be used. Expand