Python Scraping Specialist

Data Parsing, Python — incorrectly specified categories?

Project translated automatically. Log in or register, to view the original

Need Python code to get content from the site viagogo.com

Get the title of the page 100 times. Without using Selenium

In the future, this code is planned to make several thousand requests per hour.

Need something similar to what is shown in the screenshot below - but it should work


import requests
import re


url = "https://www.viagogo.com/Concert-Tickets/Pop-Rock/Post-Grunge/Linkin-Park-Tickets/E-156203727"
for i in range(100):   
    response = requests.get(url, timeout=10)
    match = re.search(r'<title>(.*?)</title>', response.text)  
    if match:
        title = match.group(1).strip()
        print(title)

Proposals 9 Withdrawn 1 Discussions 2

Danish M.

20 0

Budget: 1000 UAH Deadline: 1 day

Hello, I can implement a parser in JS, feel free to contact me.
My stack: JS, TS, ReactJS, NextJS, SCSS...

Good evening! I am ready to take on this task, ready to complete the assignment quickly and efficiently. I have extensive experience in writing parsers of various complexities, and I understand well how to work best with queries. I would be happy to collaborate!

Olksandr Kazarov

3 1

Projects 3
Rating -
Rating 449

Budget: 8200 UAH Deadline: 7 days

I propose to develop a solution for parsing content from the website viagogo.com with the aim of obtaining the page title, which will be scalable and optimized for handling thousands of requests per hour.

What will be done:
Basic functionality:

Obtaining the page title using the requests library.
Bypassing blocks using User-Agent rotation and proxies.
Optimization for a large volume of requests:

Asynchronous request handling using aiohttp for high performance.
Integration of proxy server rotation and random headers (User-Agent).
Resilience:

Handling possible errors (e.g., blocks or timeouts).
Logging results and errors for debugging.
Advantages of the solution:
High execution speed due to asynchronous requests.
Resilience to blocks thanks to proxies and dynamic headers.
Scalability for handling thousands of requests per hour.
Ready to implement the solution, provide the source code, and instructions for use. Write to discuss the details!