Parsing the results of the HSBC BWF World Tour Finals and compiling the corresponding database. The data is not only collected but also processed before entering the database. Calculations and "inversion" of results are performed in case rows are added not only about the winners but also about the losers.
How the application works:
1. Checks if the database exists - if not, it automatically starts parsing as shown in the screenshot below.
2. Displays the creation time of the CSV file. This is to understand how long ago the last update was.
3. Then launches a "looped" menu that offers:
- to search for data using a specific algorithm (H2H or common opponents).
- to update the database.
- to exit the program.
What are the advantages of the developed solution:
- Step-by-step parsing, which can be easily debugged in case of functionality expansion/modification. The ability to view both "raw" data in JSON and processed data in CSV.
- Works quite quickly, no bans from the website.
- In the settings, it is possible to gradually add other tournaments - the solution is flexible and suitable for development.
In the project, #pandas and #selenium are the main libraries of #python in this project.
How the application works:
1. Checks if the database exists - if not, it automatically starts parsing as shown in the screenshot below.
2. Displays the creation time of the CSV file. This is to understand how long ago the last update was.
3. Then launches a "looped" menu that offers:
- to search for data using a specific algorithm (H2H or common opponents).
- to update the database.
- to exit the program.
What are the advantages of the developed solution:
- Step-by-step parsing, which can be easily debugged in case of functionality expansion/modification. The ability to view both "raw" data in JSON and processed data in CSV.
- Works quite quickly, no bans from the website.
- In the settings, it is possible to gradually add other tournaments - the solution is flexible and suitable for development.
In the project, #pandas and #selenium are the main libraries of #python in this project.