Development of a map parser and creation of a GUI application

Successfully implemented a large-scale and technically complex data collection project (Web Scraping) from the interactive map of the Urbexology website and developed accompanying software.
What was implemented:
1. Adaptive scanning algorithm (Quadtree Bounding Box): Created a recursive algorithm for traversing the entire globe, which allowed for the collection and deduplication of 597,306 unique locations.
2. Deobfuscation and reverse engineering: Successfully decrypted the custom protection algorithm of the website (XOR + Caesar shift), as well as mathematically restored the actual coordinates of points using sine/cosine index formulas.
3. High-performance multithreaded detail collection: Developed and optimized a 25-thread engine (ThreadPoolExecutor) with safe delays for collecting discussions, comments, and photos without blocking.
4. Relational database: All data structured, linked (Foreign Keys), and stored in an optimized SQLite file (.db) with configured indexes for instant search queries.
5. Premium GUI application (EXE): Developed a native Windows application based on Tkinter in a stylish dark design (Premium Dark Mode) for automatic downloading of media files (65,818 photos) to the local disk. The application supports Pause/Resume, full Stop with state saving, limit selection, and detailed real-time logging.
Project results:
Unique locations collected: 597,306
Photos found: 65,818
Discussions processed: 66,301
Tools: Python, Tkinter, PyInstaller, SQLite, Multithreading, OOP.
#web_scraping #scraping #python #gui #sqlite #reverse_engineering #automation #multithreading #parser #crawler