Universal Web Scraper CLI Tool (Python, OOP)
Developed a flexible CLI utility for web data scraping. Instead of hardcoding scripts for specific sites, the tool accepts target URLs and selectors (HTML tags and classes) directly via an interactive terminal, dynamically extracting content.
Technical Details:
Architecture: Strict OOP approach with separated modules for scraping logic, data exporting, and CLI.
Interface: Interactive terminal built with the rich library, featuring colored logging, progress bars, and live table previews.
Export: Supports saving scraped data into machine-readable .csv format (via pandas) or formatted ASCII tables in .txt files.
Reliability: Includes network exception handling and input validation.
#python #Backend #CLI #beautifulsoup4 #pandas
Technical Details:
Architecture: Strict OOP approach with separated modules for scraping logic, data exporting, and CLI.
Interface: Interactive terminal built with the rich library, featuring colored logging, progress bars, and live table previews.
Export: Supports saving scraped data into machine-readable .csv format (via pandas) or formatted ASCII tables in .txt files.
Reliability: Includes network exception handling and input validation.
#python #Backend #CLI #beautifulsoup4 #pandas