Web/Data Scraper Engineer
Skilled Web/Data Scraper Engineer with 4 years of experience in designing, developing, and optimizing web scraping systems to collect, process, and analyze large-scale data. Proficient in utilizing Python-based frameworks (e.g., Scrapy, BeautifulSoup) and headless browsers (e.g., Puppeteer, Selenium) for automated data extraction from complex web structures. I adept at implementing robust scraping solutions for structured and unstructured data, while ensuring data quality and integrity through intelligent parsing and validation. Strong knowledge of API integration, data pipelines, and ETL processes, with experience in scaling scraping infrastructure using cloud services such as AWS. Effective at collaborating with cross-functional teams to deliver actionable insights that drive business decisions.
Key Skills:
* Web Scraping & Crawling (Scrapy, Requests, Puppeteer, Playwright, anti-detect browser, captcha solution)
* Data Pipelines & ETL Workflows
* API Integration & Automation
* Database Management (MongoDB, PostgreSQL, MySQL)
* Data Analytics & Visualization
