Welcome!
We are the SEO-checker project, which allows SEO specialists to scan and analyze Google SERP.
After the latest Google update, we are looking for a specialist who could restore the functionality of the script that collects website positions in search engines.
Project description (latest working version):
SEO-Checker - a SaaS platform built using JavaScript, Go, Python.
Front-End SPA application on Vue.js
API (actually back-end for frontend) written in GO, standard REST for processing requests from the client side
Databases - Postgres, Redis
Infrastructure - AWS + Terraform
SERP Service - consists of 2 parts, a simple service in Python and a Crawler for parsing Google in Python + Playwright + Scrapy.
The logic of the SERP scan works as follows: the client enters the application, selects a project, and starts the scan by clicking a button, a request is sent to the main backend, the request creates a couple of records in the Postgres DB (for tracking the scan) and sends a message to the AWS SQS queue, this queue is listened to by the SERP service, when it receives a new task, it generates tasks for the Crawler (for each keyword from the project) and puts them in Redis, the Crawler pulls these tasks from Redis and executes them, for each task it puts the result in Redis pub/sub which the SERP service listens to and then saves them in persistent storage (Postgres).
All of this is deployed on AWS via Terraform
