Optimize parsing

Hello Alex!
I am writing a parser in Python.
I can help you with this.

Show original

Translate

Good day!
I reviewed the task - the problem is not with parsing, but with the architecture: there are too frequent calls to Google Sheets in the code (several API requests every few seconds), which triggers the limits and the system stops.
I can fix it:
- implement buffering of records
- move the main storage to SQLite/CSV
- leave Google Sheets only for periodic synchronization
- set up stable operation 24/7 without hangs
I am ready to implement it quickly and make the system reliable. We can discuss the details.

Show original

Translate

Good day! I am ready to optimize your parsing for stable operation 24/7. I will solve the problem with Google Sheets (stops/limits) — either by optimizing the recording through batching and caching, or by transferring the storage to a file/SQLite for maximum reliability. I will set up an efficient data collection pipeline with error handling, logging, and auto-restart in case of failures. As a result, you will receive a stable system without data loss that operates continuously. I can also offer scaling for large volumes. I am ready to discuss the details and start immediately.

Show original

Translate

Hello! The problem of Google Sheets stopping during parsing 24/7 is well known to me — it is a result of exceeding quotas (Rate Limits) and network instability. I am ready to optimize your software, making it truly autonomous.

Show original

Translate

Good day!

The problem is clear — the overload of Google Sheets and the lack of data buffering, which makes the system unstable 24/7.

I can solve:

SQLite or file buffer instead of permanent records
batch sending to Google Sheets to reduce load
data queue between parsing and writing
… optimization of statistics recalculation
auto-restart of Selenium in case of failures

I have experience with Selenium and parsing/automation tasks.
I can provide my CV if necessary.

Show original

Translate

Hello! I have experience optimizing parsing with Google Sheets (reasons for stops: request limits, timeouts, large data volume). Solution: move storage to SQLite or CSV files with rotation, set up retries on errors, create logging for 24/7 monitoring. I can rewrite the logic for saving to a file or SQLite with auto-connection. We will discuss the details after reviewing the current code. I am looking for long-term work. I await your message in private!

Show original

Translate

Hello! I am an individual developer with 4 years of experience in automation (n8n, Python) and working with big data, so I will optimize your parsing by transferring it from unstable Google Sheets to a fault-tolerant architecture using SQLite or local file storage. I will eliminate the issue of stops due to API limits, set up log rotation, and ensure stable operation 24/7 on a VPS through PM2 or Docker, so that processes are not interrupted; I work through a sole proprietorship and am ready to develop a reliable data storage scheme today. My works: https://3magency.co/, https://jk-solution.com.ua/, https://farfieworldwide.com/, Behance.

Show original

Translate

Hello. Your current script stops because it uses Google Sheets improperly: with each update, it tries to recalculate the entire data array, hitting timeouts and strict API limits. For stable operation 24/7, I will change the saving logic. I will move all the heavy parsing history to a lightweight local database to unlock Selenium's operation, and I will only send updated statistics and a small slice of the latest games to Google Sheets purely for visualization. This will completely relieve the unnecessary load from the network, the script will stop hanging while waiting for a response from Google, and it will operate autonomously. I am ready to implement this architecture quickly and without a total rewrite of your main code.

Show original

Translate

Hello. I looked at the task and I see the approach here is quite clear: the problem is likely not only in parsing, but in the connection with Google Sheets and data storage. I can quickly analyze the current logic, eliminate the bottleneck, and bring it to a more stable scheme so that it works properly 24/7. If it turns out that it's better to move storage to SQLite or a file, I will also do that without unnecessary complications.

Show original

Translate

Hello.

I am ready to work on optimization. I have experience with parsers that need to operate reliably 24/7, and with such tasks, I usually start by addressing architectural bottlenecks rather than just "tweaking timings."

From your current script, it is already clear that the problem is likely not only in the parsing itself but also in the combination of Selenium + constant writes/updates in Google Sheets + real-time statistics recalculation. In this form, it can indeed stop or degrade over time.

What I can offer:
— to change the saving to a local SQLite/file as the main source;
— to separate Google Sheets into a separate batch synchronization, rather than in a critical stream;
… — to stabilize the operation cycle 24/7;
— if necessary, to simplify/rewrite the problematic part to make the solution more reliable.

I can quickly review the current implementation and suggest a proper working option without unnecessary complications.

Show original

Translate

Hello.

I reviewed your script and see that the problem lies not only in parsing. In the current cycle, the script simultaneously reads the History table, writes new rows to Google Sheets, then reads Results again to control the volume, and separately recalculates all statistics from history. Due to this scheme, the process starts to hit frequent calls to the Sheets API and becomes unstable during long runs.

I would approach this as a task for stabilizing the 24/7 mode: first, identify the bottleneck in the parsing → saving → updating statistics chain, then carefully separate the hot cycle and background updates so that the script does not stop during a long run. I will also check what exactly causes the most load — writing to the table, trimming old rows, or a complete recalculation of statistics.

I already see the problem and can provide a working solution without unnecessary rewriting of the entire project.

Show original

Translate

Hello! I am ready to complete this project and have extensive experience in developing various applications.

Show original

Translate

I glanced through the code, I will do it easily.
I will do it right now.

Show original

Translate

Hello. I reviewed the code, I see places where it can be improved. I will be happy to help, feel free to reach out.

Show original

Translate

Good day!
I have experience in optimizing parsers, working with Google Sheets, files, and SQLite, as well as translating similar processes to more stable data storage for continuous operation.
I have dealt with tasks where it was necessary to eliminate stops, reduce the load on Google Sheets, and build a more reliable saving scheme with a view to continuous operation 24/7.
I suggest discussing the details, as well as the cost and deadlines in private messages.

Show original

Translate

Hello! I see issues with freezing due to frequent requests to Google Sheets and overloaded Selenium parsing (repeated searches for elements, sleep, handling stale elements), so I suggest optimizing data collection (waiting through WebDriverWait, reducing requests to the DOM), adding buffering and batch requests for Sheets, or moving the storage to SQLite/file, which will significantly increase the speed and stability of the work.

Show original

Translate

I will do it in js or kotlin, we will install it on the VPS and it will work 24/7. If the attached script is already working, then we can put it on the VPS.

Show original

Translate

Hello.

I have experience with Google Sheets. I can write a script for you. Write to me, we will discuss.

Show original

Translate

I have experience with parsers. I am ready to offer solutions and fix/rewrite your code in private. Corrections and improvements to your script are free of charge. Fast and inexpensive. I will be waiting for our collaboration.

Show original

Translate

Good day. I have extensive experience in parsing and recording Google Sheets, as well as various databases. A more detailed description of the errors or what exactly needs to be collected is required. Judging by the script, parsing by HTML tags is not stable in itself. In the table, you can write a lot of data in one entry, thus bypassing the limits. Contact me, we will discuss. The price and deadline are conditional.

Show original

Translate

Hello!
I will rewrite your script to meet your needs.
Contact me for details in private.

Show original

Translate

Hello. I have extensive experience with Python. I am ready to change the way data is stored to SQLite.

Show original

Translate

Good day!
I am ready to optimize your parsing. I will solve the issue of stops in Google Sheets or suggest an alternative way to save data in a file/SQLite, ensuring stable operation 24/7. I have extensive experience with APIs, Google Sheets, and databases.

Write to me, and we will discuss the details.

Show original

Translate

Hello! Your project looks very interesting. I am ready to start working immediately and ensure high quality.

Show original

Translate

We can optimize your parsing for continuous operation 24/7. We are ready to offer several solutions: transferring data storage from Google Sheets to a local file or SQLite — this will eliminate the problem of script stoppages and significantly increase stability. We will also set up automatic recovery of the parser's operation in case of errors, monitoring, and logging. All processes will run on a separate server under the supervision of an uninterrupted control system. We are ready to take this on as comprehensive support.

Show original

Translate