Hello.
If you read what is below and are confident that you can fix this error, then I will send you a 2-minute video, without sound, in which there is code for detailed familiarization.
This task is for someone who has experience with Selenium, possibly even without it.
Because requests are made to Google through Selenium. Selenium opens Google search pages. 7 pages. On them, I even counted 62 results manually.
A function that processes and retrieves the necessary data. And this is simply the URL of the site.
And nothing more. It does not retrieve all the data. URL 62. But for some reason, it takes 52.
The words of the programmer who tried to fix this error:
In your case, there is a file (gsearch... something, I don't remember), in which there is a function that retrieves links from the search engine. I added logging output there, it works fine, it displays all available links - in our case - all 62 pieces. In utils.py, there is a function get_google_search_results_alt(), in which we do not understand why we get 56-57 pieces instead of those 62.
The problem, as I saw, was after moving to the second page (using pagination to navigate), on which we lose 4 links, and therefore in the final version we get 56-57 pieces, although Selenium retrieves them all.
Perhaps there is some limitation in the function get_google_search_results_alt, or maybe it checks something and in the final version removes these links, possibly due to the link format, possibly due to other issues - I have not understood yet.
The developer can add logs if necessary, it is not that difficult to do.
If you are not sure that you can solve this problem. Then I allow you to first connect to my code and take a look. If you are confident that you can solve this problem. Then just let me know. Then I will accept you into the project and allocate funds for the project. I can also accept you into the project right away, it is not a principle for me.
