Fix the parser in Python
It is urgent to finalize the article parser. There are some errors and inaccuracies in the implemented code, here is the code:
https://github.com/0-EternalJunior-0/-autonewsparser
There is a more up-to-date version in archive format (the developer started, almost finished, and then disappeared, and the deadlines are tight, it was supposed to be submitted the day before yesterday of the last month), I will send it in a private message. It may be necessary to fix a few bugs there, and everything will work as we need.
More details - in a private message. But just in case, below is the original task for correcting the above code (in the archive, part or most of this may already be done).
New necessary API commands:
1.
A command is needed to request N articles by an arbitrary WHERE query
it can be named anything, type POST
input data:
{
“where”:{
“field1”:”value1”,
“field2”:”value2”,
“field3”:”value3”
},
“limit”:10
}
the limit value can be anything, but it can be restricted to something, for example 100… if limit is not provided - return 1 article (by default)
in where any fields can be passed, the values are written in string (for universality)... I hope, “1” and 1 when querying the database will be considered the same value and will not cause an error… before forming the query, all passed where parameters need to be checked for existence in the table, for example, using
SHOW COLUMNS FROM articles
or
DESCRIBE articles
and if any field does not exist, return an error
based on the data, a query to the DB is formed like
SELECT * FROM articles WHERE field1=’value1’ AND field2=’value2’ AND field3=’value3’ LIMIT 10
all WHERE parameters are combined using AND
and all results with all fields are returned in the API request response… do not remove any fields from the response, return all that exist
2.
A command for arbitrary editing of an article by id is needed
it can be named anything, type POST
input data:
{
“set”:{
“field1”:”value1”,
“field2”:”value2”,
“field3”:”value3”
},
“id”:1
}
before forming the query, all passed set parameters need to be checked for existence in the table, for example, using
SHOW COLUMNS FROM articles
or
DESCRIBE articles
and if any field does not exist, return an error
it is also necessary to block the transmission of id in the set section, and return an error if id is found there
“set”:{
“id”:”2”
},
this is a clear error, id cannot be changed
based on the data, a query to the DB is formed like
UPDATE articles SET field1=’value1’, field2=’value2’, field3=’value3’ WHERE id=1
in the API request response, it is enough to return a 200 code for a successful operation, and another code with a description of the error if something went wrong
IMPORTANT:
I will be adding fields and indexes to the articles table, so both commands need to work with any fields, current and future, and not be limited to the current table structure.
Client's review of cooperation with Maksim Magerko
Fix the parser in PythonEverything is fine, thank you very much, very prompt, we continue our cooperation.
Freelancer's review of cooperation with Vladimir Makarov
Fix the parser in PythonClear task, understanding from the client, and promptness in responses. Openness to ideas, quick interaction at all stages. Satisfied with the collaboration and planning to continue working!
-
792 9 1 Hello, I will do it by the evening, waiting for the full code in private messages!
Thank you for your attention.
-
1540 3 0 Hello! I have extensive experience in developing parsers! I am ready to help you complete the task!
-
1045 10 0 I will make fixes in the best way. Experience with databases and APIs for over three years.
-
97052 1277 1 10 Hello. I have extensive experience in developing Telegram bots. I am ready for collaboration.
-
44 Hello! I have experience in FastAPI and databases. I can complete this task today or tomorrow.
-
319 2 1 I am interested in your project! I have experience in developing parsers! I will do everything quickly and efficiently!
Current freelance projects in the category Data Parsing
Set up the module "Automatic Price List Processing. v.9.5".The store on OcStore 2.3 has the module "Automatic Price List Processing. v.9.5" installed. Everything is set up by the module author, but there are currently some configuration issues that I cannot figure out and understand the logic of the module's operation. For example,… Online Stores & E-commerce, Data Parsing ∙ 17 hours 27 minutes back ∙ 20 proposals |
Pricing of auto parts from suppliers for auto parts websites based on Prom.Technical task Project Configuration of filling and synchronization of two Prom.ua stores with suppliers of auto parts. Task It is necessary to implement the loading and updating of products from auto parts suppliers for two online stores on Prom.ua. ⸻ 1. Connecting… Data Parsing ∙ 1 day 5 hours back ∙ 44 proposals |
Database parsing
45 USD
Channel requirements: 1. Content language: Russian or Ukrainian (mixed RU/UA content is allowed) 2. Number of subscribers: At least 500 subscribers 3. Activity: The last post published no later than 32 hours ago 4. Comments: Comments must be open under the posts (through a group… Databases & SQL, Data Parsing ∙ 1 day 6 hours back ∙ 30 proposals |
It is necessary to develop a Telegram bot for monitoring cars from auctions in the USA (Copart, IAAI)A Telegram bot is needed for automatic searching and monitoring of "BUY IT NOW" cars at auctions in the USA (Copart, IAAI). The bot should operate automatically and send notifications about new cars that meet the specified filters.Main functionalityFilter settings: 1. Car… Data Parsing, Bot Development ∙ 2 days 7 hours back ∙ 93 proposals |
Parsing products, preparation for import to WPScrape the full catalog of these websites: https://svit-mebliv.ua/ https://kompanit.com.ua/ru https://amia.com.ua/ https://mebliromax.com.ua/ https://pehotin.com.ua/catalog/ https://www.sokme.ua/ru/ All products need to be combined into one general table for import into WP.… Web Programming, Data Parsing ∙ 5 days back ∙ 62 proposals |