Fix the parser in Python
It is urgent to finalize the article parser. There are some errors and inaccuracies in the implemented code, here is the code:
https://github.com/0-EternalJunior-0/-autonewsparser
There is a more up-to-date version in archive format (the developer started, almost finished, and then disappeared, and the deadlines are tight, it was supposed to be submitted the day before yesterday of the last month), I will send it in a private message. It may be necessary to fix a few bugs there, and everything will work as we need.
More details - in a private message. But just in case, below is the original task for correcting the above code (in the archive, part or most of this may already be done).
New necessary API commands:
1.
A command is needed to request N articles by an arbitrary WHERE query
it can be named anything, type POST
input data:
{
“where”:{
“field1”:”value1”,
“field2”:”value2”,
“field3”:”value3”
},
“limit”:10
}
the limit value can be anything, but it can be restricted to something, for example 100… if limit is not provided - return 1 article (by default)
in where any fields can be passed, the values are written in string (for universality)... I hope, “1” and 1 when querying the database will be considered the same value and will not cause an error… before forming the query, all passed where parameters need to be checked for existence in the table, for example, using
SHOW COLUMNS FROM articles
or
DESCRIBE articles
and if any field does not exist, return an error
based on the data, a query to the DB is formed like
SELECT * FROM articles WHERE field1=’value1’ AND field2=’value2’ AND field3=’value3’ LIMIT 10
all WHERE parameters are combined using AND
and all results with all fields are returned in the API request response… do not remove any fields from the response, return all that exist
2.
A command for arbitrary editing of an article by id is needed
it can be named anything, type POST
input data:
{
“set”:{
“field1”:”value1”,
“field2”:”value2”,
“field3”:”value3”
},
“id”:1
}
before forming the query, all passed set parameters need to be checked for existence in the table, for example, using
SHOW COLUMNS FROM articles
or
DESCRIBE articles
and if any field does not exist, return an error
it is also necessary to block the transmission of id in the set section, and return an error if id is found there
“set”:{
“id”:”2”
},
this is a clear error, id cannot be changed
based on the data, a query to the DB is formed like
UPDATE articles SET field1=’value1’, field2=’value2’, field3=’value3’ WHERE id=1
in the API request response, it is enough to return a 200 code for a successful operation, and another code with a description of the error if something went wrong
IMPORTANT:
I will be adding fields and indexes to the articles table, so both commands need to work with any fields, current and future, and not be limited to the current table structure.
Client's review of cooperation with Maksim Magerko
Fix the parser in PythonEverything is fine, thank you very much, very prompt, we continue our cooperation.
Freelancer's review of cooperation with Vladimir Makarov
Fix the parser in PythonClear task, understanding from the client, and promptness in responses. Openness to ideas, quick interaction at all stages. Satisfied with the collaboration and planning to continue working!
-
792 9 1 Hello, I will do it by the evening, waiting for the full code in private messages!
Thank you for your attention.
-
1540 3 0 Hello! I have extensive experience in developing parsers! I am ready to help you complete the task!
-
1069 10 0 I will make fixes in the best way. Experience with databases and APIs for over three years.
-
93808 1266 1 10 Hello. I have extensive experience in developing Telegram bots. I am ready for collaboration.
-
44 Hello! I have experience in FastAPI and databases. I can complete this task today or tomorrow.
-
319 2 1 I am interested in your project! I have experience in developing parsers! I will do everything quickly and efficiently!
Current freelance projects in the category Data Parsing
Create a dashboard in https://airtable.com/ for the performance of advertising creatives from Facebook ads.Full specification https://docs.google.com/document/d/1_n_oYRNZWYxalUA---DM5AD1b5ZSrtePw5J4G42svGw/edit?usp=sharing Databases & SQL, Data Parsing ∙ 3 hours 25 minutes back ∙ 5 proposals |
Creation of an Excel file for uploading products to the websites of other partners.I am interested in creating an Excel table with all parameters. Here is the website - https://heiztechnik.com.ua/ And the positions I am interested in to be transferred: Manual boilers: 1) TIS UNI 15-95 kW (10) pcs 2)TIS HARD 150-500 kW (7) pcs Pellet boilers: 1)TIS PELLET… Data Parsing ∙ 7 hours 33 minutes back ∙ 23 proposals |
A developer is required for parsing the catalog and automating data import.Detailed technical specifications in the attached document Please indicate the estimated cost and timeline in your response Do you have experience working with parsing large catalogs What possible difficulties or limitations do you see in this task Databases & SQL, Data Parsing ∙ 10 hours 26 minutes back ∙ 29 proposals |
Find a product feed (Google Merchant XML) for a website on OpenCart
16 USD
It is necessary to find a direct link to the active product feed (XML) of a competitor for Google Merchant Center Platform (CMS): OpenCart / ocStore Find the original feedRequirements for the result: Working link to the XML file Python, Data Parsing ∙ 15 hours 42 minutes back ∙ 19 proposals |
Parsing products from supermarketsNeed a specialist (parsing + Google Sheets + automation). Goal: Create a system for automatic retrieval and updating of food prices from Silpo and NOVUS supermarkets with data output to Google Sheets. What needs to be implemented: Create a main Google Sheets table with a product… Data Parsing, Information Gathering ∙ 23 hours 32 minutes back ∙ 41 proposals |