Parsers of vacations
Scheme of data transmission
The source indeed.com parsim --> to the intermediate BD on the same hosting (control) --> add to the BD site of the aggregator of vacancies for external hosting
Parking is necessary:
The title
The description
The dates
Name of the company
Website of the company
Address (the country and the city)
The data is on 2 pages, the main and on the details page.
The volume of parsing is small - once a day not more than 30-50 pages
I will send you a detailed TZ.Show examples of prices.• • • • • •
Parser is needed on hosting WITH VPS - ordinary standard hosting
You need to choose solutions that do not include: separate or virtual servers, additional programs that you need to install on your local computer.The parser start and setting must be accessible to the user by correction in the files.All parser files must be stored in a separate folder on the host.• • • • • •
Parsers I order for several years, here is a list of problems that arise and which should be avoided:
- the TZ has written the hosting parameters in advance, but the executor after the start of the project asks to change the hosting
The method of storing data is written in advance, but the executor then asks to change the method of storing data.
- in the TZ is written in advance where the data will be exported, but the executor then cannot do so
- complex and unstable process of launching the parser (started once, you need to download special programs to the local computer to launch)
-
Крайне рекомендую указать в описании проекта то, что сайт находится на серверах CloudFlare.
-
Без разници где находится сайт. Просто надо использовать прокси для запросов и проблем не будет, так как если даже сайт спрятан не за CloudFlare, в чем проблема самостоятельно настроить nginx? А когда положат единственный IP в blacklist то неважно кто это сделает CloudFlare, nginx или руками
-
Current freelance projects in the category Data Parsing
Need a parser for the online store https://www.lcsc.com/It is necessary to regularly (once a month, or upon script launch) obtain up-to-date information about the products available in the store. https://www.lcsc.com/ from the catalog of all sections.… Data Parsing ∙ 12 hours 25 minutes back ∙ 36 proposals |
OpenCart — rental catalog of special equipment
135 USD
OpenCart — Equipment Rental Catalog Need to launch an equipment rental catalog on OpenCart. Theme: excavators cherry pickers forklifts generators cranes scaffolding other construction equipment. It is preferable that you already have a ready-made template or developments… Web Programming, Data Parsing ∙ 1 day 4 hours back ∙ 52 proposals |
Transfer the program - the server where the program was located has crashed (officially permitted parsing of government data)
46 USD
Hello! My client has encountered the case described below. We need help transferring to a new server and testing the program. It would be better to have a programmer who understands parsing. Software & Server Configuration, Data Parsing ∙ 1 day 8 hours back ∙ 29 proposals |
Website parsingImplementation of 4 parsers (directory websites) is required. There is a technical specification, and there is a code example as a reference. The tasks include: Writing a parser Integrating a proxy Deduplication logic (transfer the logic from the example) Hashing logic based… Data Parsing ∙ 3 days 1 hour back ∙ 44 proposals |
Collection (parsing) of product database from supplier websites (Excel / CSV)
226 USD
Collection of product database from supplier websites (Excel / CSV) Good day. A specialist is required to collect and structure data from several supplier websites, access to which will be provided.Task: A unified product database needs to be created in Excel (XLSX) or CSV… Web Programming, Data Parsing ∙ 4 days 8 hours back ∙ 105 proposals |
Praha