Parsers onlyfans
Create a parser in Python for the collection of media content (photo and video) from the web pages of the hhhh models.The parser must be able to automatically log in to the models pages, download the content and structured to store it in the MinIO storage.2ndRequirements: 2.1 Source of data:
Parser will take data from the web pages of hhhh models: hhhh.2.2 Functional requirements:
- Parser must extract links to the OnlyFans model from the Airtable table.The algorithm of the work of the parser: 1.Get a link from Airtable.2ndTransition to the received link.ThreeAutomatic authorization in the account hhh.4 .Search for photo and video content on the model page.and 5.Download photos and video content.The images that can be downloaded must be in jpg format and the video must be in mp4.2.3 Infunctional requirements:
Current events and work errors of the parser must be recorded in the log file.The parser should have an asynchronous performance to optimize the download speed.by asynk2.4 Data storage structure: - The data must be stored in the MinIO object storage.- Structure of papacks: - "Name of the social network" (e.g., hhh) - "Name of the model" (Name of the model or nickname) - "Photo" (for images) - "Video" (for video) 3.Data Export: - The downloaded media content will be stored in MinIO, taking into account the map structure described above.4 .Support for proxy and ReCaptcha: - Parser must support the use of external proxy to ensure anonymity and blockage.The proxy use mechanism must be implemented and adjusted according to the customer’s requirements.- There is a need for the reCaptcha, it is necessary to create an automatic mechanism for its processing.and 5.Authorization on the hhh page: - Parser should be able to automatically authorize on the OnlyFans models pages.For this purpose, the parser must accept the login and password, or use the stored data for authorization.6 .Temporary parsing algorithm: - The parser should be able to regularly check new links from the Airtable table (to daily).If new links are discovered, the parser must automatically start collecting content from the corresponding pages of the xhx models.A mechanism for periodic conversion of the existing content with the new (weekly).7 .Additional details: - If it is necessary to use the paid tools for drops, their selection and use must be agreed with the customer.The entire parser code must be well structured, documented and commented to ensure understanding of its logic and functionality.The documentation must contain instructions on the setting and launch of the Docker container with the parser, as well as a description of the work and use algorithm.It is possible that the parser is based on a selenium web driver, provided that it will work in a docker container.The content must not be repeated.
Current freelance projects in the category Data Parsing
Need a parser for the online store https://www.lcsc.com/It is necessary to regularly (once a month, or upon script launch) obtain up-to-date information about the products available in the store. https://www.lcsc.com/ from the catalog of all sections.… Data Parsing ∙ 10 hours 24 minutes back ∙ 34 proposals |
OpenCart — rental catalog of special equipment
135 USD
OpenCart — Equipment Rental Catalog Need to launch an equipment rental catalog on OpenCart. Theme: excavators cherry pickers forklifts generators cranes scaffolding other construction equipment. It is preferable that you already have a ready-made template or developments… Web Programming, Data Parsing ∙ 1 day 2 hours back ∙ 47 proposals |
Transfer the program - the server where the program was located has crashed (officially permitted parsing of government data)
46 USD
Hello! My client has encountered the case described below. We need help transferring to a new server and testing the program. It would be better to have a programmer who understands parsing. Software & Server Configuration, Data Parsing ∙ 1 day 6 hours back ∙ 29 proposals |
Website parsingImplementation of 4 parsers (directory websites) is required. There is a technical specification, and there is a code example as a reference. The tasks include: Writing a parser Integrating a proxy Deduplication logic (transfer the logic from the example) Hashing logic based… Data Parsing ∙ 2 days 23 hours back ∙ 44 proposals |
Collection (parsing) of product database from supplier websites (Excel / CSV)
226 USD
Collection of product database from supplier websites (Excel / CSV) Good day. A specialist is required to collect and structure data from several supplier websites, access to which will be provided.Task: A unified product database needs to be created in Excel (XLSX) or CSV… Web Programming, Data Parsing ∙ 4 days 6 hours back ∙ 105 proposals |
Ukraine