Настроить Scrapy для парсинга сайта

Task: You need to perform a test parsing and collect a database of Telegram channels in the niche of trading and cryptocurrency. Requirements for channels: • Theme: trading, futures, scalping, signals, smart money, trading bots, trading education, cryptocurrency, BTC, ETH, etc. • Language: Russian and Ukrainian. • Number of subscribers: 300 - 8000. • Channels can be either public or private (with application submission). • It is preferable to pay attention to live audience, not inflated subscribers. Keywords for search: Trading, Futures, Long, Short, Scalping, Fibonacci, Indicators, Trading Bot, Smart Money, Bitcoin, Crypto, Trading Strategy, How to earn in crypto, and other relevant terms. What is needed as a result (test phase): • A table in Excel/Google Sheets for approximately 200–300 channels. • Columns: • Link to the channel • Channel name • Number of subscribers • Approximate assessment of the live audience (if possible) • Growth over the last month (if possible) • Type of channel (public/private) • Link to chat (if available) • Brief theme (for example: signals, news, education, scalping, reviews, etc.) If the result of the test parsing satisfies me, we will continue with a larger volume (500-700 channels). Budget: negotiable Deadline: 2–4 days (Possibly more if more time is needed) Work through a secure deal. Examples of previous work on parsing Telegram channels are welcome.

A specialist is needed to collect and structure open information about sellers from marketplaces. It is necessary to determine the possibility of automated data collection and to form a database of sellers. In your response, please indicate: which marketplaces you have experience working with; what data you can obtain (seller name, link, categories, rating, number of products, other available fields); examples of similar projects.

Collection of links to sources with rental housing advertisements It is necessary to compile a database of links to groups, channels, forums, and platforms where rental housing advertisements are published in major cities of Europe and the USA. Goal: to find sources where advertisements for short-term, medium-term, and long-term rentals, subleases, rooms, studios, apartments, and lease takeovers regularly appear. Cities: Start with: Paris, Geneva, Zurich, Berlin, Amsterdam, Barcelona, Madrid, Milan, London, New York, Los Angeles, San Francisco, Boston, Chicago, Miami. Other major cities can be added if there are good sources. What sources to look for: Facebook groups/pages Telegram public channels Reddit communities / search links Craigslist links, especially for US cities Local forums and classified websites University/student housing boards Expat communities Instagram pages of agencies, coliving, student housing, rental communities X/Twitter search links Other public pages where people post rental offers What to include in the table: City Country Platform: Facebook / Telegram / Reddit / Craigslist / Forum / Website / Instagram / Other Source name URL Type of rentals: room / apartment / sublet / short-term / long-term / student housing / expat housing Language Is it public? Yes/No Estimated activity: high / medium / low Notes Important: Do not collect personal data of individuals. Do not copy the actual advertisements. Only public links to sources are needed. Check that the link opens. Do not add duplicates. Priority is given to active sources with fresh posts in the last 30 days. Expected result: Google Sheet / Excel file with at least 300–500 relevant links. For each city, it is desirable to find at least 20–40 good sources.

Technical task Project Configuration of filling and synchronization of two Prom.ua stores with suppliers of auto parts. Task It is necessary to implement the loading and updating of products from auto parts suppliers for two online stores on Prom.ua. ⸻ 1. Connecting suppliers It is necessary to connect suppliers through: Supplier API; XML, CSV, XLS price lists; or another available method of obtaining products from the supplier's website. It is important to ensure complete synchronization of products between the supplier and the Prom.ua stores. ⸻ 2. Filtering and selection of products It is necessary to implement the ability to select products during import based on the following parameters: Car brand; Category of parts; Subcategory of parts; Other available characteristics. Example: For each store, there should be the ability to separately determine which categories of products and which car brands need to be loaded. Additional requirements for product selection It is necessary to implement the ability to select products during import not only by car brands and categories of parts but also by product availability status. There should be the ability to configure the following scenarios: Import only products that are in stock with the supplier; Do not import products with the status "out of stock"; Disable or remove products from Prom.ua after they are out of stock with the supplier. During pricing configuration, there should be the ability to combine filters: By car brand; By category of parts; By subcategory; By product availability. Example: Import only parts for Volkswagen and Audi, category "Braking system", that are in stock with the supplier. It is also necessary to implement a mechanism to prevent duplication of products from different suppliers. If the same product is present with multiple suppliers, only one product record should be imported into the catalog. Criteria for selecting a product when duplicates are detected: Priority is given to the product that is in stock with the supplier; If the product is in stock with several suppliers, priority is given to the product with the lowest price; If the cheapest product is out of stock, the system should choose the cheapest product among those that are in stock; Duplicate products from other suppliers should not create separate entries in the catalog. Example: Import only parts for Volkswagen and Audi, category "Braking system", that are in stock with the supplier. If the same part is available from several suppliers, only one entry is imported into the catalog — from the supplier with the lowest price among those who have the product in stock. ⸻ 3. Import of product cards During import, the following should be automatically loaded: Product name; Article; Photos; Product description; Price; Product characteristics; Manufacturer; Other available parameters. ⸻ 4. Updates It is necessary to set up automatic: Price updates when changed by the supplier ⸻ 5. Removal of unavailable products Products that are no longer in stock with the supplier should: Be disabled; or Be removed from Prom.ua (by agreement). ⸻ 6. Filling the stores It is necessary to: Create a category structure; Create subcategories; Correctly distribute products across categories; Check the correctness of product import. ⸻ 7. Work results After the work is completed, there should be: Suppliers connected; Product import configured; Price updates configured; New product addition configured; Disabling or removal of unavailable products configured; Prom.ua stores fully filled and ready for operation.

A Telegram bot is needed for automatic searching and monitoring of "BUY IT NOW" cars at auctions in the USA (Copart, IAAI). The bot should operate automatically and send notifications about new cars that meet the specified filters.Main functionalityFilter settings: 1. Car brand; 2. Model; 3. Year of manufacture (from/to); 4. Fuel type; 5. Engine volume; 6. Mileage; 7. Price range; Bot functions: 1. Automatic monitoring of new lots; 2. Checking for updates every 1-2 minutes; 3. Protection against duplicate notifications (anti-duplicate); 4. Ability to add and remove filters through the bot menu; 5. Saving settings of already existing car searches. Message format: 1. Photo of the car (4 photos); 2. Title and lot number; 3. Year of manufacture; 4. Mileage; 5. Engine type and volume; 6. Buy it now price; 7. Link to the lot.