Langchain + TypeScript + Openai

Javascript and Typescript — incorrectly specified categories?

112 USD

Project translated automatically. Log in or register, to view the original Technical tasks 1 .Introduction to: The project consists in creating a new code based on the existing code on TypeScript (scripts/ingest-web.ts) on the basis of langchain.The new code should be able to create a base of embeddings on the text sections and also ensure that this base is relevant when re-started.The 2ndReview of Requests: The software must have the following functions and capabilities: - Cyclic passage through all text sections available at https://www.uscis.gov/policy-manual/table-of-contents. Create embeddings from the text of each section and record them into a vector database.Check the number of tokens in the text.If the number of tokens exceeds 15,000, then the embeddings must be divided into parts, each of which will contain no more than 15,000 tokens.Creating a hash from the text or using another corresponding method of comparing the text when re-start.If the text has changed, the signatures must be re-generated.3 .Architecture and Components: The software must have the following structure and basic components: - Main component: the ingest-web.ts file, modified to implement new requirements.- Database component: a vector database in which embeddings will be recorded.and 4.The Interface: Software must interact with external systems and third-party programs as follows: - Interact with the website at https://www.uscis.gov/policy-manual/table-of-contents to get the text of sections.Integration with the database for embeddings recording.and 5.The Security: The software must meet the following security requirements and data protection mechanisms: Protection of data stored in the vector database from unauthorized access.- Protection against possible vulnerabilities and attacks, such as injections or overfillment of the buffer.6 .The Testing: The software must be tested using the following test plan: - Automated testing to verify the creation of embeddings and their recording into the database.- Testing productivity to assess the time required to create embeddings and record them into the database.7 .Risk and Project Management: There are the following possible risks and ways to manage them: - Risk: Change the structure of the website by linking https://www.uscis.gov/policy-manual/table-of-contents. Management: Regular monitoring of changes in the page structure and update the code according to your needs.- Risk: Data security infringement of a vector database.Management: Use data protection mechanisms such as encryption and access authorization.8thResources and Schedule: For the implementation of the project, the following resources are available: - A team of developers, which includes developers, testers Please specify if you have any questions or need additional information.

Proposals Discussions 2

Serhii Piven
Dnepr, Ukraine

Projects -
Rating -
Rating 47

Langchain + TypeScript + Openai

Proposals are currently absent

Proposals are currently absent

Current freelance projects in the category Javascript and Typescript

Automation based on Google Sheets for signing up for trial classes (online language school)

Fix the opening of Trust Wallet when clicking the link in the TikTok profile header.

Development of Telegram Mini App (RPG Game)

Automation of creating vertical videos of one type using a plugin in After Effects.