Development and deployment of a local LLM for classification and data extraction
Create an isolated microservice based on Open Source LLM for automatic processing of incoming documents (scans, PDF, photos).
2. Tasks of the executor
Hosting selection: Choose the optimal GPU hosting (for example, Hostkey, Selectel, RunPod, Lambda Labs or similar) considering the budget and performance requirements.
Model selection and configuration: It is recommended to use Llama 3.1 8B, Mistral Small 3 or Qwen 2.5. The use of quantized versions (4-bit/8-bit) is acceptable for resource savings.
Classification (5 types): The model must determine the type of document (for example: CTC, PTC, Passport, Contract, Invoice).
Data extraction: For each type of document, configure the extraction of key fields (for example, VIN, Full Name, document number, date).
API Development: Create a REST API (FastAPI/Flask) for uploading the document and receiving a JSON response.
3. Technical requirements
OCR layer: If the document is submitted as an image, a quality OCR must be configured (for example, EasyOCR, Tesseract or DocTR).
Inference engine: Use vLLM or Ollama to ensure high processing speed and support for queues.
Containerization: The entire stack (API + Model + OCR) must be packaged in Docker.
4. Output data format
The API must return structured JSON:
{
"class": "vehicle_registration",
"confidence": 0.95,
"data": {
"vin": "ABC123456789",
"reg_number": "X000XX77",
"year": 2022
},
"processing_time": "1.2s"
}-
какие типы документов будут обрабатываться. В идеале пример показать
-
Current freelance projects in the category AI & Machine Learning
Consultation on creating an AI agent to accelerate the resolution of routine tasks - 60 minutes
16 USD
Consultation on creating an AI agent to speed up the resolution of routine tasks. I have created an agent for automatic contract filling - it's simple, but there are more complex tasks that I would also like to delegate to GPT agents, and there are several questions I would like… AI & Machine Learning ∙ 19 hours 5 minutes back ∙ 13 proposals |
Automatic posting of stories on InstagramGood day, I need help with setting up automatic posting of stories on Instagram. There are already stories in the Instagram archive that have been published, and they need to be reposted. AI & Machine Learning, Bot Development ∙ 2 days 4 hours back ∙ 24 proposals |
Creation of an AI assistant for communication with ClientsIt is necessary to create an AI assistant for communication with Clients. The chat window will be located on our website, followed by communication with the bot. Questions about products, settings, capabilities, etc. In cases where the information is unknown or the request can… AI & Machine Learning, AI Consulting ∙ 2 days 23 hours back ∙ 35 proposals |
I am looking for a video editor who creates AI videos.Creation of AI videos for dentists and other experts Objective: To create short vertical videos for Instagram Reels, Facebook Reels, TikTok, and YouTube Shorts that explain complex topics in simple language and hold the viewer's attention through a combination of AI animation… AI & Machine Learning ∙ 3 days 7 hours back ∙ 2 proposals |
I am looking for a mentor/teacher for ComfyUI for online learning (working through RunPod)
16 USD
Hello. I am looking for a practicing specialist and mentor who can help me master working with ComfyUI. The main feature of my request is that the work will be done entirely in the cloud, without downloading the program to a local computer. I plan to rent a graphics card through… AI & Machine Learning ∙ 3 days 17 hours back ∙ 1 proposal |