Server for AI Models
You need to make a server to launch AI models by API. Currently there are 2 models that can be launched by a console command. Time of execution: 5 to 60 seconds.
The main requirements:
1) line for requests for each of the models
2) Stability of work
3) Logging of server events
For more understanding please read the following examples:
HTTPS://dev.to/tanmoysarkar/deploy-ai-models-with-rabbitmq-message-broker-31a3
HTTPS://towardsdatascience.com/serving-deep-learning-algorithms-as-a-service-6aa610368fde
-
501 5 1 2 Good Morning,
You described the task that involves creating a server to launch AI models through the API with the following basic requirements:
1 .Settings for requests to each of the models: This is important for sharing and managing requests to different models.You can use line technology, such as RabbitMQ or Apache Kafka, to implement this functionality.The 2ndWorking stability: Server stability ensures error management, preserving the status of requests and possible reboot of models in the event of an accident.You can use containers such as Docker to isolate the model environment and Kubernetes or Docker Compose to orchestrate containers.3 .Server Events Logging: Log collection and analysis will help you track the server status and detect errors.You can use logging tools such as ELK Stack (Elasticsearch, Logstash, Kibana) or simply logging in the file.To accomplish this task, we can use programming languages such as Python or Node.js, and frameworks to create APIs such as Express.js.
Write to me to discuss the next steps.Congratulations to Michael!
-
682 6 0 I would implement on a different steak of technologies than those noted in the examples.
Flask - Basic Server
flask_restx - an extension to build a full app
Redis - Message Broker
Celery - for the processing of background tasks including the launch of AI tasks.
Questions remain open:
How do you want to see the logging?
- User authentication
-
сервер уже есть?
-
Current freelance projects in the category Python
Creation of a Human AI Assistant for Telegram groups### 1.1. Key Concept of the System The system must perform two main functions: #### 1. Client Communication Analysis The AI assistant must automatically analyze all communication in Telegram groups and understand the context of the conversation. In particular, the system… AI & Machine Learning, Python ∙ 8 hours 42 minutes back ∙ 15 proposals |
Black Ukraine (RP-project on base MTA)
1162 USD
|
Betting needs to create a bookmaker! WITH EXPERIENCEIt is necessary to develop a betting platform / bookmaker product based on a ready-made template. The main task is to adapt the template for a full-fledged bookmaker office: connect parsing of sports events and odds, implement a user personal account, balance, bets, transaction… Python, Web Programming ∙ 9 hours 18 minutes back ∙ 16 proposals |
Telegram automation of message distribution in chatsNeed to send messages to Telegram chats. To avoid bans. There are several hundred chats. To configure the frequency and variability of texts. Python, Bot Development ∙ 9 hours 29 minutes back ∙ 22 proposals |
Development of software with AIIt is necessary to develop software for automatic detection, capturing, and tracking of an object using a video camera and a rotating mechanism.Output data: Video camera with optics. Rotating device on two axes (azimuth/elevation angle). Servomotors controlled via Modbus… AI & Machine Learning, Python ∙ 1 day 16 hours back ∙ 16 proposals |