Revaz G.

Revaz G.

Winning proposal
36 0
  • Projects 36
  • Rating 5.0
  • Rating 15 973

Budget: 700 USD Deadline: 8 days

Hi JC,

This is a classic MLOps challenge, and your goal to securely share a high-end GPU among your team is the right approach. As a Full-Stack Developer with deep experience in Docker and cloud architecture, I can design a robust and secure system for you.

Simply connecting containers to a GPU is not enough; you need a managed, secure, and isolated environment. Here is the professional architecture I propose:

1. True GPU Isolation with NVIDIA MIG: For the A6000/L40 cards, we will use NVIDIA Multi-Instance GPU (MIG). This partitions the GPU at the hardware level, giving each user a dedicated slice of compute and memory. This is superior to basic time-slicing as it prevents any single user's workload from impacting the performance of others.

2. Centralized Authentication via Traefik Reverse Proxy: I recommend Traefik, a modern reverse proxy that integrates seamlessly with Docker. It will act as the single, secure entry point.

  • Projects 14
  • Rating 3.8
  • Rating 1 371

Budget: 180 USD Deadline: 2 days

Hi JC, this is an interesting challenge, and I'd be happy to help.
I can propose a clean and scalable architecture where each of your 4–6 users runs their own isolated Docker microservice container, all sharing access to a single powerful GPU (like the RTX A6000 or L40).

The architecture will include:

Secure GPU sharing (NVIDIA Container Toolkit + MIG if needed)

Authenticated access per user (via proxy + username/password)

Central proxy to control access to external AI services (ensuring privacy)

  • Projects 20
  • Rating 5.0
  • Rating 9 264

Budget: 1000 USD Deadline: 10 days

Вітаю
Маю досвід з:
- NVIDIA MIG конфігурацією
- Docker GPU sharing
- NGINX proxy setup
- Authentication системами

Можу запропонувати архітектуру на базі:
- MIG партиціонування GPU
- Docker Compose з GPU device mapping

  • Projects -
  • Rating -
  • Rating 99

Budget: 1300 USD Deadline: 8 days

Hello!
This setup needs careful handling, but I can take care of it. Each user will have a private container. All containers will share one GPU without conflict. I can set up secure login so only your team can access it. AI traffic will be sent using a single protected connection to keep your keys safe.
It is a complex task, but I have some experience with similar systems before. Once it's ready, it will run smoothly without much effort from your side.

Proposals concealed

The list does not show proposals concealed by the client or freelancer with a Plus profile, as well as proposals violating rules

Current freelance projects in the category AI & Machine Learning

11:53
5 July
5 July
5 July
4 July