Help deploy open source AI model

Hello!
I can select a fast open-source AI model (for example, Llama 3 8B or similar) and help with deployment, including through SambaNova or other cloud services.
Which service do you plan to use?

Show original

Translate

Hello!
I will be happy to help with on-prem deployment of the appropriate model and its configuration.

Show original

Translate

Hello!) We have experience deploying various LLM models (LLaMA, Mistral, Gemma, Phi, DeepSeek) both locally and through Ollama, vLLM, Replicate, and HuggingFace. We will help select a fast open-source model suitable for your task, deploy it, and optimize it for your infrastructure (including considering restrictions or specifics of platforms like SambaNova). The task is not difficult but quite specific and requires clarification of all details. We are ready to start immediately after agreeing on all the nuances.

Show original

Translate

It would be good to describe what equipment you have for deployment. Describe what the local AI is needed for (maybe there are more suitable models). What shell do you plan to install? And most importantly, why are the models not from HuggingFace.

Show original

Translate

Hello!
Need to clarify: where exactly do you want to deploy - is there an environment or does it need to be set up?
And what is the main goal of the deployment - just inference, chat, integration with something?

Show original

Translate

Good day! My name is Roman, I am an AI/ML engineer-consultant.

🔹 Current role – engineer-consultant at the Uzbek startup SWAZE
🔹 Previously – developed AI solutions for Rozetka.com.ua

🔹 Portfolio – Freelancehunt
🔹 Rating – top 5 in the "AI and Machine Learning" category on Freelancehunt

Show original

Translate

Hello

I am a developer in the field of AI/ML. I can complete your project. Write to me, let's discuss.

Show original

Translate