Launching local LLM llama.cpp + analysis of attention and activations (Windows)
22 USD It is necessary to install a ready-made LLM model and the software for it.
In order to:
✅ run a local LLM (without the internet)
✅ see attention heatmaps
✅ view logits
✅ see layer activations
✅ control generation parameters
✅ analyze the internal workings of the model
The software that needs to be installed for all this to work:
- CMake
- Git
- Visual Studio Build Tools
- Python
There is an installation guide available, assistance is needed with the implementation of this task. Please suggest a price
-
1 day22 USD
2181 10 0 1 day22 USD
I can help you with the installation of this software. I often use Python, Git, and VS in my work, so I can help solve installation issues. CMake is not as common, but installing it is also not a problem. I suggest running the LLM through the Ollama utility - it can be quite conveniently tailored to your needs and provides access to many models for free.
Please let me know if you are only interested in the installation or if you also need to implement some additional program on top of the LLM? If an additional program is needed, please write in more detail about its purpose and desired functionality in private. Thank you!
-
1 day22 USD
46 1 day22 USD
I can install and run llama.cpp on Windows. I will do it today.
Current freelance projects in the category AI & Machine Learning
Create a Chrome plugin for connecting to a proxyCreate a Chrome plugin for connecting to a proxy I am looking for a developer, possibly with AI who has successfully published similar plugins in the store just AI writing without development experience is not needed please send proposals regarding price and deadlines AI & Machine Learning, Web Programming ∙ 1 day 3 hours back ∙ 30 proposals |
Need to transfer the website from Figma + Webflow to code, possibly with AI.Need to transfer the site from Figma + Webflow to code, possibly with AI. If it's possible to do it with AI, with 100% accuracy and without bugs, it's better to do it that way. Please write your price and what experience you have specifically with this task. AI & Machine Learning, AI Art ∙ 1 day 3 hours back ∙ 34 proposals |
AI Video Creator & 3D Artist for Innovative AI-EdTech Project (Radaastrea)
: We are looking for a 3D artist / AI video maker for an innovative AI-EdTech project (Radaastreya)Description: We are creating a large-scale media franchise and concept of an empathetic next-generation AI robot for teenagers — RADAASTREYA. The image is of a wise and bright… AI & Machine Learning, Gaming Apps ∙ 1 day 23 hours back ∙ 1 proposal |
N8n Architecture and Deployment Review
Language Our tech team speaks English, Russian and German. You can choose any of these languages for your text deliverable and the review call. ObjectiveWe operate production-ready AI and document workflows on n8n Cloud that integrate Salesforce with LLMs and document services.… AI & Machine Learning, AI Consulting ∙ 2 days 2 hours back ∙ 19 proposals |
AI agent for collecting and structuring information
89 USD
We need a specialist who has experience in creating automated monitoring systems for websites, news, competitor pages, and industry sources. A simple MVP scenario needs to be developed that will: regularly check a specified list of websites; find new publications, changes on… AI & Machine Learning ∙ 2 days 3 hours back ∙ 36 proposals |
Ukraine