Web chat bot with "live" Live2D avatar (OpenAI + ElevenLabs + PixiJS)

Bot Development, Javascript and Typescript — incorrectly specified categories?

Project translated automatically. Log in or register, to view the original

We are creating a brand chat-bot for a container service website. The text is generated by OpenAI,

voice-over — ElevenLabs. On the front end in the browser, a Live2D avatar should be displayed

(Schlaubi truck) with mouth synchronization based on viseme events.

Current status

--------------

✓ There is a working Node.js prototype (Express + ws).

✓ Live2D model assembled in Cubism Editor (PSD, moc3, textures).

✓ Deployed on Fly.io, but TTS-viseme and mouth animation are not yet linked.

What needs to be done

-----------------

1. **Backend**

• Convert ElevenLabs TTS request to stream + viseme JSON.

• Send viseme events via WS to the browser.

• Optimize latency (20-30% faster).

2. **Frontend**

• Load model (`*.model3.json`) via live2dcubismpixi.umd.js (SDK 4).

• Create mapping viseme → parameters `ParamMouth*` in the model.

• Implement smooth interpolation + fallback (blinking, smile).

3. **Deployment**

• Build Docker image, test on dev and prod (Fly.io).

• Update README with instructions `fly deploy --no-cache`.

Technologies

----------

Node.js 18+, Express, ws, Axios, PixiJS 6, Live2D Cubism SDK 4 (web),

Docker, Fly.io, Git.

• Acceptance — when the page on production loads in ≤ 3 seconds before the first word

and the mouth is synchronized in 95% of phrases.

When responding, please send:

• 2-3 examples of your projects with Live2D / WebGL / TTS.

• Briefly describe how you will solve the latency + viseme task.

Proposals 5 Withdrawn 1

Please select

Andrey K.

1 286 1

Budget: 350 EUR Deadline: 7 days

Hello. I have extensive experience with Node.js. Ready to help with the backend

Roman Shmatkov

0 0

Projects -
Rating -
Rating 295

Budget: 500 EUR Deadline: 1 day

Good day, we are engaged in the development in the field of artificial intelligence, including Python, turnkey website development, web development, website layout on PHP, frameworks Laravel, HTML, CSS, including WordPress. We develop websites on PHP, frameworks on Laravel, and mobile applications for iOS and Android turnkey.

We develop websites on PHP and mobile applications for iOS and Android.
We have experience in creating CRM/ERP systems.
We are ready to execute your order turnkey.
We develop websites on WordPress and mobile applications for iOS and Android. The total development experience is 7 years. We are ready to execute your order turnkey.
1. Projects
https://berkanaplus.com.ua/ - This site was migrated and the server was configured.
2. https://leondesign.kyiv.ua/
PHP version updates and plugin updates.
3. https://peg.com.ua/
Development of a new module for the site for dynamic product price updates.
https://uvali.com.ua/
Configuring a dedicated VPS server. 📈 Internet marketing and promotion:
Setting up advertising on Google Ads, Facebook, TikTok
SEO and copywriting

Promotion through push notifications and in-app advertising

Marketing analytics, A/B testing, campaign optimization
📈 Internet marketing and promotion:
Setting up advertising on Google Ads, Facebook, TikTok
SEO and copywriting
🎨 Design solutions:
In-house design department
UI/UX design, branding, advertising creatives

Yelisey H.

7 0

Budget: 450 EUR Deadline: 7 days

Good day!

I am ready to bring your prototype to a production-ready state within 7 working days:

What you will receive
Backend: transition of TTS requests from ElevenLabs to a stream with JSON-viseme, sending visemes via WebSocket, latency optimization (20–30%)
Frontend: loading the model (*.model3.json) through live2dcubispixi.umd.js, mapping viseme → ParamMouth, smooth interpolation + fallback (blinking, smiling)
Deployment: Docker image for Fly.io, instructions for fly deploy --no-cache, testing on dev/prod

Term: 7 working days
Cost: 450 EUR

Ready to start today — write to me!