I will set up a private self hosted llm on your own server with your data

Y
yangye1
Y
yangye1
Yang Ye
Einige Informationen werden in englischer Sprache angezeigt.
set up a private self hosted llm on your own server with your data
Vollbild
set up a private self hosted llm on your own server with your data

Über diesen Service

Your data cannot leave the company? I set up private AI on your own server: open-source LLMs running on your GPU, with an API compatible with OpenAI so your apps can use it.


I run this in production: a company AI platform on an in-house NVIDIA GPU server, with chat, agents, RAG over documents and email, and scheduled reports. No data goes to the cloud.


What I set up:

  • Model choice and sizing for your hardware (or advice on what GPU to buy)
  • Inference server (Ollama / vLLM) with an OpenAI-compatible API
  • Private web chat for your team, with users
  • Optional: RAG over your documents and connection to your apps
  • Monitoring, updates and handover documentation

Works on Linux or Windows servers, on-premise or in a private cloud.

  • KI-Engine

    • ChatGPT
    • Claude
    • Mistral AI
    • DeepSeek
    • Meta Llama
    • Hugging Face
    • Ollama

  • Tools & Frameworks

    • LangChain
    • LlamaIndex

  • Art der KI-Lösung

    • KI-Chatbot
    • Lappensystem
    • KI-Assistent
    • Internes KI-Tool

  • Zweck

    • Kundensupport
    • Wissensmanagement
    • Dokumentenverarbeitung
    • Mitarbeiterproduktivität
    • Interne Abläufe

Lerne Yang Ye kennen

Yang Ye

Full Stack and AI Developer, Angular, NodeJS, LLM, RAG, CRM, ERP

4,7(1)
  • AusSpanien
  • Mitglied seitApr. 2023
  • Letzte Lieferung2 Jahre

  • Sprachen

    Chinesisch, Spanisch, Katalanisch, Englisch
Full-stack developer and industrial engineer (MEng). I lead the technology of a software company and build custom business software: CRM/ERP platforms, quoting engines, e-invoicing and dashboards with Angular, Node.js and MySQL. I specialise in putting real AI inside business apps: LLM assistants that act on your data, RAG over documents and email, AI document extraction and private self-hosted models on GPU servers. 8+ years of experience. I speak English, Spanish, Catalan and Chinese.

Mein Portfolio

Meine weiteren Dienstleistungen im Bereich KI-Entwicklung

Verwandte Tags