Custom LLMs without sharing compute
Running large language models (LLMs) on Salad provides a convenient, cost-effective solution to deploy various applications without worrying about infrastructure. Host your personal, proprietary LLMs without sharing compute, protecting your data/prompts from being trained on.
Have questions about SCE for your workload?
Discuss your use case with our team to see if SCE is fit for you.
Run popular models or bring your own
LLM Inference Hosting
As more LLMs are optimized to serve inference on GPUs with lower vRAM, Salad's network of RTX/GTX GPUs with the lowest GPU prices can save you thousands of dollars - offering enhanced efficiency and reduced costs.
Custom LLMs with UI
Deploy custom LLMs to 1000s of GPUs at the lowest prices, scaling easily at an affordable cost. Bring your models to life with a user-friendly UI, such as HuggingFace ChatUI.
Enterprise Chatbots
Run your own Retriever-Augmented Generative (RAG) models with LangChain and Ollama to query your enterprise's own data. Deploy/scale popular models in a customizable, cost-effective way with Text-Generation Inference (TGI).
