Tech Explorer Logo

Search Content

Tag: vllm

Total 2 articles
Open-Sourcing DeepSeek Inference Engine: A New Chapter in AI Infrastructure Community Collaboration
Open-Sourcing DeepSeek Inference Engine: A New Chapter in AI Infrastructure Community Collaboration
deepseek vLLM inference engine MoE

"DeepSeek open-sources its inference engine with vLLM integration, featuring expert parallelism and MLA optimization. A milestone for AI infrastructure standardization and community collaboration."

• 5 min read
News
AI Model Tools Comparison How to Choose Between SGLang, Ollama, VLLM, and LLaMA.cpp?
AI Model Tools Comparison How to Choose Between SGLang, Ollama, VLLM, and LLaMA.cpp?
AI Models SGLang Ollama VLLM LLaMA.cpp Artificial Intelligence Large Language Models

In-depth comparison and analysis of popular AI model deployment tools including SGLang, Ollama, VLLM, and LLaMA.cpp, helping developers and users choose the most suitable AI model deployment tool

• 7 min read
AIGC