vLLM Benchmark

4

Benchmarks vLLM deployments by measuring throughput, latency, and token generation speed through natural language test configuration

Category Models
Added Mar 28, 2026
Views 72

About

MCP vLLM Benchmarking Tool enables interactive performance testing of vLLM deployments through a simple interface. This proof-of-concept implementation allows users to benchmark language models served by vLLM by specifying endpoints, model names, and test parameters through natural language prompts. The tool leverages code from vLLM's official benchmarking suite to measure metrics like throughput, latency, and token generation speed across multiple test iterations. Developed by Eliovp-BV as an exploration of MCP capabilities, it's useful for AI engineers who need to evaluate and compare the performance characteristics of different model deployments.

Is this your product? Claim this listing with an email at your domain to post updates.

Is this your project?

Claim this listing to manage your page, access analytics, and unlock upgrades. Verification takes 60 seconds.

Log In to Claim

Share This Project

Embed Badge

Add this badge to your README:

[![Listed on AiList](https://hifriendbot.com/ai-list/badge/vllm-benchmark.svg)](https://hifriendbot.com/ai-list/vllm-benchmark/)
Listed on AiList

List Your Project

Join the directory Ai agents read. Free forever.

Submit Your Project