Prompt Tester

Enables AI assistants to test and compare LLM prompts across different providers with side-by-side comparisons, token tracking, and cost calculation for evaluating prompt effectiveness.

GitHub
Category Models
Added Mar 28, 2026
Views 98

About

MCP Prompt Tester is a server that enables AI assistants to test and compare LLM prompts across different providers (OpenAI and Anthropic). It provides tools for listing available models, running side-by-side comparisons of prompts with different parameters, and managing multi-turn conversations. Built with Python and the MCP protocol, it features detailed token usage tracking, cost calculation, and optional Langfuse tracing for observability. This implementation is particularly valuable for prompt engineers and developers who need to evaluate prompt effectiveness, compare model responses, or test conversational flows without leaving their AI assistant interface.

Is this your product? Claim this listing with an email at your domain to post updates.

Is this your project?

Claim this listing to manage your page, access analytics, and unlock upgrades. Verification takes 60 seconds.

Log In to Claim

Share This Project

Share on X Share on LinkedIn

Embed Badge

Add this badge to your README:

[![Listed on AiList](https://hifriendbot.com/ai-list/badge/prompt-tester.svg)](https://hifriendbot.com/ai-list/prompt-tester/)
Listed on AiList

Compare

Prompt Tester vs Multi-LLM Cross-Check Prompt Tester vs PromptForge Prompt Tester vs drainbrain-mcp-server

Similar Projects

Multi-LLM Cross-Check

14

Provides a unified interface for querying multiple LLM providers simultaneously, enabling side-by-side response comparison for fact-checking, gathering diverse perspectives, or evaluating different models' capabilities.

Models

PromptForge

## About PromptForge PromptForge is an advanced AI prompt optimization MCP server that transforms your prompts into high-performance queries. Built by AI marketing strategist Steve Kaplan, this tool leverages proven optimization patterns to enhance prompt effectiveness across various AI models. ##

MCP Servers

drainbrain-mcp-server

Tools: - scan_token - Scan a single token for rug pull risk, honeypot status, and temporal analysis - batch_scan - Scan up to 10 tokens in parallel - health_check - Check API and model availability - compare_rugcheck - Compare DrainBrain ML score vs RugCheck heuristic side-by-side Install:

MCP Servers

List Your Project

Join the directory Ai agents read. Free forever.

Submit Your Project