arin-deloatch/mcp-testing

PoC for MCP evaluation using DeepEval

★ 0Forks 0PythonGitHub ↗Compare

README

mcp-testing

PoC for MCP evaluation using DeepEval

This repository is under heavy construction.


src/mcp_testing/servers/baseline/server.py

A minimal, deterministic MCP server for evaluation testing.

Overview

Purpose: Provide a predictable foundation for MCP evaluation using DeepEval.

Characteristics:

  • Deterministic outputs (no randomness)
  • Simple, testable tools
  • Clear input/output contracts
  • No external dependencies or network calls

Available Tools

1. echo

Returns input unchanged.

{
  "message": "test"
}
→ "test"

2. add

Adds two numbers.

{
  "a": 5,
  "b": 3
}
→ 8.0

3. multiply

Multiplies two numbers.

{
  "a": 4,
  "b": 7
}
→ 28.0

4. greet

Generates greeting message.

{
  "name": "Alice",
  "formal": false
}
→ "Hello, Alice!"

5. get_server_info

Returns server metadata.

{}
→ {
  "name": "baseline-server",
  "version": "0.1.0",
  "purpose": "PoC for MCP evaluation using DeepEval",
  "tool_count": 5,
  "deterministic": true
}

Running the Server

Start server directly:

uv run src/mcp_testing/servers/baseline/server.py

Contributors

arin-deloatch

Issues