feat: Enhance MCP integration and example

[ThanabordeeN]

📝 Changes Description

TLDR; Enhanced DSPy's ReAct with concurrent MCP server support, enabling efficient integration with external APIs (e.g., Airbnb) through asynchronous operations and robust resource management.

This MR/PR introduces significant improvements to DSPy's ReAct framework, enabling concurrent interaction with multiple MCP (Model Context Protocol) servers. Key enhancements include:

• mcp_multi_server_example.py:
  • Provides a practical demonstration of concurrent MCP server operations within a ReAct workflow.
• mcp.py:
  • Add mcp module intregrations
• Asynchronous ReAct Operations:
  • Leverages ReAct's asynchronous capabilities (async_forward in react.py) for efficient management of multiple server connections.

Example Usage

import asyncio
import os
import dspy

# Define a simple DSPy Signature for the agent
class MultiServerSignature(dspy.Signature):
    """Perform operations using tools potentially available across multiple MCP servers."""
    request: str = dspy.InputField(desc="The user's request, potentially requiring external tools.")
    output: str = dspy.OutputField(desc="The final response to the user's request after potentially using tools.")

async def main():
    # Initialize language model
    lm = dspy.LM("gemini/gemini-2.0-flash", api_key=os.getenv("GOOGLE_API_KEY"))
    dspy.configure(lm=lm)
    
    # Configure MCP servers
    config_path = "path/to/servers_config.json"
    
    async with dspy.MCPServerManager() as server_manager:
        # Load and initialize servers from config
        config = server_manager.load_config(config_path)
        await server_manager.initialize_servers(config)
        
        # Get all tools from all connected servers
        all_mcp_tools = await server_manager.get_all_tools()
        
        # Create a ReAct agent with the tools
        react_agent = dspy.ReAct(
            MultiServerSignature,
            tools=all_mcp_tools,
            max_iters=7
        )
        
        # Execute a request
        result = await react_agent.async_forward(request="Your request here")
        print("Final Result:", result.output)

if __name__ == "__main__":
    asyncio.run(main())

✅ Contributor Checklist

• [-] Pre-Commit checks are passing (locally and remotely)

⚠️ Warnings

• MCP tools are currently incompatible with combinations of default functions and MCP functions must use async function instead
• Some MCP functions may exhibit unexpected behavior.
• SSE MCP functionality has not been thoroughly tested.

[TomeHirata]

Please don't include mcp in the main dependency. Include it in the extra dependency instead

[TomeHirata]

Please don't change the minimum support Python version

[TomeHirata]

Examples are not actively used. Can we have a documentation page in docs/docs/tutorials?

[TomeHirata]

@ThanabordeeN Thank you for the PR. The maintainer team is discussing how we should support the MCP integration in dspy.ReAct. Can we keep this PR on hold while we discuss the design direction?

[ThanabordeeN]

Okay , with pleasure.

[TomeHirata]

Hi, @ThanabordeeN. Regarding the MCP support in dspy.ReAct. Here is the proposal from the maintainer team. Are you willing to contribute?

1. We provide a public util to convert mcp.types.Tool and mcp.client.session.ClientSession into dspy.primitives.tool.Tool so that MCP tools can be passed to dspy.ReAct
2. dspy.ReAct should be able to use async callables and async Tools in the sync forward method. While we plan to provide an async forward method, it should be a follow-up after the MVP version
3. We don't plan to support MCP server session management within the DSPy library in the short term. We believe it should be addressed by the MCP library side.

[ThanabordeeN]

Of course, I am interested in being a part of this development because I have personally benefited from using this tool in research and other personal projects.

[okhat]

Thank you @ThanabordeeN ! Looking forward to collaborating with you. (+ Thank you @TomeHirata !)