Skip to main content
The MCP server provides the following tools for your AI assistant:

execute_mobile_command

Execute natural language commands on your mobile device using the mobile-use SDK. Parameters:
  • goal (required): Natural language command to execute
  • output_description (optional): Description of expected output format
  • profile (optional): Profile name to use (default: ‘default’)
Example usage: Example 1: Simple command with natural language output
## IDE Query example
Execute mobile command: Open Settings and tell me the current battery level

## MCP Tool call example
execute_mobile_command(
  (goal = "Open Settings and tell me the current battery level")
);

# **Expected output:**

The phone battery level is at 85% and charging.
Example 2: Command with structured output
## IDE Query example
Execute mobile command: Find the first 3 unread emails in Gmail and list their sender and subject, return as JSON array with sender, subject, and timestamp fields

## MCP Tool call example
execute_mobile_command(
  (goal =
    "Find the first 3 unread emails in Gmail and list their sender and subject"),
  (output_description =
    "Return as JSON array with sender, subject, and timestamp fields")
);

# **Expected output:**

```json
[
  {
    "sender": "John Smith",
    "subject": "Project Update - Q4 Review",
    "timestamp": "2025-01-10 09:30:00"
  },
  {
    "sender": "Marketing Team",
    "subject": "New Campaign Launch Tomorrow",
    "timestamp": "2025-01-10 08:15:00"
  },
  {
    "sender": "LinkedIn",
    "subject": "You have 5 new profile views",
    "timestamp": "2025-01-10 07:45:00"
  }
]

analyze_screen

Captures a screenshot from a mobile device and analyzes it using a vision language model. Parameters:
  • prompt (required): Analysis prompt describing what information to extract
  • device_id (optional): Specific device ID to target
Example usage:
## IDE Query example
Analyze screen: What app is currently open? List all visible UI elements.

## MCP Tool call example
analyze_screen(
  (prompt = "What app is currently open? List all visible UI elements.")
);

# **Expected output:**

The screen shows the Gmail app with the following UI elements:
- Navigation bar with "Gmail" title
- Search bar at the top
- Email list with 3 visible emails
- Floating action button (+) for composing new email
- Bottom navigation with icons for Mail, Meet, Chat, and Spaces

Resources

data://devices

Lists all connected mobile devices (Android and iOS). Returns: Array of device information:
  • device_id: Device serial (Android) or UDID (iOS)
  • platform: "android" or "ios"
  • name: Device name
  • state: Device state ("connected" or "Booted")