Skip to main content
This guide will help you connect your first device and start using Pilot’s visual editor features.
Make sure you’ve completed the Installation steps before proceeding.

​
Connect a Device

Choose your device type to get started:

​
1. Enable USB Debugging

On your Android device:
  1. Go to Settings → About Phone
  2. Tap Build Number 7 times to enable Developer Options
  3. Go back to Settings → Developer Options
  4. Enable USB Debugging

​
2. Connect via USB

  1. Connect your device to your computer via USB
  2. Accept the “Allow USB debugging” prompt on your device

​
3. Start Streaming

  1. Open the Pilot panel from the Activity Bar
  2. Select your Android device from the device selector

​
Using Pilot’s Core Features

Once your device is streaming, you can use Pilot’s visual editor features to give context to your AI agent.

​
1. Embed Device Control

Interact with your mobile device directly from your IDE:
  • Tap: Click on the device screen
  • Swipe: Click and drag to swipe
  • Type: Use your keyboard when a text field is focused
  • Navigate: Move through your app without touching your phone
Navigate to the screen you want to modify before using Point and Prompt.

​
2. Screenshot to Chat

Send your current mobile screen to your AI chat with one click:
  1. Navigate to the screen you want to discuss
  2. Click the Screenshot to Chat button
  3. Your AI agent now sees exactly what you see
  4. Ask your question with full visual context

​
3. Point and Prompt

Click on specific UI elements to give your AI precise context:
  1. Click the Point and Prompt button to enter selection mode
  2. Click on any element in your mobile interface
  3. The element is highlighted and sent to your AI chat
  4. Describe what you want to change: “Make this button blue” or “Add padding to this card”
Your AI agent can now make changes with precision—no more describing “the button at the bottom of the screen”.

​
4. Select Area

For complex changes that need more context:
  1. Click the Select Area button
  2. Draw a rectangle around the area you want to discuss
  3. The entire selection is piped to your AI chat
  4. Ask for changes that involve multiple elements

​
Example Workflow

Here’s how a typical development session looks with Pilot:
1

Start Streaming

Connect your device and start the stream in your IDE
2

Navigate to Your Screen

Use embedded device control to reach the screen you’re working on
3

Point at the Element

Click on the UI element you want to modify
4

Describe the Change

Tell your AI what you want: “Make this text larger and bold”
5

Review and Iterate

See the change on your device, point at something else if needed

​
Tips for Best Results

Instead of selecting a large area, point at the exact element you want to change. This gives your AI agent precise context.
When asking about layout or design questions, use Screenshot to Chat to show the full screen context.
Use Screenshot to Chat for the big picture, then Point and Prompt for specific elements you want to modify.

​
Next Steps

Suggest a Feature

Share your ideas and vote on features

Troubleshooting

Common issues and solutions