Contents

Pinky ↗ connects AI agents to Android phones and iPhones, letting you monitor operations, approve actions, and take manual control from a desktop window. It is worth trying for supervised smartphone tasks, but as a pre-alpha release, it makes sense to start with a spare device.

Key Points#

  • Pinky connects MCP-compatible agents such as Claude Code, Codex, and Cursor to smartphones from macOS, Windows, and Linux.
  • Payments, trades, and money transfers require approval by default, and you can add more actions under Settings › Safety.
  • Android 13 and later can use a separate background display; older Android devices and iPhones use the main screen.
  • It is free under the Apache-2.0 license, requires no account, and stores activity records on your computer.

What Pinky Can Actually Do#

Pinky gives agents the ability to operate a smartphone screen. They can read the screen, launch apps, tap, swipe, and enter text. You tell the agent what to do and watch its actions in Pinky’s desktop window. It is useful for tasks that require mobile apps rather than websites or APIs.

Connections use MCP, a protocol supported by many agent tools. Pinky lets you configure supported agents under Settings › Agents and can also expose an MCP server for manual configuration. Agents on another computer or inside a container can connect over HTTP.

The desktop app supports macOS 12 and later, x64 editions of Windows 10 or 11, and compatible x86-64 Linux environments. According to the project, downloads range from 16–22 MB, and idle memory usage on Mac is about 70 MB. These are the project’s own measurements, not independent benchmarks.

How Approval Controls Work#

Pinky enforces approval rules at the gateway rather than relying on agents to follow written instructions. Payments, trades, and money transfers wait for a user click by default. You can also require approval for messages, deletions, orders, calls, installations, external links, and settings changes, or require approval for every step.

Banking, wallet, and password manager apps are hidden from agents by default. Agents can request temporary access to banking or wallet apps for a specific task. Pinky also blocks agents from entering text in password and one-time code fields, and each new agent requires user approval and a defined access scope.

Clicking the mirrored smartphone screen pauses the agent and lets you take manual control. On Android, touching the physical device also pauses it. There is also a global stop shortcut: Option+Command+. on macOS and Ctrl+Alt+. on Windows and Linux. Each run produces a step log, screenshots, and a screen recording, which can be exported as HTML for review.

Connect Your First Smartphone#

If you have a choice, start by connecting an Android phone over USB. The documented setup is simpler, and Pinky bundles adb, so you usually do not need to install a separate Android development environment.

1. Download the appropriate installer from the repository’s releases page and open Pinky. 2. Select Add phone › Android, enable Developer options and USB debugging on your phone, then connect the cable. 3. Approve the USB debugging prompt on your phone and follow Pinky’s setup instructions, including installing the Companion app. 4. Open Settings › Agents, connect your agent, and start with a read-only request such as “Open Settings and tell me the Android version.”

Pinky lists support for Android 10–17. Windows may require the manufacturer’s USB driver, while Linux may require Android udev rules. Android 11 and later support wireless debugging pairing, but confirm that USB works before troubleshooting Wi-Fi connections.

Check the iPhone Limitations#

The project lists support for iOS 17.4 and later, but setup and verification vary considerably by version. On iOS 27 and later, Pinky uses Apple’s Device Hub protocol without installing a helper app. The included documentation reports that a full sequence of operations was completed on an iPhone 13 mini running iOS 27.0.1.

On iOS 17.4–26, tapping and text entry require WebDriverAgent, which you build and install using Xcode. With a free Apple ID, you must reinstall this helper app every seven days. The documentation explicitly states that this method has not yet been tested on a physical iPhone running an iOS version earlier than 27.

Initial setup requires a USB cable, trusting the computer, Developer Mode, and Apple’s developer disk image. Wi-Fi is available after setup, but capturing screenshots can be substantially slower. On the iPad tested by the project, this took about one second over USB versus about five seconds over Wi-Fi.

Account for the Pre-Alpha Limitations#

The repository distinguishes between implemented features and features verified by a person. Remote unlocking, background tasks, recording, export, and Wi-Fi support are listed as implemented, but some execution paths still await manual verification. Before relying on a feature, check docs/ACCEPTANCE.md for the verification status of your device and OS.

You should also test approval prompts in the apps you intend to use. Pinky says it recognizes sensitive buttons in 10 languages, but that does not guarantee recognition of every custom interface. Enable approval for every step during your first few runs, and review the execution records before assigning longer tasks.

Next Steps#

Install Pinky from the repository’s releases page, require approval for every step, and run the Android version check described above on a spare smartphone.

Source: https://github.com/DIYgod/pinky

Contents