We just open-sourced Computer, a Computer-Use Interface (CUI) framework that enables AI agents to interact with isolated macOS and Linux sandboxes, with near-native performance on Apple Silicon. Computer provides a PyAutoGUI-compatible interface that can be plugged into any AI agent system (OpenAI Agents SDK , Langchain, CrewAI, AutoGen, etc.).

Why Computer?

As CUA AI agents become more capable, they need secure environments to operate in. Computer solves this with:

• Isolation: Run agents in sandboxes completely separate from your host system.

• Reliability: Create reproducible environments for consistent agent behaviour.

• Safety: Protect your sensitive data and system resources.

• Control: Easily monitor and terminate agent workflows when needed.

How it works:

Computer uses Lume Virtualization framework under the hood to create and manage virtual environments, providing a simple Python interface:

from computer import Computer

computer = Computer(os="macos", display="1024x768", memory="8GB", cpu="4") try: await computer.run()

    # Take screenshots
    screenshot = await computer.interface.screenshot()
    
    # Control mouse and keyboard
    await computer.interface.move_cursor(100, 100)
    await computer.interface.left_click()
    await computer.interface.type("Hello, World!")
    
    # Access clipboard
    await computer.interface.set_clipboard("Test clipboard")
    content = await computer.interface.copy_to_clipboard()

finally: await computer.stop()

Features:

• Full OS interaction: Control mouse, keyboard, screen, clipboard, and file system

• Accessibility tree: Access UI elements programmatically

• File sharing: Share directories between host and sandbox

• Shell access: Run commands directly in the sandbox

• Resource control: Configure memory, CPU, and display resolution

Installation:

pip install cua-computer

GitHub repo: https://github.com/trycua/computer Discord for feedback: https://discord.com/invite/mVnXXpdE85

We're excited to see you building the next Manus general agents with Computer!

We'd love to hear your thoughts, feedback, and any questions you might have. What use cases do you see for AI agents running in sandboxes? How do you see Computer being useful in your workflow?

user:	sarakaser
created:	February 2, 2025
karma:	1