{"repo":"AIPythoner/pymidscene","free":true,"listed":false,"github":"https://github.com/AIPythoner/pymidscene","clone":"git clone https://github.com/AIPythoner/pymidscene.git","description":"PyMidscene - Midscene.js 的 Python SDK 实现 | AI 驱动的自然语言 UI 自动化，告别选择器，用中文描述即可操作。与官方缓存格式完全兼容。","language":"Python","stars":18,"topics":["ai","automation","browser-automation","midscene","natural-language","playwright","python","rpa","ui-testing","vision-llm"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"PyMidscene Python SDK for Midscene.js - AI-powered UI automation using natural language Features Installation Quick Start Documentation 中文文档 --- What is PyMidscene? PyMidscene is a Python port of Midscene.js - an AI-powered UI automation framework. It allows you to control web browsers using natural language instead of CSS selectors or XPath. No more fragile selectors! Just describe what you want to click, type, or extract: Features - Natural Language Automation - Describe elements in plain English/Chinese, no selectors needed - Multi-Model Support - Works with Doubao, Qwen, GPT-4V, Claude, and other vision LLMs - Playwright Integration - Seamless integration with Playwright for web automation - Android Integration - Control real devices over ADB with pymidscene[android] (see pymidscene/android/README.md) - iOS Integration - Drive iPhones / simulators through WebDriverAgent (see pymidscene/ios/README.md) - XPath Caching - Smart caching system compatible with Midscene.js format - Visual Reports - Generate beautiful HTML reports for debugging and sharing - Type-Safe - Full type hints for excellent IDE support Installation Or with Poetry: Quick Start 1. Set up your API key 2. Write your automation script CLI Run automation written as YAML scripts — no Python needed — with the pymidscene command (installed with the package): A script declares one platform target ( web / android / ios ) plus tasks : See docs/CLI.md for the full flag and flow-item reference, and examples/cli/ for r","default_branch":null,"files":null,"tree":[],"storefront":"/r/AIPythoner","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/AIPythoner/pymidscene/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}