首次提交：初始化项目

Author: Python51888

.env.example

@@ -0,0 +1,20 @@
+# Environment Variables for Midscene Python
+
+# AI Model Configuration
+MIDSCENE_AI_PROVIDER=openai
+MIDSCENE_AI_MODEL=gpt-4-vision-preview
+MIDSCENE_AI_API_KEY=your-api-key-here
+# MIDSCENE_AI_BASE_URL=https://api.openai.com
+
+# Execution Settings
+MIDSCENE_CONCURRENT=1
+MIDSCENE_CONTINUE_ON_ERROR=false
+MIDSCENE_GENERATE_REPORT=true
+
+# Logging
+MIDSCENE_LOG_LEVEL=INFO
+MIDSCENE_LOG_FILE=midscene.log
+
+# Development Settings
+MIDSCENE_DEBUG=false
+MIDSCENE_CACHE_ENABLED=true

.gitignore

@@ -0,0 +1,138 @@
+# Byte-compiled / optimized / DLL files
+__pycache__/
+*.py[cod]
+*$py.class
+
+# C extensions
+*.so
+
+# Distribution / packaging
+.Python
+build/
+develop-eggs/
+dist/
+downloads/
+eggs/
+.eggs/
+lib/
+lib64/
+parts/
+sdist/
+var/
+wheels/
+pip-wheel-metadata/
+share/python-wheels/
+*.egg-info/
+.installed.cfg
+*.egg
+MANIFEST
+
+# PyInstaller
+*.manifest
+*.spec
+
+# Installer logs
+pip-log.txt
+pip-delete-this-directory.txt
+
+# Unit test / coverage reports
+htmlcov/
+.tox/
+.nox/
+.coverage
+.coverage.*
+.cache
+nosetests.xml
+coverage.xml
+*.cover
+*.py,cover
+.hypothesis/
+.pytest_cache/
+
+# Translations
+*.mo
+*.pot
+
+# Django stuff:
+*.log
+local_settings.py
+db.sqlite3
+db.sqlite3-journal
+
+# Flask stuff:
+instance/
+.webassets-cache
+
+# Scrapy stuff:
+.scrapy
+
+# Sphinx documentation
+docs/_build/
+
+# PyBuilder
+target/
+
+# Jupyter Notebook
+.ipynb_checkpoints
+
+# IPython
+profile_default/
+ipython_config.py
+
+# pyenv
+.python-version
+
+# pipenv
+Pipfile.lock
+
+# PEP 582
+__pypackages__/
+
+# Celery stuff
+celerybeat-schedule
+celerybeat.pid
+
+# SageMath parsed files
+*.sage.py
+
+# Environments
+.env
+.venv
+env/
+venv/
+ENV/
+env.bak/
+venv.bak/
+
+# Spyder project settings
+.spyderproject
+.spyproject
+
+# Rope project settings
+.ropeproject
+
+# mkdocs documentation
+/site
+
+# mypy
+.mypy_cache/
+.dmypy.json
+dmypy.json
+
+# Pyre type checker
+.pyre/
+
+# Midscene specific
+reports/
+.midscene/
+*.log
+
+# IDE
+.vscode/
+.idea/
+*.swp
+*.swo
+
+# OS
+.DS_Store
+Thumbs.db

Makefile

@@ -0,0 +1,75 @@
+.PHONY: help install dev test lint format clean build docs
+
+# Default target
+help:
+	@echo "Available commands:"
+	@echo "  install     Install package and dependencies"
+	@echo "  dev         Install development dependencies"
+	@echo "  test        Run tests"
+	@echo "  lint        Run linting"
+	@echo "  format      Format code"
+	@echo "  clean       Clean build artifacts"
+	@echo "  build       Build package"
+	@echo "  docs        Build documentation"
+
+# Install package
+install:
+	pip install -e .
+
+# Install development dependencies
+dev:
+	pip install -e ".[dev,docs]"
+	pre-commit install
+
+# Run tests
+test:
+	pytest tests/ -v --cov=midscene --cov-report=html --cov-report=term-missing
+
+# Run tests with specific markers
+test-unit:
+	pytest tests/ -v -m "unit"
+
+test-integration:
+	pytest tests/ -v -m "integration"
+
+# Linting
+lint:
+	ruff check midscene/ tests/
+	mypy midscene/
+
+# Format code
+format:
+	black midscene/ tests/ examples/
+	isort midscene/ tests/ examples/
+	ruff check --fix midscene/ tests/
+
+# Clean build artifacts
+clean:
+	rm -rf build/
+	rm -rf dist/
+	rm -rf *.egg-info/
+	rm -rf .pytest_cache/
+	rm -rf .coverage
+	rm -rf htmlcov/
+	find . -type d -name __pycache__ -delete
+	find . -type f -name "*.pyc" -delete
+
+# Build package
+build: clean
+	python -m build
+
+# Build documentation
+docs:
+	mkdocs build
+
+# Serve documentation locally
+docs-serve:
+	mkdocs serve
+
+# Release to PyPI
+release: build
+	twine upload dist/*
+
+# Release to Test PyPI
+release-test: build
+	twine upload --repository testpypi dist/*

README.md

@@ -0,0 +1,123 @@
+# Midscene Python
+
+Midscene 的 Python 实现版本 - 基于 AI 的自动化框架，支持 Web 和 Android 平台的 UI 自动化操作。
+
+## 概述
+
+Midscene Python 是原 TypeScript/JavaScript 版本的完整移植，保持相同的核心架构和功能特性：
+
+- **自然语言驱动**：使用自然语言描述自动化任务
+- **多平台支持**：支持 Web（Selenium/Playwright）和 Android（ADB）
+- **AI 模型集成**：支持 GPT-4V、Qwen2.5-VL、Gemini 等多种视觉语言模型
+- **可视化调试**：提供详细的执行报告和调试信息
+- **缓存机制**：智能缓存提升执行效率
+
+## 项目架构
+
+```
+midscene-python/
+├── midscene/                    # 核心框架
+│   ├── core/                    # 核心框架
+│   │   ├── agent/              # Agent系统
+│   │   ├── insight/            # AI推理引擎
+│   │   ├── ai_model/           # AI模型集成
+│   │   ├── yaml/               # YAML脚本执行器
+│   │   └── types.py            # 核心类型定义
+│   ├── web/                     # Web集成
+│   │   ├── selenium/           # Selenium集成
+│   │   ├── playwright/         # Playwright集成
+│   │   └── bridge/             # Bridge模式
+│   ├── android/                 # Android集成
+│   │   ├── device.py           # 设备管理
+│   │   └── agent.py            # Android Agent
+│   ├── cli/                     # 命令行工具
+│   ├── mcp/                     # MCP协议支持
+│   ├── shared/                  # 共享工具
+│   └── visualizer/              # 可视化报告
+├── examples/                    # 示例代码
+├── tests/                       # 测试用例
+└── docs/                        # 文档
+```
+
+## 技术栈
+
+- **Python 3.9+**：核心运行环境
+- **Pydantic**：数据验证和序列化
+- **Selenium/Playwright**：Web 自动化
+- **OpenCV/Pillow**：图像处理
+- **HTTPX/AIOHTTP**：HTTP 客户端
+- **Typer**：CLI 框架
+- **Loguru**：日志记录
+
+## 快速开始
+
+### 安装
+
+```bash
+pip install midscene-python
+```
+
+### 基础用法
+
+```python
+from midscene import Agent
+from midscene.web import SeleniumWebPage
+
+# 创建 Web Agent
+with SeleniumWebPage.create() as page:
+    agent = Agent(page)
+    
+    # 使用自然语言进行自动化操作
+    await agent.ai_action("点击登录按钮")
+    await agent.ai_action("输入用户名 'test@example.com'")
+    await agent.ai_action("输入密码 'password123'")
+    await agent.ai_action("点击提交按钮")
+    
+    # 数据提取
+    user_info = await agent.ai_extract("提取用户个人信息")
+    
+    # 断言验证
+    await agent.ai_assert("页面显示欢迎信息")
+```
+
+## 主要特性
+
+### 🤖 AI 驱动的自动化
+
+使用自然语言描述操作，AI 自动理解并执行：
+
+```python
+await agent.ai_action("在搜索框中输入'Python教程'并搜索")
+```
+
+### 🔍 智能元素定位
+
+支持多种定位策略，自动选择最优方案：
+
+```python
+element = await agent.ai_locate("登录按钮")
+```
+
+### 📊 数据提取
+
+从页面提取结构化数据：
+
+```python
+products = await agent.ai_extract({
+    "products": [
+        {"name": "产品名称", "price": "价格", "rating": "评分"}
+    ]
+})
+```
+
+### ✅ 智能断言
+
+AI 理解页面状态，进行智能断言：
+
+```python
+await agent.ai_assert("用户已成功登录")
+```
+
+## 许可证
+
+MIT License