Screen-state automation
Screen State Detection & Automation
A local desktop tool that watches screen content, detects calibrated visual states with OpenCV, and triggers configured mouse or keyboard actions while keeping the UI responsive.
Detection flow
- Template matching against user-captured UI elements with configurable confidence thresholds.
- Drag-select calibration flow so users can create detection templates without manual cropping.
- Background detection loop with PyQt signal handoff to avoid freezing the interface.
- Windows input and focus handling for local desktop automation workflows.
Trigger flow
The loop captures a visual target, watches for a match, and triggers the configured response when the confidence threshold is reached.