UFO

A Windows UI operation agent developed by Microsoft Research that analyzes Windows interfaces through screenshots and performs actions. It understands the UI layout of Windows applications and can complete complex cross-application operation tasks using natural language.