OmniParser

OmniParser is a Microsoft Research screen-parsing model that converts UI screenshots into structured, grounded elements so LLM-based agents can reliably identify and interact with buttons, icons, and text on any interface. It serves as a vision layer for computer-use agents rather than a general-purpose chat or reasoning model. Source: supabase.