BrowserGym

🛠️ Setup - 🏋 Usage - 💻 Demo - 🌐 Ecosystem - 🚀 AgentLab - 🌟 Contributors - 📄 Paper - 📝 Citation

](https://pypi.org/project/browsergym/) [) ](https://pypistats.org/packages/browsergym-core) [ ](https://github.com/ServiceNow/BrowserGym/actions/workflows/code_format.yml) [

pip install browsergym

[!WARNING] BrowserGym is meant to provide an open, easy-to-use and extensible framework to accelerate the field of web agent research. It is not meant to be a consumer product. Use with caution!

!TIP] 🚀 Check out [AgentLab✨ ! A seamless framework to implement, test, and evaluate your web agents on all BrowserGym benchmarks.

https://github.com/ServiceNow/BrowserGym/assets/26232819/e0bfc788-cc8e-44f1-b8c3-0d1114108b85

_Example of a GPT4-V agent executing openended tasks (top row, chat interactive), as well as WebArena and WorkArena tasks (bottom row)._

BrowserGym includes the following benchmarks by default:

• MiniWoB
• WebArena
• WebArenaVerified
• VisualWebArena
• WorkArena
• AssistantBench
• WebLINX (static benchmark)
• OpenApps
• TimeWarp

Designing new web benchmarks with BrowserGym is easy, and simply requires to inherit the `AbstractBrowserTask` class.

🛠️ Setup

To use browsergym, install one of the following packages:

pip install browsergym  # (recommended) everything below
pip install browsergym-experiments  # experiment utilities (agent, loop, benchmarks) + everything below
pip install browsergym-core  # core functionalities only (no benchmark, just the openended task)
pip install browsergym-miniwob  # core + miniwob
pip install browsergym-webarena  # core + webarena
pip install browsergym-webarena-verified  # core + webarena_verified
pip install browsergym-visualwebarena  # core + visualwebarena
pip install browsergym-workarena  # core + workarena
pip install browsergym-assistantbench  # core + assistantbench
pip install weblinx-browsergym  # core + weblinx
pip install browsergym-timewarp  # core + timewarp 

Then setup playwright by running

playwright install chromium