{"repo":"wbsg-uni-mannheim/WebMall","free":true,"listed":false,"github":"https://github.com/wbsg-uni-mannheim/WebMall","clone":"git clone https://github.com/wbsg-uni-mannheim/WebMall.git","description":"This repository contains the code and data of the WebMall benchmark for evaluating the capability of Web agents to find and compare product offers from multiple e-shops.","language":"HTML","stars":16,"topics":["benchmarking","ecommerce","llm-agents","llms","web-agents"],"license":null,"category":"ai-agents","readme_excerpt":"WebMall - A Multi-Shop Benchmark for Evaluating Web Agents 🌐 WebMall Website 📄 Paper Abstract This repository contains the code and data of the WebMall benchmark for evaluating the capability of Web agents to find and compare product offers from multiple e-shops. The benchmark features two sets of tasks: A set containing basic tasks like searching and comparing offers, adding offers to the shopping cart, and finally checking out the selected offers. The benchmark also features an advanced task set containing searches with vague requirements as well as searches for compatible products or cheaper substitute products. For more detailed information about the benchmark design, task specifications, and initial results, please refer to our website. Setting up WebMall Environment - WebMall requires python 3.11/3.12 - WebMall requires a python environment without installed versions of BrowserGym and AgentLab, as we provide edited versions of BrowserGym and AgentLab which need local installation (steps below). Install local version of BrowserGym - As we use a fork of BrowserGym and AgentLab as submodules, they must be initialized first with git submodule update --init --recursive - Run make install in a terminal in the WebMall/BrowserGym folder to install BrowserGym and to install PlayWright to run experiments in a browser. Install local version of AgentLab - Run pip install -e . in WebMall/AgentLab Setup WebMall and AgentLab environment variables - WebMall expects a file: WebMall/.e","default_branch":null,"files":null,"tree":[],"storefront":"/r/wbsg-uni-mannheim","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/wbsg-uni-mannheim/WebMall/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}