{"repo":"bin123apple/InfantAgent","free":true,"listed":false,"github":"https://github.com/bin123apple/InfantAgent","clone":"git clone https://github.com/bin123apple/InfantAgent.git","description":"[NeurIPS 2025] A multimodal agent that can interact with its own PC in a multimodal manner.","language":"Python","stars":39,"topics":["agent","llm","multimodal","artificial-intelligence","claude","gpt","chatgpt","deep-research","deep-research-agent"],"license":"Apache-2.0","category":"ai-agents","readme_excerpt":"InfantAgent: A multimodal agent that can interact with its own PC in a multimodal manner. Introduction 1. To build a multimodal agent that can interact with its own PC in a multimodal manner. This means it can autonomously operate the mouse and click anywhere on the screen, rather than relying solely on browser analysis to make decisions. 2. This agent system will be used for subsequent reinforcement learning training of agents. 3. I have not yet conducted large-scale testing of this agent beyond the benchmark; please feel free to report any bugs or submit pull requests. :wave: Recent Updates We’ve switched from NoMachine to the open-source Guacamole for desktop sharing, because NoMachine requires a license for multi-user concurrent sessions. The Docker code has just been updated to support this change, and we will roll out a few follow-up patches to address remaining edge cases and polish the experience. Installation Requirements Now, it is only tested on linux server with Nvidia Tesla GPU (A100, H200 ...) . The GPU is for open-spurce model inference. There may be some bugs for Mac/Windows. Setup 1. Setup environment 2. Build the Docker. Only required on the first use. It will pull the docker image from the Docker Hub. 3. Run 4. Configure Virtual Machine (You only need to configure it once when using it for the first time.) - Enter your api key in setting By default, you should enter the Claude API key. You can also change this in the config.py file. - Wait for the backend t","default_branch":null,"files":null,"tree":[],"storefront":"/r/bin123apple","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/bin123apple/InfantAgent/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}