Announced in 2016, Gym is an open-source Python library developed to assist in the development of support learning algorithms. It aimed to standardize how environments are specified in AI research study, making published research more easily reproducible [24] [144] while supplying users with a simple user interface for communicating with these environments. In 2022, new developments of Gym have actually been relocated to the library Gymnasium. [145] [146]
Gym Retro

Released in 2018, Gym Retro is a platform for support knowing (RL) research study on computer game [147] utilizing RL algorithms and research study generalization. Prior RL research focused mainly on optimizing agents to fix single tasks. Gym Retro provides the capability to generalize in between games with similar principles but various appearances.

RoboSumo

Released in 2017, RoboSumo is a virtual world where humanoid metalearning robot agents initially do not have knowledge of how to even walk, but are offered the goals of learning to move and to push the opposing agent out of the ring. [148] Through this adversarial learning process, the agents learn how to adjust to changing conditions. When an agent is then removed from this virtual environment and put in a brand-new virtual environment with high winds, the representative braces to remain upright, suggesting it had actually learned how to balance in a generalized method. [148] [149] OpenAI's Igor Mordatch argued that competitors in between agents could develop an intelligence "arms race" that might increase an agent's capability to operate even outside the context of the competition. [148]
OpenAI 5

OpenAI Five is a group of 5 OpenAI-curated bots utilized in the competitive five-on-five video game Dota 2, that learn to play against human players at a high ability level completely through experimental algorithms. Before ending up being a team of 5, the very first public presentation occurred at The International 2017, the annual best championship competition for the video game, where Dendi, an expert Ukrainian gamer, lost against a bot in a live individually matchup. [150] [151] After the match, CTO Greg Brockman explained that the bot had discovered by playing against itself for two weeks of genuine time, which the knowing software application was a step in the direction of creating software application that can handle intricate tasks like a cosmetic surgeon. [152] [153] The system utilizes a kind of support learning, as the bots find out with time by playing against themselves hundreds of times a day for months, and are rewarded for actions such as eliminating an enemy and taking map objectives. [154] [155] [156]
By June 2018, the capability of the bots broadened to play together as a full group of 5, and they had the ability to defeat teams of amateur and semi-professional gamers. [157] [154] [158] [159] At The International 2018, OpenAI Five played in two exhibition matches against professional players, [forum.batman.gainedge.org](https://forum.batman.gainedge.org/index.php?action=profile