We developed a heuristic-based reflex agent, Tonic, for the EAAI 2021 Undergraduate Research Challenge, which tasks competitors to create an autonomous player to play the card game gin rummy. Tonic's heuristics originate in expert knowledge and inform decision making for the three actions comprising a turn: drawing a card, discarding a card, and deciding when to knock. However, because these strategies are based in human intuition, there is often a lack of specificity to directly model them as algorithms. We developed parameterized models describing that intuition based on factors such as the number of turns played and an estimation of the opponent hand. To hone their performance, we conducted both manual analysis and parameter optimization (grid search) using self-play and play against a simple baseline agent. These heuristic models enable Tonic to win against the baseline agent at least 68% of the time.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.