After rethinking the question, I came back here to clarify and correct some of what I said- only to find that KongTower already beat me to the punch! You are, of course, correct that I was missing the key component to what AI actually is, and that would be the I, or, intelligence. I was conceptualizing the technology in the same manner as a brute force method of solving a board or logic game- using software to run simulations of every possibility, discarding failed results and keeping sucessful results, to arrive at a clean decision tree that leads to perfect play. I was imagining, basically, a program that writes its own TAS for the game, which is not at all what we're talking about here, even if that would be interesting in itself.
Maybe a better analogy for AI gaming, and maybe KongTower can help verify or correct me here, would be if Johnny 5 took to playing Donkey Kong and kept playing and playing until he became better than all humans. The difference being that instead of a physical robot, Johny 5's play is generated by code that directly inputs controls into the game instead of using a joystick and buttons.