How to Win without Planning