Mouse Count by Ellen Stoll Walsh

From chapters.ca:
In this charming companion to "Mouse Paint," Ellen Stoll Walsh introduces the concept of counting forward and backward in a suspenseful story that will keep young readers guessing.