Alpha Oops! H is for Halloween by Alethea Kontis, illustrated by Bob Kolar

From chapters.ca:
H gets top billing - but a stubborn B has something scary to say - as the inside- out alphabet gives a howl- arious Hallowe'en performance. Neon- bright, comically detailed illustrations show a cacophony of costumed letters, each with a mind and personality all its own.