The Bilbies are Ty's friends who were imprisioned by Boss Cass in small cages hidden throughout the stages (each stage has 5), if you get all of them in a stage, you'll get a Thunder Egg, you need to bite the cages to free them.
Here's a guide for finding them all: