Can baby zebra finches be kept in a big aviary with parents?

My pair of zebra finches have two babies. They all live happily at the moment in my big aviary. The babies are flying, but don't have their colors yet. When they are fully mature with colors will i have to put them in another cage.