Two fires destroyed homes in Victoria on Sunday evening, displacing many residents and leaving them without their belongings.