One in four first-time buyers have no emotional ties to their first home, moving on after four-and-a-half years.