The real reason Emma Roberts and Evan Peters broke up