Denise Richards rumored to be leaving RHOBH due to alleged affair