"It really caught us off guard," Romano tells PEOPLE about how moving on from the sitcom after nine seasons impacted his family Saying goodbye to Everybody Loves Raymond was a tough pill for Ray ...