I spoke to my hosts - 123-reg. Maybe they're completely incompetent as it does seem they find it difficult to solve problems that aren't written down on their sheets.
They kept talking about DNS servers and name servers, MX records etc and saying it has nothing to do with them. That I should "contact the email provider". Sigh.