HELP- Falling sick after a period of regular exercise routine

I have had experienced it 3 times so far. Whenever I am back to regular exercising, I am pushing myself hard, I am losing weight, everything is great. Then usually after 5-6 weeks of regularity, I tend to catch sort of flu suddenly. And it's not the seasonal virus flu, there is no seasonal thing right now. First I would have just headache and stiff jaw, next day comes sore throat and body ache. And I have to go to forced break for a week so. Like now.

It's very frustrating suddenly falling down from a perfect situation just when I got back the full rhythm. Specially for someone like me who has consistency issue after an illness break.

I wonder anyone else experienced this? Is it because I put my body in strenuous exercise regime after a break? Any insight would be helpful. Thanks.