I'm not sure you can do much to prevent it, as that's just how your skin naturally is. You probably need a moisturiser for Combination skin and if you use a Foundation, then select an oil free one. Do you also use a translucent powder?
I have been using a brand called "Corn Silk", it's colour free, fixes makeup in place, reduces oily shine and doesn't cause any build up, even with reapplication throughout the day.
You can can purchase it in the Original formula, which is suitable for younger oilier skins or the Semi Matt. Now I'm older and not as oily, I use the Semi Matt. It comes either as a loose powder or in a compact. I would recommend the compact, as the loose powder gets everywhere.