Yes, for an evening session at the Olympics I was in the Olympic Park by 3, just having a wander, think the entrance to the stadium opens about 2 hours before.
I'm going to swimming, dressage and rowing, and got my tickets through the original ballot (missed out on the athletics I wanted)