The public generally have the right to observe all proceedings which determine the innocence or guilt of a defendant. There are only certain limited exceptions, when a court convenes 'in camera'.
However a bail application is unrelated to innocence or guilt, so there's no automatic right for the public to observe. When the defendant is not actually before the court, it's usual for a judge to consider the matter outside of a courtroom. (i.e. 'in chambers').
In the circumstances you describe, the courtroom temporarily became the judge's office, to which you have no right of entry.
Chris