You cannot access the internet through a memory stick. So you mean a dongle?. Of course you can do your paperwork and save it to a memory stick but you are more likely to lose the memory stick than get hacked.
Both good points,as soon as I sent the post I realised that I could store any info ,but I couldn't do "banking" without going on-line and therefore leaving myself at risk.Thanks.