>>>I don't really want to play around with the wireless settings on the router.
You probably wouldn't need to play around with anything. Unless your ISP changed the settings before sending you the router, its SSID and Security Key should be on a label attached to it. (Otherwise, assuming that you got the router from your ISP, they should have a record of the settings - and they should have sent you a printed copy anyway. Many ISPs change the SSID to show their own name but leave the Security Key unchanged).
So to attempt a wifi connection you simply need to get the relevant device to search for your router, select it and enter its security key. It should only take a few seconds!
Otherwise though, I see no reason why you can't use one of these (and, at under 6 quid, it's not going to cost you a fortune to find out) but I've no personal experience of using such a device:
Amazon.co.uk User Recommendation