Having a low annual mileage isn't the only thing that's taken into account when the insurance premium is calculated.
There are other things, such as how much of a claim are you prepared to pay yourself. Where is the car normally kept, a drive, on the street or in a locked garage? Also, have you had any motoring convictions in the last three years, up to five years with some companies.
But, you've been given good advice about going on to the comparison sites, or maybe a broker.
Best of luck in your search.