Cheese can have other meanings - sentimental, a big cheese (powerful person), to stop; desist or to act in a grovelling manner, but i can't think of a suitable opposite. It may even be to do with saying 'cheese' for a photo.
It could relate to chalk but i can't see anything yet