The only way you can try to wriggle out is to say he took the car without your permission. If you were in the car, or it could be shown that you gave him the keys, this may be difficult.
On the strict analysis of your question, nothing will happen unless you were caught. If you were caught, you should be aware of what will happen to you as they will have explained the position to you.