The oiler is just a push fit and will normally pull or lever out fairly easily. If it is hard to shift, a stud extractor (tapered type with a left hand spiral) will almost certainly remove it. I would not recommend drilling to avoid debris in the oil way.