You could get by without filtering at all, especially if you pre-filtered, but I would definatley heat to sterilize since coffee filters are not sterile. Set oven at 250, heat for 15 min then repeat. Keep an eye on it, make sure it doesn't start to discolor.