EFAs are required to help you movilize fat. A good starting point is to keep your fat intake (GOOD fat) at about 20-30% of your daily caloric intake (1 gram fat = 9 cals).
I have always had them in my diet, so cannot really compare against not having them, but it feels much better than those fad diets with no fat in them...