I also get worse milage with everything off.

aerodynamics has more of an effect on highway mileage than weight does. Awesome Mythbusters episode on this if you can find it.

But on a personal note, no noticeable difference with the top off. Doors do make a difference.