I searched the internet in vain for this before reverting to the fool-proof strategy of clicking at random things in Excel. To turn the arrows off, go to the "Data" tab. The "Filter" button is highlighted. Click it and the arrows disappear. Click it again to reactivate the arrows on column headers. That's what I've learned today :-)
Happy new year!
