The rule of thumb here is if it has hard wiring, plumbing (especially gas), mechanical or structural a permit is required. Water heaters take electrical, plumbing and sometimes gas.
That being said, many people do not get permits for water heaters, plumbing, and minor electrical work in their...