Free standard shipping on orders over $149.97
Water quality

Water filters and softeners for tankless water heaters

A water softener for tankless water heater protection is one option against hard water, the number one enemy of tankless units. Here’s how filters, scale inhibitors and softeners compare.

Updated November 5, 2026 · 3 min read · By Tankless Water Heater Shop Editorial Team · How we write guides

Key takeaways

  • Water above about 7 grains per gallon (120 ppm) of hardness causes noticeable scale in tankless units.
  • A scale inhibitor (polyphosphate or template-assisted crystallization) is an affordable way to reduce scale; a water softener removes hardness for the whole house.
  • Every tankless unit has an inlet filter screen to clean regularly; well water often needs an extra sediment filter.

How hard water affects a tankless water heater

As water is heated, dissolved calcium and magnesium come out of solution and stick to hot surfaces as scale. In a tankless unit, the heat exchanger’s narrow passages heat water quickly, so scale builds where it hurts most. It reduces heat transfer, lowers flow, causes temperature swings and triggers error codes. Left alone, scale can overheat and damage the heat exchanger.

Water hardness levels

Hardness Grains per gallon Parts per million Recommendation
Soft 0–3.5 0–60 Flush yearly
Moderately hard 3.5–7 60–120 Flush every 6–12 months
Hard 7–10.5 120–180 Scale inhibitor or softener, flush every 6 months
Very hard 10.5+ 180+ Water softener strongly recommended

Test strips, a home test kit or your water utility’s annual report tell you your hardness.

Your options

A tankless water heater filter and a water filter for tankless water heater protection do different jobs from a softener, as explained below. Pairing a water softener and tankless water heater is the strongest protection.

Inlet filter screen (built in)

Every tankless water heater has a mesh filter at the cold inlet. It catches sand and debris, not dissolved minerals. Clean it every few months. Replacement screens are inexpensive.

Sediment pre-filter

A cartridge filter before the heater catches sand, rust and silt, which is useful for well water or older pipes. Change cartridges on schedule.

Scale inhibitor

Installed on the cold line before the heater. Polyphosphate cartridges coat minerals so they stay dissolved; TAC (template-assisted crystallization) media converts hardness into tiny crystals that don’t stick. Both reduce scale without salt. Some brands sell scale inhibitors designed for their tankless units.

Water softener

A salt-based ion-exchange softener removes calcium and magnesium for the entire house. It is the most effective protection for very hard water and also helps fixtures and appliances. It needs salt and periodic maintenance.

Well water and tankless

Well water can carry sediment, iron, manganese and high hardness. Test your water, install a sediment filter, treat iron if present, and choose softening or scale control based on hardness. Clean the tankless inlet screen more often and flush more frequently.

Keep flushing

Even with treatment, follow your manufacturer’s descaling schedule. See how to flush a tankless water heater.

Filters and flush kits

Pre-filters, scale inhibitors and descaling kits for tankless units.

Shop accessories

Frequently asked questions

Do I need a water softener for a tankless water heater?

Not always. If your water is under about 7 grains per gallon, regular flushing is usually enough. Above that, many manufacturers recommend water treatment, and some warranties exclude scale damage when hardness exceeds their limit.

Is a water softener or a scale inhibitor better for tankless?

A softener removes hardness for the whole house and is the most thorough option. A scale inhibitor installed before the heater is cheaper and needs less upkeep, but doesn’t soften water for the rest of the home.

Where is the filter on a tankless water heater?

The inlet filter screen is usually at the cold water inlet on the bottom of the unit, sometimes inside the isolation valve. Your manual shows its location.

Can I use a tankless water heater with well water?

Yes, but well water often contains sediment, iron or hardness. Test your water, add a sediment filter, and treat hardness if needed. Clean the inlet screen more often.

This guide is general information for U.S. homeowners, not professional advice. Gas, electrical and venting work must follow the manufacturer’s instructions and local codes, and in most areas requires a licensed plumber, electrician or gas fitter and a permit. Specifications and prices change; always confirm details on the product page and in the installation manual.