If you don’t want to use dish soap, you can also mix equal parts warm water and white vinegar for a natural cleaner. [2] X Expert Source Melanie GarciaProfessional House Cleaner Expert Interview. 10 October 2019.

You can find straw brushes at most home goods stores. If you don’t have a straw brush, use a clean pipe cleaner instead.

You might see some grime on the straw brush, which is a good sign! If you take your straw brush out and it’s dirty, rinse it off and then use your soap mixture to give it a good scrubbing.

If the outside of your water dispenser is dirty, wipe it down with a soapy paper towel.

For example, if you use 1  c (240 mL) of water, add 1  c (240 mL) of white vinegar.

Vinegar has a strong smell, but it will disappear as it dries.

If there’s any stuck-on grime that really won’t come off your tray, use a new toothbrush to scrub any hard-to-reach areas. [11] X Research source

The valve is usually near the bottom of the fridge on the right hand side.

Vinegar also helps break down mold and mildew without using harsh chemicals.

If you need to replace the filter in your water dispenser, now’s the time!

If you have an ice maker too, let the ice maker fill up with new ice, then discard that batch since it might be tainted with vinegar. After that, your ice should be clean and ready to use.