This is gonna blow your mind but even a lot of bottled water just comes out of plain-ass municipal water systems.

No, these machines are directly connected to the tap. Many will cool the water down but I don’t think many of them do filtering.