That is a thing, but I know of exactly one person personally that has that. Most people here just have screw on filters that goes on their sink tap, or a fridge with a water dispenser, which already needs a water line for exactly the reason you guessed, ice cubes.