How do you keep chlorine out of the tank using one of those "Direct from aquarium to sink" siphons?

I know how they work now but I need to know how you keep the chlorine out of the tank when you siphon the water back in... since it goes straight into the tank wouldn't it kill the fish inside because the water going back in is full of chlorine?