My temperature gauge rises when the car (Mazda) is just idling. Btw, I only have water in the radiator. There are no leaks whatsoever.

Should I flush the existing fluid, add coolant and top it off again with water? Or can I just drain some of the water, add the coolant and top it again with water? (That's the instructions from the coolant I bought)

Thanks