Keep it... if it needs replacement, its not that costly naman.

The thermostat regulates the flow of water into the engine depending on the temperature. Without it, water just flow through continuously and may keep the engine from reaching an optimal operating temperature.

My .002