If all parts in the engine are OEM, follow the manufacturer's specs. The clearance is there as a provision for thermal expansion of the valve stems. If the clearance is insufficient, the valves may not close properly when the engine reaches normal operating temperature resulting in burnt valves and/or valve seats.