This depends on your vehicle, usually it is stated in your manual.

For our Accord, it is stated that there is no need to warm up the engine, the car may be driven within a minute of starting.

According to the manual warming up the engine only wastes gasoline.

And also consider our climate, optimal driving temp is reached pretty quickly.