How does the exhaust system of a car affect the overall performance?

Does installing a header and aftermarket muffler have any effects on the speed and performance of the car?