I see I was mentioned here...
Like Monseratto says, the Fort is much better than the old one, but still too stiff for family duty. I figure the correct approach to this issue will be more progressive shocks plus a change of footwear... perhaps to tires with softer sidewalls.
Lowering pressure on the stock tires will not help much... if the sidewalls are stiff, all this will do is make the ride bouncier and wear out your tires' shoulders more. Having a more comfortable "premium" tire will give you a smoother ride even at the same 32 psi.
I don't think there's a need to change anything at the front. It's the rear set-up that has always been the problem for the Fort.
Be interested to hear what the final solution is.