You might want to configure the router for the type of internet connection you are using. Example, static IP, dynamic IP, PPOE, etc.

If you don't know what I am talking about, try reading the quick guide that comes with the Linksys router.