Len check out the link for examples of cable types. If you had 2 computers connected together before more than likely you have a crossover cable. If not and you have a straight through cable hook computers and router to 1,2,3,4 etc.
What brand an model of router do you have?
Do you have cable or DSL ?
You may have to set some settings in the router software in order to connect to service etc.