Depends on the router, but most of them will have an access restriction or parental control section or you might have to go to tools -> schedule, or just schedule. I might be able to say more if I know the model number. :)
Also I think there's software that'll do it on a PC if the router thing doesn't work (e.g., rescuetime I think?).