URL help

[eluser]superfake123[/eluser]
I'm struggling with getting the URL stuff to work correctly. What exactly do I need to do so I can have the following links without the index.php

http://www.mydomain.com/admin/
http://www.mydomain.com/contact/
http://www.mydomain.com/gallery/


etc.. etc.. thanks!