How to hide index.php from URL for both www and without www on http/https on Amazone

I am facing the issue of index.php in url, when i visit the site with www then it displaying the index.php in url but without www its url is just fine no index.php in url for both protocol http and https on Amazon cloud server e.g

     Case 1:

     when i put www.example.com/mobiles in url and hit enter, then the url become like the following

     https://www.example.com/index.php/mobiles

     Case 2:

     when i put just example.com/mobiles in url and hit enter, then the url become like

     https://example.com/mobiles


Can we control this through .htaccess if yes then how?

Thanks.