Trying to get rid of index.php from address on my ubuntu system

Thank you for your replies, but at this moment nothing seems to get rid of it.  I have tried the following:

I have change this in /etc/apache2/apache2.conf

Code:

<Directory /var/www/>
    Options Indexes FollowSymLinks
    AllowOverride All
    Require all granted
</Directory>

I have also added the .htaccess to have this

Code:

RewriteEngine On
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule ^(.*)$ index.php/$1 [L]

and also this one

Code:

RewriteEngine On
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule .* index.php/$0 [PT,L]

I have also made sure that in config.php it is set as

Code:

$config['index_page'] = '';

and just incase 

Code:

$config['index_page'] = 'index.php';

I have used phpinfo() to display on the server and in the loaded modules it says mod_rewrite.

but yet if I have it as the page http://localhost/ it shows the home page as normal, but if I say go into http://localhost/blog it cannot find it.  I add index.php into the address and it works.

I have had this exact project in WAMP on windows working fine and also on my linux hosting and it also works fine there.  I just don't see what could be making the issue.