Actually, "Options -Indexes" just prevents mod_autoindex from returning a formatted listing of the directory if that file is not present. In most situations, you should avoid "Options All", but "Options -Indexes" is a good idea for those directories which don't contain an index file.
You should remove system and application from public_html, if you can, regardless of whether you remove the index.html files.