Should data be manipulated in the controller or is it "View"'s job

I haven't used Angular before, but in general I would recommend a single database call, and do all of your processing/grouping/sorting of data in your controller (or better yet, a library, to keep controllers lean).

The view should then simply be iterating over the data and displaying it.