Can a controller method be excluded from redirect()->back()?

Is there a way to exclude a controller method from being added to redirect()->back()? 
For example, say I have a function that returns an image or file directly to the browser. I wouldn't necessarily want that function to be included in ->back().  Is there anyway to prevent this?

Nevermind, I see DownloadResponse is ignored and I need to update my image download to use $response->download()