Without a toolbar, Finder opens each folder in its own window

I believe this behavior is by design. The problem is that without the toolbar hidden there would be no way (other than a keyboard shortcut) to go back to the previous folder. I believe your only options are to show the toolbar or to have it keep opening new windows.