Just add a tip to make this a little faster.
After you complete a bounty, you can press
to open up the local map, then press
switch to chapter map. You can now choose the required way point and travel to it directly from where you are. You don't need to return to town every time. This may save a lot of time.