While playing through the first areas of the Forbidden Jails, you will free a goblin blacksmith named Lundgren. After you talk to him, he'll move to the Goblin Market and open his shop.
You can then fast travel to the Goblin Market and talk to him, select "Upgrade Weapons" and choose one of your weapons or armor to upgrade.