Can I exchange items that my regiments use?

No, exchanging items is not possible. All regiments use predefined items that are always equipped. You can, however, upgrade them in the Forge to make them, and - in turn - your regiments, more powerful.