Can I choose what card I want to swap or steal?

No, you can just choose the colour. The other manager can choose which colour within that colour.