I personally feel that the armour upgrades do need a counter effect. The best 'balance' comes from having to make a choice. If I choose this big armour upgrade, this will also happen. The idea is to customize your ship to a fighting style. Some people like to tank damage, others prefer to stay away from it.
I think that having armour affect your speed negatively is a good counter effect. The only problem is how to actually do it.