There are two countermeasures that you can employ:
– Use 3 on your keyboard to release a smoke screen so you can attempt to lose your pursuer.
– Use 4 on your keyboard to release chaff (small bits of metal) which will damage any plane approaching you from behind.