‘The one way to stop that from happening is to make sure we defend the majority’