If our ancestors had cared for the rights of other people,' he had reminded his Cabinet colleagues in 1878, 'the British Empire would not have been made.