"Abraham Lincoln would maintain that he had never been in favor "of making voters or jurors of negroes, nor of qualifying them to hold office, nor to intermarry."