That was the problem with time travel, of course (apart from the impossibility) - one would always be a Cassandra, spreading doom with one's foreknowledge of events