You cannot be with someone just because you don't want to hurt him. You have your own happiness to think about.