When should I have stopped loving you?

This is the question I still ask myself

When should I have stopped loving you ?

Sometimes the tense confuses me

Should I be using past tense or present?

Would I be telling the truth

When I say “have stopped” and not just plain “stop”