This is how it is with us.
When we do someone a favor, that favor grows in importance in our mind over time.
When we receive a favor, that favor diminishes in importance in our mind over time.
My way of thinking to combat this is to think less of what I do for others and focus more on the good others do for me. Do good and remember the good done to you.