Summary: The psalmist focuses on the permanence of God's love. He is so far above anything or anyone else, and chooses His people to bless. He also chose David, but has seemingly turned His back on him. They cry to God to return and bless them once again.
Response: God and His people Israel did make a covenant (several actually), but God is not the party to it that strayed again... and again, and again...
So I guess I'm glad they can still notice God is missing and ask Him to return. Sometimes I feel like I've gotten away too many times, though in my head I know there are no such things. I hope to rely on His Spirit more and more and His grace every time I need it (which is very often).