"Give what is Caesar to Caesar" is not to pay the devil with our good substance, but rather, do what is right and obey the law of the land, because the law protects us.
We should not be ignorant of the law of the land, they are not against our belief.