Foreign allegiance

Did a sitting member of Congress really pledge allegiance to a foreign country and say they would that country first over the people they represent?