The man was fired after he was publicly linked to a group that espouses racist ideals.