Note the decline starting around 1900 and the absolute low around 1930, around the time that many Jews were trying to escape Germany and the regions around it. At the time they needed a place to go, the US had largely closed its doors.
Here we see the total number of foreign born citizens living in the US from 1850 to 2009 (bars) and their percent makeup of the total population.