White House confirms Americans could be left behind