(Off top of my head, many more Japanese folks in US than vice versa, absolutely or normalized, esp if you back out military.)
(Not clear to me what percentage of the second number live in Japan as a function of US military presence; historically that was a high percentage.)