The usual option of buying a pre-paid SIM doesn't apply in Japan. Pre-paid phones are not available to non-residents. But you can rent a SIM for the duration of your stay.
Softbank is one carrier that has had good reviews. There are collection points on arrival at both Narita and Kansai and you can book your SIM in advance of your arrival.
Phil at the safety hub. over 6 years ago