As someone who lives in Japan, that is true as long as you stay inside the tourist bubble. Once you start venturing into places not meant for visitors, the difficulty goes from 0 to 100 real quick. That said, sometimes those experiences of struggling communication can be among the best you’ll have here.