Most facilities like public baths, hot springs, swimming pools in Japan prohibits people from entering when you have a tattoo ... even a tattoo is very small. If the tattoo is small, you can buy a bandage to cover it up. Tattoo is considered as a sign of you belonging to a gang or Yakuza.
It is not illegal to tell people to leave if they have even a single tattoo in Japan.