Ant frass? in shower cubicle

I have this black powdery substance that appears in my shower cubicle (see pictures). Given that there are small ants running about I assume it is ant frass?

  1. The ants seem to be coming out of the small holes in the grout (see pictures). Do I need to have all the grouting redone? Or can I just DIY fill in the holes?
  2. Do I need to have someone check if there is water damage behind the tiles from water leaking through the small holes in the grout?
  3. Are the ants harmless to the structure? Do I need to do anything about them / pest control etc?

https://preview.redd.it/7wfi9lcx9gce1.jpg?width=3000&format=pjpg&auto=webp&s=39e0bfbdfe9cb97eae9fba7f5cad3cca2f90c688

https://preview.redd.it/hfox0zvx9gce1.jpg?width=2252&format=pjpg&auto=webp&s=b6d9368d6310d9dcb02ea45f0c2dd7c15acd838f

https://preview.redd.it/bc5hy3ey9gce1.jpg?width=2252&format=pjpg&auto=webp&s=e5acc655a2dbe05ee531b53f16321d54eb153c45