A comment by protodrew

https://janlukas.blog/micro/2021/03/crawlers-seo

protodrew

damn that sucks.... is there some way to block them from crawling your site on an IP or host level or would that just be like playing advertising whack a mole?