User-agent: dotbot User-agent: JUST-CRAWLER User-agent: MLBot Disallow: / User-agent: * Disallow: /images Disallow: /images.rec Disallow: /images.liv Disallow: /real Disallow: /sounds Disallow: /bak