# Reference: https://developers.google.com/webmasters/control-crawl-index/docs/robots_txt User-agent: * Allow: / Disallow: /users/login Disallow: /experiments Disallow: /light_cycle Disallow: /shortlist Disallow: /signup User-agent: GPTBot Disallow: / Sitemap: https://www.apartmentlist.com/sitemap.xml