User-agent: * Disallow: /http: Disallow: /api Disallow: /terms-and-conditions Disallow: /forgot-password Disallow: /reset-password Disallow: /emails/unsubscribe Disallow: /login? Disallow: /articles/search Clean-param: ref&etext&order&search_terms&city