User-agent: Scrapy Allow: / User-agent: Scrapy Allow: / User-agent: Scrapy Allow: / User-agent: * Allow: / Allow: /feed/$ Disallow: /feed Disallow: /comments/feed Disallow: /*/feed/$ Disallow: /*/feed/rss/$ Disallow: /*/trackback/$ Disallow: /*/*/feed/$ Disallow: /*/*/feed/rss/$ Disallow: /*/*/trackback/$ Disallow: /*/*/*/feed/$ Disallow: /*/*/*/feed/rss/$ Disallow: /*/*/*/trackback/$ Disallow: /tag/ Disallow: /tag/$ Disallow: /category/ Disallow: /category/$ #Ruta del sitemap: Sitemap:https://conocerelcastellano.com/sitemap.xml