User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: Bytespider Disallow: / User-agent: yacybot Allow: /VORSCHAU/* User-agent: bingbot Disallow: /die-hhu/kontakt-und-services/zentrale-und-amtliche-bekanntmachungen/* Disallow: /en/about-hhu/contact-and-services/central-and-official-announcements/* User-agent: gptbot Disallow: /die-hhu/kontakt-und-services/zentrale-und-amtliche-bekanntmachungen/* Disallow: /en/about-hhu/contact-and-services/central-and-official-announcements/* User-agent: * Disallow: /VORSCHAU/* Disallow: /ARCHIV/ Disallow: /blochproxy/ # Only allow URLs generated with RealURL Disallow: /*?id=* Disallow: /*&id=* # L=0 is the default language Disallow: /*?L=0* Disallow: /*&L=0* # typeNum = 98 is usually the print version. Disallow: /*?type=98* Disallow: /*&type=98* Disallow: /*?type=9818* Disallow: /*&type=9818* Disallow: /*?type=151* Disallow: /*&type=151* # Should always be protected (.htaccess) Disallow: /*/Private/* Disallow: /fileadmin/templates/html/* Disallow: /*/Configuration/* Disallow: /typo3temp/* Allow: /typo3temp/*.css$ Allow: /typo3temp/*.css.*.gzip$ Allow: /typo3temp/*.js$ Allow: /typo3temp/*.js.*.gzip$ Allow: /typo3temp/*.jpg$ Allow: /typo3temp/*.gif$ Allow: /typo3temp/*.png$ Disallow: *.sql Disallow: *.sql.gz #nfs v9