## whitelist user agents / pages to visit for app-paths

User-agent: Googlebot
Allow: /app/
Disallow: /*.integrator-includes.txt
Disallow: /*.integrator-includes.json
Disallow: /nl/configurator.html/__app/*
Disallow: /nl/dealers.html?lat-app=*
Disallow: /nl/modellen.html?*---=*
Disallow: /nl/modellen/*.html?*---=*
Disallow: /nl/modellen/vergelijker.html?*---=*

User-agent: Slurp
Allow: /app/
Disallow: /*.integrator-includes.txt
Disallow: /*.integrator-includes.json
Disallow: /nl/configurator.html/__app/*
Disallow: /nl/dealers.html?lat-app=*
Disallow: /nl/modellen.html?*---=*
Disallow: /nl/modellen/*.html?*---=*
Disallow: /nl/modellen/vergelijker.html?*---=*

User-Agent: Bingbot
Allow: /app/
Disallow: /*.integrator-includes.txt
Disallow: /*.integrator-includes.json
Disallow: /nl/configurator.html/__app/*
Disallow: /nl/dealers.html?lat-app=*
Disallow: /nl/modellen.html?*---=*
Disallow: /nl/modellen/*.html?*---=*
Disallow: /nl/modellen/vergelijker.html?*---=*

User-Agent: msnbot
Allow: /app/
Disallow: /*.integrator-includes.txt
Disallow: /*.integrator-includes.json
Disallow: /nl/configurator.html/__app/*
Disallow: /nl/dealers.html?lat-app=*
Disallow: /nl/modellen.html?*---=*
Disallow: /nl/modellen/*.html?*---=*
Disallow: /nl/modellen/vergelijker.html?*---=*

### default block
User-agent: *
Disallow: /app/
Disallow: /*notification
Disallow: /*.integrator-includes.txt
Disallow: /*.integrator-includes.json
Disallow: /nl/configurator.html/__app/*
Disallow: /nl/dealers.html?lat-app=*
Disallow: /nl/modellen.html?*---=*
Disallow: /nl/modellen/*.html?*---=*
Disallow: /nl/modellen/vergelijker.html?*---=*

### block direct access to dam images and videos
User-agent: *
Disallow: /content/dam/*.jpeg$
Disallow: /content/dam/*.jpg$
Disallow: /content/dam/*.png$
Disallow: /content/dam/*.mp4$
Disallow: /content/dam/*.JPEG$
Disallow: /content/dam/*.JPG$
Disallow: /content/dam/*.PNG$
Disallow: /content/dam/*.MP4$
Disallow: /idhub/content/dam/*.jpeg$
Disallow: /idhub/content/dam/*.jpg$
Disallow: /idhub/content/dam/*.png$
Disallow: /idhub/content/dam/*.mp4$
Disallow: /idhub/content/dam/*.JPEG$
Disallow: /idhub/content/dam/*.JPG$
Disallow: /idhub/content/dam/*.PNG$
Disallow: /idhub/content/dam/*.MP4$

Sitemap: https://www.volkswagen.nl/nl.sitemap.xml