Sites with VAST cachebuster

Discussion in 'Missed Ads' started by Blaz, Jan 27, 2016.

  1. Blaz

    Blaz Moderator & Translator Staff Member Moderator

    Joined:
    Dec 21, 2014
    Messages:
    9,934
    Please list here all video sites with VAST ads using cachebuster:

    http://www.focus.de/wissen/videos/h...rei-vor-zwoelf-wie-lange-noch_id_5238943.html
    Code:
    amazonaws.com/homad-global-configs.schneevonmorgen.com/www.focus.de/config.json$replace=/"enabled": true\,/"enabled": false\,/i,domain=focus.de
    http://www.t-online.de/tv/webclips/...2/mieze-und-hund-sind-die-besten-freunde.html
    Code:
    amazonaws.com/www.t-online.de/config.json$replace=/"enabled": true\,/"enabled": false\,/i,domain=t-online.de
    http://www.rtl.de/cms/dschungelcamp-2016-nathalie-volk-muss-das-camp-verlassen-2664005.html
    Code:
    ||schneevonmorgen.com.s3.amazonaws.com/*config.json$replace=/"enabled": true\,/"enabled": false\,/i,domain=rtl.de
    
    http://www.clipfish.de/special/ich-...e-sternstunde-fuer-helena-dschungelcamp-2016/
    Code:
    ||homad-global-configs.schneevonmorgen.com.s3.amazonaws.com/global_config.json$replace=/"enabled": true\,/"enabled": false\,/i,domain=clipfish.de
    http://web.de/magazine/unterhaltung/lifestyle/fallschirmspringer-bleibt-haengen-31305606
    Code:
    amazonaws.com/www.web.de/config.json$replace=/"enabled": true\,/"enabled": false\,/i,domain=web.de
    
    Must be disabled:
    Code:
    @@||amazonaws.com^$object-subrequest,domain=gmx.net|homerj.de|spiegel.tv|sueddeutsche.de|web.de
    http://www.gmx.net/magazine/wissen/gerettetes-faultier-internet-hit-31309382
    Code:
    amazonaws.com/www.gmx.net/config.json$replace=/"enabled": true\,/"enabled": false\,/i,domain=gmx.net
    http://www.vox.de/cms/videos.html
    Code:
    @@||cdn.videoplaza.tv/contrib/de-ipd/svm/homadConfigVideoplaza-vox.json$domain=vox.de
    amazonaws.com/www.vox.de/config.json$replace=/"enabled": true\,/"enabled": false\,/i,domain=vox.de
    
    http://www.nowtv.de/rtl/ich-bin-ein-star-holt-mich-hier-raus/tag-17-das-grosse-wiedersehen/player
    Code:
     Adblock detection:
    @@||cdn.videoplaza.tv/contrib/de-ipd/svm/homadConfigVideoplaza-nowtv.json
    @@||cdn.static-fra.de/*/adcontrol.min.js$domain=rtl.de|clipfish.de|nowtv.de
    ||nowtv.de^$elemhide
    or the single rules:
    rtl.de,clipfish.de,nowtv.de#@##flashad
    rtl.de,clipfish.de,nowtv.de#@##adsense
    rtl.de,clipfish.de,nowtv.de#@##adscolumn
    rtl.de,clipfish.de,nowtv.de#@##ads_button
    rtl.de,clipfish.de,nowtv.de#@##ads728
    rtl.de,clipfish.de,nowtv.de#@##ad_rect1
    rtl.de,clipfish.de,nowtv.de#@##ad_halfpage
    rtl.de,clipfish.de,nowtv.de#@##ad300-250
    rtl.de,clipfish.de,nowtv.de#@##ads
    
    http://www.rtl2.de/sendung/promifla...30087-folge-62-justin-bieber-wird-zum-retter/:
    Code:
    amazonaws.com/www.rtl2.de/config.json$replace=/"enabled": true\,/"enabled": false\,/i,domain=rtl2.de
    
    http://www.rtlnitro.de/cms/index.html (click on first video link), it seems the site doesn't offer episodes, redirects to nowtv.de, but it requests the usual VAST files:
    Code:
    Adblock detection:
    @@||cdn.videoplaza.tv/contrib/de-ipd/svm/homadConfigVideoplaza-rtl.json
    
    http://www.sueddeutsche.de/gesundhe...irus-noch-kein-globaler-notfall-ist-1.2841900
    Code:
    amazonaws.com/www.sueddeutsche.de/config.json$replace=/"enabled": true\,/"enabled": false\,/i,domain=sueddeutsche.de
    
    http://www.pcgameshardware.de/Dying-Light-Spiel-22342/Videos/Trailer-Spielwelt-1184684/:
    Code:
    amazonaws.com/www.pcgameshardware.de/config.json$replace=/"enabled": true\,/"enabled": false\,/i,domain=pcgameshardware.de
    
    http://www.pcgames.de/Doom-2016-Spiel-56369/Videos/Video-Diskussion-1184577/
    Code:
    amazonaws.com/www.pcgames.de/config.json$replace=/"enabled": true\,/"enabled": false\,/i,domain=pcgames.de
    
    http://www.4players.de/4players.php...he_Little_Ones/NEU_Video-Test_gesprochen.html
    Code:
    schneevonmorgen.com/www.4players.de/config.json$replace=/"enabled": true\,/"enabled": false\,/i,domain=4players.de
    
    http://www.videogameszone.de/The-Re...rvival-Spinoff-Fragmented-im-Trailer-1184840/
    Code:
    amazonaws.com/www.videogameszone.de/config.json$replace=/"enabled": true\,/"enabled": false\,/i,domain=videogameszone.de
    
    http://www.gamesaktuell.de/The-Repo...rvival-Spinoff-Fragmented-im-Trailer-1184840/
    Code:
    amazonaws.com/www.gamesaktuell.de/config.json$replace=/"enabled": true\,/"enabled": false\,/i,domain=gamesaktuell.de
    
    http://www.d8.tv/d8-divertissement/...oste/pid6319-videos-extraits.html?vid=1356249
    Code:
    @@||cdn.videoplaza.tv/contrib/fr-canalplus/svm/homadConfigVideoplaza-d8.json^$domain=d8.tv
    amazonaws.com/www.d8.tv/config.json$replace=/"enabled": true\,/"enabled": false\,/i,domain=d8.tv
    http://www.clubic.com/video/trailer...a-base-d-operations-beta-xbox-one-474626.html
    Code:
    amazonaws.com/www.clubic.com/config.json$replace=/"enabled": true\,/"enabled": false\,/i,domain=clubic.com
    
    http://www.gamezone.de/Valkyria-Chr...38/Tests/SEGA-greift-zu-den-Reserven-1195748/
    Code:
    amazonaws.com/www.gamezone.de/config.json$replace=/"enabled": true\,/"enabled": false\,/i
    
    http://www.buffed.de/Overwatch-Spie...les-was-ihr-zum-Launch-wissen-muesst-1195881/
    Code:
    amazonaws.com/www.buffed.de/config.json$replace=/"enabled": true\,/"enabled": false\,/i
    
    http://videos.huffingtonpost.de/pol...n-die-ihr-heute-hoeren-werdet_id_5350334.html
    Code:
    schneevonmorgen.com/www.huffingtonpost.de/config.json$replace=/"enabled": true\,/"enabled": false\,/i
    
    http://www.autobild.de/videos/video-mercedes-gla-4566849.html (vast ad is not always playing):
    Code:
    schneevonmorgen.com/www.autobild.de/config.json$replace=/"enabled": true\,/"enabled": false\,/i 
    
    http://www.vgtv.no/#!/video/124419/treholt-bloeffen -- currently 2nd page is not needed, but may be in the future.
    Code:
    @@||cdn.videoplaza.tv/contrib/no-vg/svm/homadConfigVideoplaza-vgtv.json^$domain=vgtv.no
    cdn.videoplaza.tv/contrib/no-vg/svm/homadConfigVideoplaza-vgtv.json$replace=/"enabled": true\,/"enabled": false\,/i,domain=vgtv.no
    
    Working with current replace:

    http://www.chip.de/video/Edel-und-Kompakt-Das-Samsung-Galaxy-A3-im-Test-Video_88831896.html
    http://www.spiegel.de/video/schwarze-kasse-wm-2006-mutmasslich-gekauft-video-1617567.html
    http://www.toggo.de/videos/index-97.htm
    http://www.n24.de/n24/Mediathek/videos/d/7974880/liga-mx--favoriten-siege-mit-zauber-volleys.html
    http://www.computerbild.de/videos/c...en-auf-Kickstarter-ist-ein-Star-14985207.html
    http://www.n-tv.de/mediathek/videos...-Kaeufer-von-Chemikalien-article16859996.html

    If you find additional sites, please post them here. You will notice them when it looks like:

    http://homad-global-configs.schneevonmorgen.com.s3.amazonaws.com/global_config.json?cache=1185859356
    or
    http://bilder.static-fra.de/rtl09/flash/rtl_player.swf?cachebuster=1453860000

    EDIT: A much generic version which should resolve most VAST ads:
    Code:
    schneevonmorgen.com*/www.*/config.json$replace=/"enabled": true\,/"enabled": false\,/i
    
    EDIT2: Another generic version:
    Code:
    amazonaws.com/www*/config.json$replace=/"enabled": true\,/"enabled": false\,/i
     
    Last edited: May 23, 2016
  2. avatar

    avatar Administrator Staff Member Administrator

    Joined:
    Oct 26, 2010
    Messages:
    13,144
    Could you please tell me what's wrong with simply replacing enabled=true -> false for all "config" urls?
    It is not enough?
     
  3. Blaz

    Blaz Moderator & Translator Staff Member Moderator

    Joined:
    Dec 21, 2014
    Messages:
    9,934
    Sites which aren't working are using that cachebuster and then the ad still gets displayed as it is using the cache link and it seems Adguard is not replacing on the cache link.
     
  4. avatar

    avatar Administrator Staff Member Administrator

    Joined:
    Oct 26, 2010
    Messages:
    13,144
    Does clearing browser cache help in this case?
     
  5. Blaz

    Blaz Moderator & Translator Staff Member Moderator

    Joined:
    Dec 21, 2014
    Messages:
    9,934
    Sadly no as my browser is clearing cache everytime when I close the browser.

    Also the cache is saved on the server according to the request.
     
  6. avatar

    avatar Administrator Staff Member Administrator

    Joined:
    Oct 26, 2010
    Messages:
    13,144
    That's weird, if they were cached on the server side - AG would easily apply $replace again.
     
  7. Blaz

    Blaz Moderator & Translator Staff Member Moderator

    Joined:
    Dec 21, 2014
    Messages:
    9,934
    When I tested with RTL and T-online I had the issue it was not reapplied (rule had no domain= only suffix, so it should have applied it to, but when I manually opened the cache link it was set to enabled/true instead of disabled/false).
    Ad Muncher had no problem to replace cache value.
     
  8. avatar

    avatar Administrator Staff Member Administrator

    Joined:
    Oct 26, 2010
    Messages:
    13,144
    I am pretty sure the problem was caused by the browser cache.
    Ad Muncher suppresses browser cache which is not very good idea.

    In the RC2 Adguard also suppresses browser cache for the first 20 seconds after any change done to filtering rules.
    It should help with that issue.

    ---------- Post added 01-02-2016 at 12:13 AM ---------- Previous post was 31-01-2016 at 11:51 PM ----------

    I've just tried rtl.de + experimental filter and everything seems to be good there.
     
  9. Blaz

    Blaz Moderator & Translator Staff Member Moderator

    Joined:
    Dec 21, 2014
    Messages:
    9,934
    Just tried rtl.de and the solution is better, but sometimes in my Chrome the ad video is shown.
     

    Attached Files:

  10. avatar

    avatar Administrator Staff Member Administrator

    Joined:
    Oct 26, 2010
    Messages:
    13,144
    Could you please give more links to rtl.de videos? I am still trying a link from the first post and don't see any ads there.
     
  11. Blaz

    Blaz Moderator & Translator Staff Member Moderator

    Joined:
    Dec 21, 2014
    Messages:
    9,934
    That's the video I tried and where it sometimes show the ad.
     
  12. avatar

    avatar Administrator Staff Member Administrator

    Joined:
    Oct 26, 2010
    Messages:
    13,144
    Is it preroll all the time?

    ---------- Post added at 01:58 AM ---------- Previous post was at 01:56 AM ----------

    I suppose they may simply not show it to me because of my location.

    Could you please check browser developers tools and "network" tab there?
    Maybe we've missed one of their "config" files?

    ---------- Post added at 02:00 AM ---------- Previous post was at 01:58 AM ----------

    And one more thing worth trying:

    1. Disable this rule in German filter:
    Code:
    @@||rtl.de^*/admeta.xml?$object-subrequest
    
    2. Add this rule to user filter:
    Code:
    ||bilder.rtl.de/ip/admeta.xml$replace=/(<adconfig(.|\s)*?>)(.|\s)*<\/adconfig>/\$1<\/adconfig>/
    
     
  13. Blaz

    Blaz Moderator & Translator Staff Member Moderator

    Joined:
    Dec 21, 2014
    Messages:
    9,934
    Code:
    @@||rtl.de^*/admeta.xml?$object-subrequest
    That rule must stay enabled or else no video at all shows.
    Sadly the ad video still shows. There were only 3 json files, here is the one which had "enabled":

    Code:
    Request header:
    GET /contrib/de-ipd/svm/homadConfigVideoplaza-rtl.json?cache=2242439810 HTTP/1.1
    Host: cdn.videoplaza.tv
    Connection: keep-alive
    X-Requested-With: ShockwaveFlash/20.0.0.286
    User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.2564.97 Safari/537.36
    Accept: */*
    Referer: http://www.rtl.de/cms/dschungelcamp-2016-tag-12-nathalie-volk-muss-ich-bin-ein-star-holt-mich-hier-raus-verlassen-2664005.html
    Accept-Encoding: gzip, deflate, sdch
    Accept-Language: en-US,en;q=0.8
    
    
    Response header:
    
    HTTP/1.0 200 OK
    Content-Type: application/json
    ETag: "1323589855"
    Last-Modified: Mon, 10 Aug 2015 12:26:00 GMT
    Server: lighttpd/1.4.28
    Accept-Ranges: bytes
    X-Varnish: 1708591910 1678192956
    Date: Sun, 31 Jan 2016 23:09:13 GMT
    Connection: keep-alive
    Content-Length: 393
    X-Adguard-Rule: rule=%40%40%7C%7Cvideoplaza.tv%5E%24domain%3Drtl.de; filterId=0
    X-Adguard-Filtered: Adguard for Windows; version=6.0.167.886
    
    
    Response:
    {
        "enabled": true,
        "server": [
            "http://[hash].1.damoh.rtl.de/",
            "http://[hash].2.damoh.rtl.de/",
            "http://[hash].3.damoh.rtl.de/"
        ],
        "alias": "deipdvideoplazatv",
        "adpath": "",
        "blockForCookies": false,
        "disablecookietest": true,
        "config": "http://homad-global-configs-eu-fra.schneevonmorgen.com.s3.amazonaws.com/www.rtl.de/config.json"
    }
    EDIT: Now it doesn't show after a few tests, will monitor it.
     
    Last edited by a moderator: Jan 31, 2016
  14. avatar

    avatar Administrator Staff Member Administrator

    Joined:
    Oct 26, 2010
    Messages:
    13,144
    I've tried it before suggesting and video was ok with that rule disabled and $replace rule used instead.



     
  15. Blaz

    Blaz Moderator & Translator Staff Member Moderator

    Joined:
    Dec 21, 2014
    Messages:
    9,934
    Tomorrow is sadly not possible, but after disabling and enabling all filter subscription it works so far, currently checking the other sites and will monitor rtl.de.

    ---------- Post added at 12:45 AM ---------- Previous post was at 12:35 AM ----------

    I just checked and finished rules for the other sites, you can find them in the 1st post.

    EDIT2: Added a few others sites and rules :)
     
    Last edited by a moderator: Feb 1, 2016
  16. avatar

    avatar Administrator Staff Member Administrator

    Joined:
    Oct 26, 2010
    Messages:
    13,144
    Great list! We'll transfer most of these rules to the German filter shortly after v6 release.
     
  17. Blaz

    Blaz Moderator & Translator Staff Member Moderator

    Joined:
    Dec 21, 2014
    Messages:
    9,934
    It seems the issue with rtl.de (and cachebuster) is gone with RC2 finally, don't know why I had issues yesterday.
     
  18. Alex302

    Alex302 Filters Developer Staff Member Administrator

    Joined:
    Jul 20, 2012
    Messages:
    24,899
    This works without ads
    http://www.chip.de/video/Edel-und-Kompakt-Das-Samsung-Galaxy-A3-im-Test-Video_88831896.html
    http://www.spiegel.de/video/schwarze-kasse-wm-2006-mutmasslich-gekauft-video-1617567.html
    http://www.toggo.de/videos/index-97.htm
    ---
    Added(to EF) your rules and:
    http://www.n24.de/n24/Mediathek/vide...r-volleys.html
    Code:
    ||amazonaws.com/www.web.de/config.json$replace=/"enabled": true\,/"enabled": false\,/i,domain=web.de
    http://www.computerbild.de/videos/c...en-auf-Kickstarter-ist-ein-Star-14985207.html
    don't see ads, only remains of ad player(overlay on the main player)
    Code:
    computerbild.de##body > div[id][style^="z-index:"]
    http://www.n-tv.de/mediathek/videos/politik/Polizei-fahndet-nach-verdaechtigem-Kaeufer-von-Chemikalien-article16859996.html
    does it works on you end? I see endless loading.

    Please, check after update, didn't I forgot something?:)
     
  19. Blaz

    Blaz Moderator & Translator Staff Member Moderator

    Joined:
    Dec 21, 2014
    Messages:
    9,934
    It seems computerbild.de doesn't show them currently.
    n-tv.de shows fine here.

    Following exclusion rules are active for n-tv.de when playing a video:
    Code:
    @@||videoplaza.tv/proxy/
    @@||rtl.de^$generichide
    @@||videoplaza.tv/crossdomain.xml
    @@||videoplaza.tv/resources/
    @@n-tv.de/stat/ <- in my user filter
    
    It will take a while until the updates are available in the filter, therefore have to check later.
     
  20. Alex302

    Alex302 Filters Developer Staff Member Administrator

    Joined:
    Jul 20, 2012
    Messages:
    24,899
    What I need do with these exclusions?:)