Post Reply 
Blocklist Additions
Jan. 20, 2009, 05:27 AM
Post: #1
Blocklist Additions
This thread is intended to be a topic where you can share any links/code that have some unwanted element not removed.

I came across a banner that wasn't blocked (which was quite noticeable as it's the first one I've come across ITW with Sidki's latest config pack, a really good thing Cheers).

Sidki, please let me know if my approach is correct, and if it's the best method of removing these elements Wink

AdPaths:
Code:
aff.id
Example:
Code:
<a href="http://www.download-provider.com/?aff.id=1321&aff.subid=1" target = "_top">**banner here**</a>

EDIT:

AdKeys:
Code:
textbanner&&\7
http://www.vcdq.com/index.php

AdKeys-J:
Code:
cpmstar_[a-z]+$TST(\3=>)
http://www.animesuki.com/
Visit this user's website
Add Thank You Quote this message in a reply
Jan. 20, 2009, 12:32 PM
Post: #2
RE: Blocklist Additions
I'm going to explain it from a developer perspective, not the one of a private user.
How to block ads depends on the scope you want to target.

Single sites:
You wouldn't use the general ad lists, but try to manage it with the specific lists, AdKeys-S and IncludeExclude(-U).

If a solution with site-specific lists isn't possible, if you don't see any generic patterns, and if it isn't a very popular site, you would leave the ad alone and live with it.

If it's a very popular site and the ad is annoying, you would think about that problem while promenading, cooking, etc. Wink

Example for AdKeys-S:
Code:
www.vcdq.com/            $SET(sAdKey=.textbanner.)

As for the IncludeExclude lists, the respective section is:
3 INCLUDE (BLOCK, FAKE, SITE-SPECIFIC)



Generic additions:
You would add test entries to the respective general lists.

1st case - AdPaths:
Code:
aff.id
  ($TST(volat=*.log:[12]*)$ADDLST(Log-Rare,ALST AdP aff.id\t\u)|)

2nd case - AdKeys:
Code:
textbanner
  &&(($TST(volat=*.log:[12]*)\8&$ADDLST(Log-Rare,AKEY-H \8 \t\u))|*)

3rd case - AdHost-J:
Code:
([^/]++.|)cpmstar.com/
  &&(($TST(volat=*.log:[12]*)\8&$ADDLST(Log-Rare,ALST AdHj \8 \t\u))|*)

Regarding case 3, once you get a couple of matches, you would narrow ([^/]++.|) further down (i think i've seen server.cpmstar.com ads before).
If you're a super professional, you would also add a "cpmstar.com" test entry to AdDomains, which matches after AdHosts-J, to see if this domain also serves non-JS ads.


Regarding all cases, you would regularly check your Log-Rare.log and wait for 3-20 matches per test entry, depending on severeness / annoyance-level.

It doesn't matter if an entry looks plausible. For instance, right now i have test entries in AdPaths for coread(s|) , adsleft[a-z0-9]+ , adsright[a-z0-9]+ , popover[0-9]+. They all just produced one or two hits so far, so they probably won't make it into the distributed list.
Add Thank You Quote this message in a reply
Feb. 01, 2009, 05:49 AM
Post: #3
RE: Blocklist Additions
Thanks for that very informative post; I've certainly learned more about the blocklists and the work behind deciding which strings are generic or site-specific!

I was thinking, would it be helpful to you if members told you how many times "coread(s|) , adsleft[a-z0-9]+ , adsright[a-z0-9]+ , popover[0-9]+" were matched?
Visit this user's website
Add Thank You Quote this message in a reply
Feb. 01, 2009, 03:18 PM
Post: #4
RE: Blocklist Additions
(Feb. 01, 2009 05:49 AM)Kye-U Wrote:  I was thinking, would it be helpful to you if members told you how many times "coread(s|) , adsleft[a-z0-9]+ , adsright[a-z0-9]+ , popover[0-9]+" were matched?

Absolutely! The entire "matched" lines, that is. You'll find all matches for code/list entries which are currently under test in your Log-Rare.log. In beta configs there's a lot of them, in release configs very few.
Add Thank You Quote this message in a reply
Feb. 06, 2009, 07:09 AM
Post: #5
RE: Blocklist Additions
Hi sidki,
I would like to log these entries, (and do a lot of surfing Whistling) to post some results, could you just elaborate which of those 3 cases need to be added please ? Smile!
Add Thank You Quote this message in a reply
Feb. 06, 2009, 01:56 PM
Post: #6
RE: Blocklist Additions
Hi Toppy, i've already removed above mentioned test entries, but there's a lot under test in the config version you're using. If you open your Log-Rare.log, you'll see several types of entries, distinguishable by their initial string.

AKEY: entries in the AdKey lists
ALST: entries in other ad lists
HDR: test code in header filters
WEB: test code in web filters

If you'd like to post/attach any of these, great.
Add Thank You Quote this message in a reply
Feb. 06, 2009, 09:45 PM
Post: #7
RE: Blocklist Additions
Got a whole bunch in there, perhaps these are the most of interest :
Code:
AKEY-J nuconomy     http://ps3.ign.com/
AKEY-J NUCONOMY     http://ps3.ign.com/
AKEY-J nuconomy     http://ps3.ign.com/articles/919/919111p1.html
AKEY-J NUCONOMY     http://ps3.ign.com/articles/919/919111p1.html
AKEY-J pm_scripthost     http://support.purenetworks.com/cgi-bin/pure.cfg/php/enduser/std_alp.php?p_sid=BC-nEwoj
AKEY-J nuconomy     http://media.ps3.ign.com/media/856/856680/image_frame.html
AKEY-J NUCONOMY     http://media.ps3.ign.com/media/856/856680/image_frame.html
AKEY-J nuconomy     http://media.ps3.ign.com/media/856/856680/vids_1.html
AKEY-J NUCONOMY     http://media.ps3.ign.com/media/856/856680/vids_1.html
ALST AdPj oeTriggerParams     http://www.macromedia.com/support/documentation/en/flashplayer/help/settings_manager02.html
ALST AdPj oeLauncher     http://www.macromedia.com/support/documentation/en/flashplayer/help/settings_manager02.html
WEB JS_Sniff Refetch     http://www.realmatch.com/Widgets/Pages/Widget_JSON.aspx?op=getWidget&widgetID=442&CallBack=writeWidget Ref: http://www.majorgeeks.com/ CT: text/plain; charset=utf-8; PrxMsg: Filter Text
ALST AdPj elqNow     http://www.solarwinds.com/products/
ALST AdPj elqNow     http://www.solarwinds.com/products/
AKEY-J pm_scripthost     http://billing.finance.yahoo.com/realtime_quotes/signup?.src=quote&.refer=qb
AKEY-J pm_scripthost     http://billing.finance.yahoo.com/realtime_quotes/signup?.src=quote&.refer=qb


Attached File(s)
.txt  Log-Rare.log.txt (Size: 100.47 KB / Downloads: 416)
Add Thank You Quote this message in a reply
Feb. 06, 2009, 09:50 PM
Post: #8
RE: Blocklist Additions
Thanks! Smile!
Add Thank You Quote this message in a reply
Feb. 06, 2009, 11:45 PM
Post: #9
RE: Blocklist Additions
Here is mine Smile!

BTW, I just added .log files to the allowed attachments list Wink


Attached File(s)
.log  Log-Rare.log (Size: 4.94 KB / Downloads: 296)
Visit this user's website
Add Thank You Quote this message in a reply
Feb. 07, 2009, 12:55 AM
Post: #10
RE: Blocklist Additions
Thanks again guys, you're accelerating things significantly.
Add Thank You Quote this message in a reply
Feb. 07, 2009, 03:43 AM
Post: #11
RE: Blocklist Additions
(Feb. 06, 2009 01:56 PM)sidki3003 Wrote:  AKEY: entries in the AdKey lists
ALST: entries in other ad lists
HDR: test code in header filters
WEB: test code in web filters
How about adding them in the Abbreviations.txt or in the header of Log-Main.log and Log-Rare.log so other users know what they mean?
Add Thank You Quote this message in a reply
Feb. 07, 2009, 03:13 PM
Post: #12
RE: Blocklist Additions
Here's my log-rare. Hope that it helps.


Attached File(s)
.txt  Log-Rare.txt (Size: 3.63 KB / Downloads: 374)
Add Thank You Quote this message in a reply
Feb. 07, 2009, 08:34 PM
Post: #13
RE: Blocklist Additions
Thanks 43unite. Sure.


whenever, good idea, for Log-Rare.

Log-Main is somewhat different. It doesn't log test code matches, but all filter hits that may cause problems on a page.
Logging is time-stamped and invoked by CTRL + SHIFT + Reload.
(I always use this log file, instead of the log window; latter just for looking at headers.)
Add Thank You Quote this message in a reply
Feb. 07, 2009, 09:53 PM
Post: #14
RE: Blocklist Additions
Code:
###############################################################################
#
#  LOGFILE NOADDURL LST(Log-Rare) -- Naoko 4.5
#  Logs uncommon filter hits and test code matches
#
#  The type of entry can be identified by its initial string:
#    AKEY: Test entries in one of the AdKey lists
#    ALST: Test entries in other ad lists
#    HDR:  Header filters -- Rare hits or test code matches
#    WEB:  Web filters -- Rare hits or test code matches
#
#  You can help improving this config set by sending in those entries that you
#  don't mind to share.
#
#  You can reduce verbosity by deactivating the "4.2 Log common Nuisances"
#  header filter.
#
###############################################################################
Add Thank You Quote this message in a reply
Feb. 08, 2009, 06:03 AM
Post: #15
RE: Blocklist Additions
Here's my little contribution.

.rar  Log-Rare.rar (Size: 866 bytes / Downloads: 324)
Add Thank You Quote this message in a reply
Post Reply 


Forum Jump: