Post Reply 
Base: Speeding up ad-list
Feb. 20, 2009, 06:53 AM
Post: #3
RE: Base: Speeding up ad-list
Regarding speed -- I don't know if this is of any relevance to the Base Config approach, or even applicable, but i thought i'd share:

When switching to Paul Rupe's 3-list approach (AdHosts, AdDomains, AdPaths), i got a significant speed boost, mainly because the list invoking expression could be much better tailored to the actual list content.

There is a fourth list, "AdList", which acts as a hub for the other lists. I was messing around a lot with it to get it right. Now an (off-domain host testing) entry looks like:
Code:
http(s|):\\+/\\+/
  (^([^/]++.|)$TST(uDom)(^.))$TST(flag=(^*.adurl_l:[12].)(.)\9*|*)
  (($LST(AdHosts))\8(^[a-z0-9])$SET(9=AdH \8)
  |([^/]++.|)($LST(AdDomains))\8(^[a-z0-9])$SET(9=AdD \8)
  |[^/?]+*[/._?&;=-]($LST(AdPaths))\8(^[a-z0-9])$SET(9=AdP \8))

Same test with "ftp(s|):\\+/\\+/" and "//". I've never seen an FTP - let alone secure FTP - ad server. That test is just still in to keep that list hashable (and - to a lesser extend - for completeness).

Most of above code isn't exactly interesting, but the tailored list invocation expressions work pretty well for me:
AdHosts: No wildcarding needed.
AdDomains: ([^/]++.|)
AdPaths: [^/?]+*[/._?&;=-]
Add Thank You Quote this message in a reply
Post Reply 


Messages In This Thread
Base: Speeding up ad-list - lnminente - Feb. 19, 2009, 11:57 PM
RE: Base: Speeding up ad-list - whenever - Feb. 20, 2009, 06:34 AM
RE: Base: Speeding up ad-list - sidki3003 - Feb. 20, 2009 06:53 AM
RE: Base: Speeding up ad-list - lnminente - Feb. 20, 2009, 05:16 PM
RE: Base: Speeding up ad-list - sidki3003 - Feb. 20, 2009, 05:41 PM
RE: Base: Speeding up ad-list - Kye-U - Feb. 20, 2009, 06:17 PM
RE: Base: Speeding up ad-list - sidki3003 - Feb. 20, 2009, 07:30 PM
RE: Base: Speeding up ad-list - lnminente - Feb. 20, 2009, 06:30 PM
RE: Base: Speeding up ad-list - Kye-U - Feb. 20, 2009, 06:32 PM
RE: Base: Speeding up ad-list - lnminente - Feb. 20, 2009, 07:37 PM
RE: Base: Speeding up ad-list - Kye-U - Feb. 21, 2009, 04:54 AM
RE: Base: Speeding up ad-list - Siamesecat - Feb. 21, 2009, 06:31 AM
RE: Base: Speeding up ad-list - lnminente - Feb. 21, 2009, 03:39 PM
RE: Base: Speeding up ad-list - lnminente - Mar. 15, 2009, 07:13 PM
RE: Base: Speeding up ad-list - sidki3003 - Mar. 15, 2009, 08:35 PM
RE: Base: Speeding up ad-list - lnminente - Mar. 15, 2009, 09:47 PM
RE: Base: Speeding up ad-list - whenever - Mar. 16, 2009, 03:15 AM
RE: Base: Speeding up ad-list - lnminente - Mar. 16, 2009, 10:17 AM
RE: Base: Speeding up ad-list - sidki3003 - Mar. 16, 2009, 03:26 PM
RE: Base: Speeding up ad-list - lnminente - Mar. 16, 2009, 08:08 PM
RE: Base: Speeding up ad-list - ProxRocks - Mar. 17, 2009, 12:42 AM
RE: Base: Speeding up ad-list - lnminente - Mar. 17, 2009, 12:17 PM
RE: Base: Speeding up ad-list - lnminente - May. 27, 2009, 01:04 AM

Forum Jump: