Base: Speeding up ad-list

[lnminente]

Bad new, the intermediate Mem-Adlist didn't give any benefits with the AdList. The good new is proxomitron does a very good work processing the 18000 AdLinks using so few CPU from my Athlon 2'8Ghz.

The test:
I went to a page with many adlinks and extracted all of them.
I copied these 9 adlinks two hundred times inside a clean html page, having 18000 adlinks and resulting an HTML file of 2'88 megabytes.

In the picture we can see two CPU load graphics, upper is firefox, down is proxomitron. The left cpu load is without using the Mem-Adlist, the right cpu load is using the Mem-Adlist.

Conclusion: no benefits while using hashed keywords from the list ( http://local.ptron/.pinfo/lists/Adlist ) Later did the same, replacing all the adlinks to get matched for keywords don't hashed, and more of the same, no benefits... I think the "mem-cache method" is something to have in mind for other methods, but not for lists of keywords hashed.

Note: The second cpu load in firefox is bigger, the reason is i didn't reboot firefox. I made more experiments taking this in mind but the results of the cpu load of proxomitron was the same.

(Mar. 16, 2009 03:26 PM)sidki3003 Wrote:  lnminente: Yep, those match a full address.

Fine, so i can forget about (^?), you know how strange is the proxomitron matching sometimes hehe

(Mar. 16, 2009 03:26 PM)sidki3003 Wrote:  Maybe you only need to modify log -> block in "Content-Type: 6c Log Third Party Scripts". (I'm currently developing "Set-Cookie: 2d Block Third Party Cookies", based on the same principle. )

You could probably automate config reloading via the "load" URL command, although i doubt that this is a practical approach, also because it would kill all open connections.

I will take a look as soon as i can Sidki. I'm currently blocking all the Set-cookie from ad-sources, and would like to complement it with 3rd party too

Code:

[HTTP headers]
In = TRUE
Out = FALSE
Key = "Set-Cookie: Block in ad sources {ln}090314 (out) TEST"
Match = "(?*)\1$URL(((\w)\2|*((^(http|ftp)://|//)(http|.|/)\w)\2)$TST(\2=(.|/|)($LST(Adlist))\9*)) $ADDLST(debug,Set-Cookie: Block in ad sources\t$DTM(Y/M/D H:m:s't)\t$GET(uDom)\t$GET(uExt)\t$GET(ContentType)\t$GET(Resp)\t$GET(ContentLength)\t\u\t\9\t\1\t\3)"
Replace = "$LOG(R$DTM(c),Set-Cookie: Remove in ad source (\9): \1 )"

By the way i'm testing now for some days and by now is working fine, to remove Location in Ad sources, maybe would be better just to block all non 200 responses... (learning about responses these days )