Post Reply 
ProxHTTPSProxyMII: Development
Jun. 03, 2014, 02:59 AM
Post: #16
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
Python SSL is still buggy. During my test on https://www.yahoo.com with the system default store, sometimes it worked and sometimes not. I don't know why.

IE and Chrome use the system default store. So far it has only 45 entries on my system. Firefox has its own store. The http://curl.haxx.se/docs/caextract.html one dated "Tue Apr 22 08:29:31 2014" has 153 entries.

Let the proxy use the Firefox store, so that we can have the same base to test.
Add Thank You Quote this message in a reply
Jun. 04, 2014, 02:04 AM
Post: #17
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
Opera21, CoolNovo, and Palemoon work well, so far.

My IE11 will not login at Yahoo through ProxHTTPSProxy. After attempting to login, it may continue to the destination URL without logging in or open a different login page that may display "The browser you're using refuses to sign in. (cookies rejected)"
Add Thank You Quote this message in a reply
Jun. 07, 2014, 09:24 AM (This post was last modified: Jun. 07, 2014 09:37 AM by whenever.)
Post: #18
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
I could reproduce the Yahoo login issue on either IE11 on windows 8.1 or IE8 on windows XP.

Those Set-Cookie response headers after a right login were sent by Yahoo server, but for some reason some of the cookie values like below were not sent back by IE to Yahoo server.

Code:
Set-Cookie: T=z=M4rkTBM...; expires=Tue, 07-Jun-2016 07:23:55 GMT; path=/; domain=.yahoo.com; HttpOnly
Set-Cookie: SSL=v=1&s=cj9Ww...; expires=Tue, 07-Jun-2016 07:23:56 GMT; path=/; domain=.yahoo.com; secure; httponly

Chrome did send them back to Yahoo server so could login successfully.

So far I have no clue why IE behaved like this.

Added: If we firstly disable IE proxy and login successfully, the login status could remain after enabling the proxy.
Add Thank You Quote this message in a reply
Jun. 07, 2014, 02:30 PM (This post was last modified: Jun. 07, 2014 02:31 PM by whenever.)
Post: #19
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
Took me several hours to come out a one line fix. Banging Head

IE has problem with multiple lines headers like below:

Code:
Set-Cookie: DNR=deleted; expires=Fri, 07-Jun-2013 13:29:34 GMT; path=/;
  domain=.www.yahoo.com

0.6b change those multiple lines headers to one line headers. Please test.


Attached File(s)
.zip  ProxHTTPSProxy 0.6b.zip (Size: 169.91 KB / Downloads: 623)
Add Thank You Quote this message in a reply
Jun. 07, 2014, 03:24 PM
Post: #20
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
Applause Works now!
I noticed the missing cookies but didn't see the multi line headers coming in.
Good catch.Thumbs Up

Thanks, you probably saved me several hours of Banging Head this morning. Wink

But we do like solving puzzles. Smile!
Add Thank You Quote this message in a reply
Jun. 08, 2014, 03:32 AM (This post was last modified: Jun. 08, 2014 08:16 AM by whenever.)
Post: #21
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
SSL handshake takes time.

Version 0.7 try to reuse connections between the browser and the proxy.

Working on reusing connections between the proxy and the server.


Attached File(s)
.zip  ProxHTTPSProxy 0.7.zip (Size: 169.76 KB / Downloads: 608)
Add Thank You Quote this message in a reply
Jun. 08, 2014, 06:17 PM (This post was last modified: Jun. 08, 2014 06:22 PM by JJoe.)
Post: #22
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
I have IE11, Palemoon 24.5.0, Opera 21.0.1432.57.
https://www.yahoo.com does not load when Web Page filtering is enabled, even when no web page filters are active.
ProxHTTPSProxy 0.7 log shows

Code:
----------------------------------------
Exception happened during processing of request from ('127.0.0.1', 65008)
Traceback (most recent call last):
  File "C:\Python34\lib\socketserver.py", line 609, in process_request_thread
    self.finish_request(request, client_address)
  File "C:\Python34\lib\socketserver.py", line 344, in finish_request
    self.RequestHandlerClass(request, client_address, self)
  File "C:\Python34\lib\socketserver.py", line 665, in __init__
    self.handle()
  File "C:\Python34\lib\http\server.py", line 398, in handle
    self.handle_one_request()
  File "C:\Python34\lib\http\server.py", line 386, in handle_one_request
    method()
  File "C:\Users\E3\Programs\ProxHTTPSProxy 0.7\proxytool.py", line 99, in do_CO
NNECT
    self.handle()
  File "C:\Python34\lib\http\server.py", line 398, in handle
    self.handle_one_request()
  File "C:\Python34\lib\http\server.py", line 386, in handle_one_request
    method()
  File "C:\Users\E3\Programs\ProxHTTPSProxy 0.7\ProxHTTPSProxy.py", line 63, in
do_METHOD
    self.wfile.write(body)
  File "C:\Python34\lib\socket.py", line 391, in write
    return self._sock.send(b)
  File "C:\Python34\lib\ssl.py", line 679, in send
    v = self._sslobj.write(data)
ConnectionResetError: [WinError 10054] An existing connection was forcibly close
d by the remote host
----------------------------------------

The Proxomitron's log window does show a response from yahoo, however.

IE11 shows

Quote:The proxy server isn’t responding

•Check your proxy settings 127.0.0.1:8079.
Go to Tools > Internet Options > Connections. If you are on a LAN, click “LAN settings”.
•Make sure your firewall settings aren’t blocking your web access.
•Ask your system administrator for help.

Same for https://www.google.com

Both sites load when Web Page filtering is not enabled.

edit: added "IE11 shows..."
Add Thank You Quote this message in a reply
Jun. 09, 2014, 01:39 AM
Post: #23
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
My bad. I always tested without Proxomitron in the chain.

Does it work if you set the ProxAddr to the rear server? Does v0.6b work with or without Proxomitron in the chain?

Get to work now.
Add Thank You Quote this message in a reply
Jun. 09, 2014, 04:21 AM
Post: #24
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
(Jun. 09, 2014 01:39 AM)whenever Wrote:  Does it work if you set the ProxAddr to the rear server? Does v0.6b work with or without Proxomitron in the chain?

Yes to both.

(Jun. 09, 2014 01:39 AM)whenever Wrote:  Get to work now.

Have a good day.

I get to bed now. lol
Add Thank You Quote this message in a reply
Jun. 09, 2014, 10:13 AM
Post: #25
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
I am not sure if it is a bug of Proxomitron but it hangs if it receives a 304 response AND the other party try to maintain the persistent connection as it asked.

The Proxomitron Changes.txt has:
Quote:Final fixes in Naoko 4.5 (release version)

* Fixed issue where under some conditions 304 replies could cause
persistent connections to get out of sync (this could cause headers
to appear in the web page body for example).

Try 0.7a please.


Attached File(s)
.zip  ProxHTTPSProxy 0.7a.zip (Size: 170.24 KB / Downloads: 620)
Add Thank You Quote this message in a reply
Jun. 09, 2014, 06:52 PM
Post: #26
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
(Jun. 09, 2014 10:13 AM)whenever Wrote:  Try 0.7a please.

It is working.Cool
Some config changes and more tests are in my future.

Thanks.
Add Thank You Quote this message in a reply
Jun. 10, 2014, 03:34 AM
Post: #27
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
0.8 uses urllib3 for server side connections reuse.

Code:
c:\Python34\Scripts>pip install urllib3

It should be the fastest version by far! Enjoy! Cool


Attached File(s)
.zip  ProxHTTPSProxy 0.8.zip (Size: 170.12 KB / Downloads: 616)
Add Thank You Quote this message in a reply
Jun. 10, 2014, 11:28 PM (This post was last modified: Jun. 10, 2014 11:39 PM by JJoe.)
Post: #28
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
(Jun. 10, 2014 03:34 AM)whenever Wrote:  It should be the fastest version by far! Enjoy! Cool

Does seem quicker but I have had the Proxomitron's log open to watch things so...

Unfortunately, I can't login at yahoo with or without the Proxomitron in the chain.

(Jun. 10, 2014 03:34 AM)whenever Wrote:  0.8 uses urllib3 for server side connections reuse.

Code:
c:\Python34\Scripts>pip install urllib3

Use a direct connection for the install!

Edit: You posted Yesterday, 10:34 PM. Sorry for the delay.
Add Thank You Quote this message in a reply
Jun. 11, 2014, 12:39 AM
Post: #29
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
I could reproduce the problem with a new IE session. I think that I didn't have the problem yesterday might be because some cookies needed by the login were already left in that IE session by prior tests.

A quick look of the Proxomitron log showed that urllib3 combined multiple Set-Cookie values into one. That might be the cause. I will check later.
Add Thank You Quote this message in a reply
Jun. 11, 2014, 01:40 AM
Post: #30
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
(Jun. 11, 2014 12:39 AM)whenever Wrote:  A quick look of the Proxomitron log showed that urllib3 combined multiple Set-Cookie values into one. That might be the cause.

I agree. I think, the browsers are expecting multiple Set-Cookies.


For the next few days, my replies and help may take a while.
I didn't have time to look for the cause.
Add Thank You Quote this message in a reply
Post Reply 


Forum Jump: