Ola,
Every day new proxy lists are released. But most of the time half of them is broken or is useless (like in, slowwwwww). To check this quickly I wrote a simple script that will identify if the Proxy is alive and what its speed is. This is how I determined this:
1. I made sure I let the connection timeout after 5 seconds (I’m sorry but if the connection already takes 5 seconds, what is the rest going to be?)
2. See how long it takes to visit a page (I use a website like IP-chicken or whatsmyip.com to verify I’m working via a proxy)
These are the results (proxy list input via http://www.governmentsecurity.org/forum/topic/33774-2012-02-12-281-scrapebox-passed-http-proxies-freshly-verified-w-screenshot/):
#I cant explain the -59 yet. I'll try to fix that bugFast proxy found: 110.164.191.30:3128, operation took -59 seconds. Useless proxy found: 92.46.119.133:3128, operation took 5 seconds. Slow proxy found: 190.203.132.88:8080, operation took 3 seconds. Medium proxy found: 190.237.114.161:3128, operation took 2 seconds. Medium proxy found: 180.183.128.157:3128, operation took 2 seconds. Fast proxy found: 180.183.97.144:3128, operation took 1 seconds. Useless proxy found: 41.233.175.33:8080, operation took 6 seconds. Medium proxy found: 110.139.207.52:8080, operation took 2 seconds. Fast proxy found: 118.82.28.67:8080, operation took 1 seconds. Fast proxy found: 195.28.31.62:8181, operation took 1 seconds. Fast proxy found: 187.72.87.137:8080, operation took 1 seconds. Fast proxy found: 202.162.223.138:8080, operation took 1 seconds. Medium proxy found: 119.160.177.119:8118, operation took 2 seconds.
[edit]
Geo location
* 1 x 180.183.128.157 | Thailand - Bangkok * 1 x 118.82.28.67 | Indonesia - Jakarta * 1 x 187.72.87.137 | Brazil - * 1 x 119.160.177.119 | Brunei Darussalam - Bandar Seri Begawan * 1 x 180.183.97.144 | Thailand - Bangkok * 1 x 41.233.175.33 | Egypt - Cairo * 1 x 190.237.114.161 | Peru - Lima * 1 x 195.28.31.62 | Ukraine - * 1 x 92.46.119.133 | Kazakstan - Astana * 1 x 202.162.223.138 | Indonesia - Jakarta * 1 x 190.203.132.88 | Venezuela - Caracas * 1 x 110.139.207.52 | Indonesia - Makasar * 1 x 110.164.191.30 | Thailand - Bangkok
These are the results of the published list this morning (http://www.governmentsecurity.org/forum/topic/33779-2012-02-13-323-scrapebox-passed-http-proxies-freshly-verified-w-screenshot/):
Fast proxy found: 180.183.200.209:3128, operation took 1 seconds. Medium proxy found: 180.183.200.66:3128, operation took 2 seconds. Medium proxy found: 110.171.16.246:3128, operation took 2 seconds. Fast proxy found: 180.183.71.49:3128, operation took 1 seconds. Medium proxy found: 92.96.179.234:8118, operation took 2 seconds. Fast proxy found: 187.122.112.48:3128, operation took 1 seconds. Medium proxy found: 180.183.200.50:3128, operation took 2 seconds. Fast proxy found: 41.43.179.125:8080, operation took 1 seconds. Slow proxy found: 41.35.231.164:8080, operation took 3 seconds. Fast proxy found: 190.239.144.160:80, operation took 1 seconds. Medium proxy found: 92.98.23.251:8118, operation took 2 seconds. Medium proxy found: 41.35.46.57:8080, operation took 2 seconds. Fast proxy found: 41.35.45.15:8080, operation took 1 seconds. Fast proxy found: 201.75.26.97:3128, operation took 1 seconds. Fast proxy found: 190.204.133.66:8080, operation took 1 seconds. Fast proxy found: 41.233.43.55:8080, operation took 1 seconds. Medium proxy found: 92.96.195.137:8118, operation took 2 seconds. Fast proxy found: 41.235.11.236:8080, operation took 1 seconds. Medium proxy found: 109.127.33.81:8118, operation took 2 seconds. Medium proxy found: 189.10.143.90:3128, operation took 2 seconds. Medium proxy found: 41.237.230.212:8080, operation took 2 seconds. Fast proxy found: 41.43.14.78:8080, operation took 1 seconds. Fast proxy found: 201.75.110.2:3128, operation took 1 seconds. Fast proxy found: 110.77.193.25:3128, operation took 1 seconds. Fast proxy found: 110.77.193.6:3128, operation took 1 seconds. Slow proxy found: 171.98.162.44:3128, operation took 4 seconds. Medium proxy found: 41.238.213.254:8080, operation took 2 seconds. Medium proxy found: 180.248.71.37:8080, operation took 2 seconds. Useless proxy found: 180.248.10.112:8080, operation took 6 seconds. Useless proxy found: 41.237.230.108:8080, operation took 5 seconds. Fast proxy found: 186.3.41.22:3127, operation took -59 seconds. Fast proxy found: 60.48.86.184:8118, operation took -59 seconds. Fast proxy found: 180.183.232.203:3128, operation took -58 seconds. Slow proxy found: 41.43.77.64:8080, operation took 4 seconds. Fast proxy found: 190.204.68.133:8080, operation took -55 seconds. Medium proxy found: 190.9.14.66:8118, operation took 2 seconds. Medium proxy found: 41.236.172.189:8080, operation took 2 seconds. Medium proxy found: 92.99.33.193:8118, operation took 2 seconds. Useless proxy found: 41.236.173.223:8080, operation took 5 seconds. Useless proxy found: 41.236.175.154:8080, operation took 6 seconds. Medium proxy found: 180.183.106.26:3128, operation took 2 seconds. Fast proxy found: 41.43.31.1:8080, operation took 1 seconds. Slow proxy found: 190.203.108.70:8080, operation took 4 seconds. Slow proxy found: 190.74.255.232:8080, operation took 3 seconds. Slow proxy found: 186.113.186.91:8080, operation took 4 seconds. Useless proxy found: 173.19.119.62:6515, operation took 5 seconds. Useless proxy found: 92.96.152.71:8118, operation took 5 seconds. Medium proxy found: 110.77.234.150:3128, operation took 2 seconds. Medium proxy found: 61.90.21.96:3128, operation took 2 seconds. Fast proxy found: 200.109.164.238:8080, operation took 1 seconds. Medium proxy found: 41.43.230.12:8080, operation took 2 seconds. Useless proxy found: 190.203.81.101:8080, operation took 6 seconds. Fast proxy found: 187.79.197.112:8080, operation took 1 seconds. Fast proxy found: 41.238.58.193:8080, operation took 1 seconds. Fast proxy found: 118.96.165.160:8080, operation took 1 seconds. Slow proxy found: 180.248.37.98:8080, operation took 3 seconds. Fast proxy found: 41.235.61.218:8080, operation took 1 seconds. Fast proxy found: 190.203.72.219:8080, operation took 1 seconds. Medium proxy found: 118.97.170.162:80, operation took 2 seconds. Fast proxy found: 187.54.67.169:3128, operation took 1 seconds. Medium proxy found: 118.97.193.74:8080, operation took 2 seconds. Fast proxy found: 119.152.119.60:8080, operation took 1 seconds. Fast proxy found: 110.77.148.124:3128, operation took 1 seconds. Medium proxy found: 180.183.111.181:3128, operation took 2 seconds. Slow proxy found: 41.43.79.126:8080, operation took 3 seconds. Medium proxy found: 189.75.171.226:3128, operation took 2 seconds. Slow proxy found: 201.75.112.40:3128, operation took 4 seconds. Slow proxy found: 118.97.8.106:8080, operation took 4 seconds. Fast proxy found: 190.204.79.181:8080, operation took 1 seconds. Fast proxy found: 190.121.22.186:8080, operation took 1 seconds. Slow proxy found: 190.203.81.212:8080, operation took 3 seconds. Medium proxy found: 61.6.252.117:8118, operation took 2 seconds. Medium proxy found: 201.75.4.245:3128, operation took 2 seconds. Useless proxy found: 110.139.174.226:3128, operation took 6 seconds. Medium proxy found: 180.241.252.45:8080, operation took 2 seconds. Medium proxy found: 180.242.62.150:8088, operation took 2 seconds. Useless proxy found: 182.72.244.210:8080, operation took 8 seconds. Useless proxy found: 119.110.65.173:8080, operation took 5 seconds.
Ow in case you need this. Their geo location:
* 1 x 109.127.33.81 | Azerbaijan - * 1 x 110.139.174.226 | Indonesia - * 1 x 41.236.175.154 | Egypt - * 1 x 190.203.81.212 | Venezuela - Valencia * 1 x 41.43.14.78 | Egypt - * 1 x 190.9.14.66 | Argentina - Mar Del Plata * 1 x 41.43.77.64 | Egypt - * 1 x 200.109.164.238 | Venezuela - Caracas * 1 x 41.35.231.164 | Egypt - Mansoura * 1 x 110.77.193.25 | Thailand - * 1 x 118.97.8.106 | Indonesia - Semarang * 1 x 180.183.111.181 | Thailand - Bangkok * 1 x 92.96.152.71 | United Arab Emirates - Dubai * 1 x 41.238.58.193 | Egypt - Hurghada * 1 x 180.183.200.50 | Thailand - * 1 x 180.248.10.112 | Indonesia - Jakarta * 1 x 41.237.230.108 | Egypt - * 1 x 41.43.31.1 | Egypt - * 1 x 180.183.232.203 | Thailand - Lop Buri * 1 x 118.97.193.74 | Indonesia - Jakarta * 1 x 60.48.86.184 | Malaysia - Petaling Jaya * 1 x 171.98.162.44 | Thailand - Bangkok * 1 x 180.183.200.66 | Thailand - * 1 x 41.35.46.57 | Egypt - Cairo * 1 x 41.237.230.212 | Egypt - * 1 x 201.75.112.40 | Brazil - Manaus * 1 x 110.77.234.150 | Thailand - * 1 x 41.43.79.126 | Egypt - * 1 x 180.183.106.26 | Thailand - Bangkok * 1 x 180.242.62.150 | Indonesia - Jambi * 1 x 41.235.61.218 | Egypt - G.za * 1 x 41.43.179.125 | Egypt - * 1 x 190.74.255.232 | Venezuela - Barquisimeto * 1 x 189.75.171.226 | Brazil - Irati * 1 x 190.203.81.101 | Venezuela - Valencia * 1 x 180.241.252.45 | Indonesia - Batam * 1 x 92.99.33.193 | United Arab Emirates - Abu Dhabi * 1 x 41.35.45.15 | Egypt - Cairo * 1 x 110.171.16.246 | Thailand - * 1 x 190.239.144.160 | Peru - Huancavelica * 1 x 201.75.110.2 | Brazil - Manaus * 1 x 190.204.79.181 | Venezuela - Valencia * 1 x 180.183.71.49 | Thailand - Bangkok * 1 x 118.97.170.162 | Indonesia - Jakarta * 1 x 41.238.213.254 | Egypt - * 1 x 186.3.41.22 | Ecuador - Guayaquil * 1 x 173.19.119.62 | United States - Archie * 1 x 41.233.43.55 | Egypt - * 1 x 61.6.252.117 | Brunei Darussalam - Brunei * 1 x 190.203.72.219 | Venezuela - Valencia * 1 x 92.98.23.251 | United Arab Emirates - Dubai * 1 x 190.204.133.66 | Venezuela - Guatire * 1 x 118.96.165.160 | Indonesia - Kebumen * 1 x 119.152.119.60 | Pakistan - Lahore * 1 x 61.90.21.96 | Thailand - Bangkok * 1 x 187.79.197.112 | Brazil - Fortaleza * 1 x 41.236.173.223 | Egypt - * 1 x 41.43.230.12 | Egypt - * 1 x 92.96.179.234 | United Arab Emirates - Dubai * 1 x 189.10.143.90 | Brazil - * 1 x 180.248.37.98 | Indonesia - Jakarta * 1 x 190.203.108.70 | Venezuela - Valencia * 1 x 201.75.4.245 | Brazil - Manaus * 1 x 187.122.112.48 | Brazil - Embu * 1 x 180.183.200.209 | Thailand - * 1 x 190.204.68.133 | Venezuela - Valencia * 1 x 41.236.172.189 | Egypt - * 1 x 201.75.26.97 | Brazil - Manaus * 1 x 182.72.244.210 | India - Hyderabad * 1 x 187.54.67.169 | Brazil - Parano * 1 x 110.77.193.6 | Thailand - * 1 x 119.110.65.173 | Indonesia - Jakarta * 1 x 186.113.186.91 | Colombia - Bogot * 1 x 190.121.22.186 | Chile - Temuco * 1 x 92.96.195.137 | United Arab Emirates - Sharjah * 1 x 110.77.148.124 | Thailand - * 1 x 41.235.11.236 | Egypt - Alexandria * 1 x 180.248.71.37 | Indonesia - Jakarta
[/edit]
Have fun!
* I’ll release my tool soon after I did some cleaning up
Cheers,
Ruben.