ucj nocookie IP`s

[Dan S]

The following stats are nocookie stats on an UCJ tgp with 130k total incoming, 70% content, entrance is a gateway to the categories, no trade links on the mainpage other than the top19 list.<br /><br />Chances are good that alot of that nocookie traffic is valid, because people are able to bookmark the category pages directly and switch categories. So that way ucj doesnt count that traffic in and cant place a cookie.<br /><br />Incoming from nocookie<br />Raw:921 Uniques:305 Percent:33.12<br /><br />Outgoing generated by nocookie<br />Raw:73887 Uniques:4617 Percent:6.25<br /><br />Referring URL<br />921 - nocookie<br /><br />Most Popular Links<br />7103 - GMovie<br />5285 - GMature Lady<br />5248 - GBig Tit<br />4463 - GGroupsex<br />4130 - divert<br />3708 - GTranssexual<br />3470 - GBlack Babe<br />3328 - GHardcore<br />3283 - GAsian<br />3199 - GCumshot<br />3179 - GCartoon<br />3087 - GTeen<br />2390 - GFat Girl<br />2181 - GGay<br />2144 - GBabe<br />2080 - GAnalsex<br />2072 - GInterracial<br />1937 - GAmateur<br />1916 - GPornstar<br />1896 - GLesbian<br />1798 - GBlowjob<br />1736 - GToy Action<br />1371 - GFetish<br />1009 - GCelebrity<br />353 - top<br />333 - GFat<br />294 - GMature<br />204 - GBig<br />179 - GToy<br />127 - GLatina<br /><br />Incoming Repetitive IP's<br />97 - 210.141.40.166<br />78 - 80.130.148.44<br />46 - 141.158.71.20<br />40 - 172.177.86.56<br />35 - 152.163.188.66<br />33 - 216.175.121.43<br />27 - 144.138.242.212<br />27 - 65.101.30.227<br />23 - 172.178.10.202<br />14 - 66.169.165.119<br />14 - 12.79.36.246<br />11 - 64.12.96.41<br />11 - 203.147.0.42<br />11 - 211.216.216.34<br />10 - 62.5.175.66<br />10 - 217.185.240.18<br />8 - 61.189.146.69<br />7 - 68.12.136.85<br />7 - 203.147.49.247<br />7 - 203.147.49.250<br />6 - 217.36.33.184<br />6 - 62.2.65.155<br />6 - 64.12.96.206<br />5 - 63.188.192.44<br />5 - 172.182.53.192<br />5 - 209.226.210.181<br />5 - 193.248.169.55<br />5 - 152.163.189.166<br />5 - 205.188.208.106<br />5 - 80.12.139.163<br /> 886 - none <br />3 - 213.7.90.146 <br />2 - 212.22.63.2 <br />2 - 212.198.217.93 <br />2 - 192.168.1.2 <br />2 - 212.183.253.190 <br />1 - 213.151.42.178 <br />1 - 24.65.27.144 <br />1 - 203.173.193.24 <br />1 - 211.178.70.135 <br />1 - 62.107.244.163 <br />1 - 210.54.87.86 <br />1 - 202.133.166.2 <br />1 - 212.42.81.222 <br />1 - 192.0.0.195 <br />1 - 213.224.180.114, 213.224.83.78 <br />1 - 200.64.253.60 <br />1 - 66.84.194.60 <br />1 - 213.153.187.175 <br />1 - 213.151.38.131 <br />1 - 62.137.117.198 <br />1 - 24.77.1.226 <br />1 - 209.240.220.147 <br />1 - 209.240.220.195 <br />1 - 211.177.119.213 <br />1 - 212.111.147.27 <br />1 - 192.168.100.9 <br />1 - 192.168.99.10 <br />1 - 10.100.8.158 <br />1 - 62.136.56.166 <br /> <br /><br />Outgoing Repetitive IP's<br />4130 - 209.198.37.101<br />512 - 217.136.116.145<br />493 - 193.50.225.138<br />329 - 24.150.83.187<br />286 - 61.229.54.179<br />277 - 62.99.88.10<br />249 - 211.216.216.93<br />246 - 142.177.209.239<br />245 - 68.44.18.207<br />241 - 62.7.65.242<br />223 - 24.147.226.226<br />216 - 212.185.225.59<br />212 - 194.65.14.69<br />212 - 194.30.220.164<br />209 - 213.65.200.243<br />197 - 12.79.192.195<br />197 - 211.216.216.34<br />195 - 200.40.105.196<br />195 - 213.45.200.238<br />192 - 209.86.186.62<br />190 - 195.151.195.43<br />189 - 80.132.230.18<br />188 - 217.36.33.184<br />186 - 61.144.128.16<br />185 - 12.219.164.179<br />184 - 217.82.162.15<br />182 - 61.196.165.47<br />181 - 24.46.146.1<br />180 - 164.77.246.67<br />179 - 212.185.225.251<br /> 65822 - none<br />250 - 62.99.32.92<br />209 - 213.65.203.130<br />202 - 195.97.119.208<br />180 - 200.72.30.26<br />173 - 203.173.193.24<br />158 - 217.17.230.13<br />154 - unknown<br />150 - 210.86.56.136<br />116 - 218.97.197.158<br />112 - 217.136.94.172<br />105 - 213.6.37.136<br />97 - 192.168.1.2<br />96 - 66.84.194.60<br />85 - 213.44.149.137<br />83 - 210.49.120.126<br />79 - 213.33.5.67<br />76 - 62.42.25.50<br />75 - 212.198.217.93<br />74 - 213.33.23.13<br />74 - 198.142.239.96<br />73 - 195.252.136.186<br />72 - 62.136.56.166<br />69 - 62.137.64.230<br />68 - unknown, 130.88.96.65<br />68 - 192.168.1.3<br />62 - 213.7.116.66<br />61 - 213.6.55.108<br />61 - 213.224.132.169<br />59 - 24.77.1.226

[Dan S]

Ok, its easy to say that<br />Outgoing Repetitive IP's<br />4130 - 209.198.37.101<br /><br />is bullshit traffic.<br />The IP does not appear in the repetative incoming IP`s, so it could be a teleport or something similar. So I will just block it now.<br /><br />But where to draw the line, how do I know which IP is good and which is not?

['Plat]

Dan its a pronbot. They hit my site up bad, i had over 10,000 hits coming from 5 different ip's at one time... not to forget the other 20 with like 1000+ plus hits out.<br /><br />Ruins UCJ cookies setting them to 0.00 if you get hit hard enough killing all your trades. I have made a script for my site that stops these things but I'm not willing to give it out to anyone. Might fall in the wrong hands and id be screwing myself. Sorry hope you find a solution. There is another way around them and thats to put all your galleries in a database and call them from a php script.. i.e "gallery.php?teens".

[Dan S]

What exactly is pronbot?<br /><br />I mean, is it only the excessive<br />Outgoing Repetitive IP's<br />4130 - 209.198.37.101<br /><br />or all others aswell?

['Plat]

Its a bot that comes to your site. Scans the entire thing (all the links) then goes to each and ever link opening the gallery, grabbing all the images, moving to the next gallery grabbing all those images. Can click every link on your site in a matter of mintues. Sending out fake hits to your trades from UCJ etc.<br /><br />Its not pretty.

[Dan S]

I mean, is it only the excessive<br />Outgoing Repetitive IP's<br />4130 - 209.198.37.101<br /><br />or all others aswell?

['Plat]

heres my outgoing nocookie stats from a day in february<br /><br />Outgoing Repetitive IP's<br />11244 - 149.156.102.212<br />9101 - 151.29.208.128<br />7562 - 80.128.177.173<br />5023 - 151.202.107.101<br />4861 - 62.253.64.6<br />1845 - 61.157.93.246<br />1643 - 202.155.9.8<br />1014 - 211.96.110.3<br />475 - 208.63.167.200<br />391 - 131.164.193.162<br />346 - 62.202.13.5<br />327 - 65.164.92.75<br />316 - 210.236.162.241<br />316 - 213.189.165.14<br />305 - 142.177.95.130<br />284 - 65.35.254.167<br />273 - 192.91.75.29<br />269 - 200.191.112.188<br />259 - 62.42.63.4<br />258 - 62.155.174.109<br />253 - 62.26.68.19<br />245 - 61.171.23.68<br />236 - 24.122.0.89<br />231 - 213.46.100.92<br />229 - 24.196.255.96<br />223 - 62.26.68.43<br />221 - 210.232.8.209<br />219 - 217.3.12.84<br />215 - 142.173.145.176<br />205 - 200.241.212.30<br />116155 - none<br />309 - unknown<br />259 - 62.42.210.15<br />189 - 213.76.147.98<br />169 - 62.25.249.204<br />163 - 62.30.174.191<br />143 - 216.244.197.57<br />142 - 213.119.126.148<br />137 - 62.47.38.237<br />130 - 213.7.36.254<br />127 - 192.168.13.133<br />126 - 213.7.24.190<br />124 - 213.6.20.187<br />123 - 217.135.21.78<br />114 - 203.91.74.27<br />105 - 24.116.149.31<br />103 - 200.190.140.245<br />99 - 213.7.57.98<br />97 - 213.119.67.125<br />95 - 10.50.9.13<br />93 - 192.168.28.170<br />89 - 62.136.25.11<br />87 - 192.168.160.50<br />87 - 212.253.50.51<br />86 - 213.131.80.167<br />79 - 196.30.236.169<br />71 - 212.198.180.34<br />70 - 213.119.145.85<br />70 - 213.6.81.186<br />69 - 161.142.42.117<br /><br />Here is mine as of right now:<br /><br />Outgoing Repetitive IP's<br />1992 - 172.180.56.38<br />1085 - 62.98.214.115<br />608 - 203.69.218.74<br />604 - 212.198.0.97<br />481 - 211.216.216.93<br />382 - 217.84.164.191<br />350 - 64.33.169.83<br />347 - 200.164.245.61<br />343 - 65.43.117.168<br />335 - 63.193.112.123<br />297 - 216.36.191.2<br />279 - 64.160.25.167<br />272 - 213.243.30.4<br />252 - 213.224.83.150<br />248 - 62.98.224.17<br />241 - 24.201.13.183<br />238 - 213.64.60.72<br />237 - 64.230.189.161<br />236 - 63.100.218.4<br />231 - 24.217.194.39<br />229 - 63.122.20.179<br />225 - 206.61.14.119<br />221 - 64.12.107.27<br />214 - 64.81.138.115<br />214 - 193.153.117.83<br />214 - 65.80.162.89<br />213 - 213.45.124.126<br />212 - 203.198.2.3<br />211 - 65.64.26.132<br />208 - 43.236.234.3<br /> 73692 - none<br />378 - 212.198.27.106<br />313 - 213.119.36.245<br />231 - 24.217.194.39<br />224 - 62.29.64.240<br />169 - 10.42.42.61<br />163 - 213.65.28.230<br />150 - 213.224.243.193<br />144 - 213.119.50.116<br />140 - 202.175.95.52<br />135 - 62.31.150.17<br />121 - 10.100.220.101<br />117 - unknown<br />108 - 81.65.100.26<br />106 - 213.6.250.103<br />100 - 213.119.25.184<br />92 - 217.136.97.221<br />91 - 213.7.125.164<br />90 - 80.200.40.33<br />81 - 217.135.139.102<br />79 - 213.7.221.114<br />78 - 192.168.37.12<br />77 - 212.198.146.128<br />76 - 213.7.34.20<br />73 - 212.253.27.219<br />72 - 202.146.236.254<br />68 - 217.135.180.157<br />67 - 213.190.37.120<br />65 - 202.78.107.59<br />65 - 217.135.218.147<br /> <br /><br />As you can see there are still some getting through but that is until I can find a way to htaccess deny my cgi-bin directory, mainly c.cgi.<br /><br />Also I believe its only "nocookie" traffic that these pronbots are found in in UCJ. Say someone comes to your site, they like it see alot of cool galleries so they decide to run their bot on it. Could be using a proxy, could be using their own IP. I'm still researching it trying to find out exactly what and how it works, only problem is I havent gotten my hands on an actual Bot for myself to test and play with it.

[Dan S]

Ok, looks like everything above 500 repetition is a leeching offline browser?<br /><br />In other words:<br />Is it save enough to block IP`s with excessive repeting outgoings?

['Plat]

Yes block as many as you can. But they will only return with new IP's etc.<br /><br />And its not exactly and "offline browser" its an evil lil bot <img border="0" title="" alt="[Razz]" src="tongue.gif" />

[jayeff]

If you have your main page in your root, but your gallery listings in a separate directory, this is a partial answer. Let's say your listings page(s) is/are in a sub-directory called "lists", then put this .htaccess file into that sub-directory:<br /><br />RewriteEngine On<br />RewriteCond %{HTTP_COOKIE} !.*visits.*<br />RewriteRule /* <a href="http://www.yourdomain.com/nocookies.html" target="_blank">http://www.yourdomain.com/nocookies.html</a> [R,L]<br /><br />If you figure that with IE6 defaulting to no cookies, use a last line like above, sending the hits to a page asking them to switch cookie acceptance on. Otherwise change the last line to sump them wherever you like.<br /><br />This htaccess will check to see whether UCJ set a cookie successfully, without modifying the cookie at all.<br /><br />Of course this won't keep out harvesting software that accepts cookies, but at least it means you will only be sending trackable hits to trades.

[Dan S]

yes, I have my categories in a sub-folder.<br /><br />I believe IE6 is getting quite popular and has already a good market share.<br /><br />If the default setting is nocookie we cant trade any of IE6 with default settings, right?<br />Is it about time to change the scripts to accomplish this issue?

[Dan S]

I also just realized another problem.<br /><br />On this site I am having 70.000 nocookie outclicks (including to galleries).<br />Part of it is good traffic from direct category bookmarks, part of it is cookies disabled, part of it is harvesting software and other bullshit.<br /><br />What I am concerned about is the cookies disabled traffic. If I send that traffic to a trade, I assume that its still beeing counted in from the recieving script, right?<br /><br />But if the traffic clicks on the recieving site, the prod is not beeing credited to me, cause the script don`t know its my click because it has no cookie. Is that right?<br /><br />With an increasing number of IE6 with disabled cookies default, this is causing some major troubles.<br /><br />Am I on track? Does it make sense?<br /> <br /> <small>[ 14 March 2002, 01:33 PM: Message edited by: Dan S ]</small>

[jayeff]

</font><blockquote><font size="1" face="Verdana, Arial">quote:</font><hr /><font size="2" face="Verdana, Arial">Originally posted by Dan S:<br /><strong>Am I on track? Does it make sense?</strong></font><hr /></blockquote><font size="2" face="Verdana, Arial">You are exactly right... lots of hits out that achieve nothing except to reduce your productivity on your partners' sites.<br /><br />That's why I block no-cookie surfers with that htaccess. I believe that wasted "real" hits are actually a bigger problem than the one mentioned at the start of this thread.<br /><br />You know what is really scary? When I also added a spider trap that was pretty primitive, but caught maybe 70% of the harvesters (which mostly do accept cookies), the productivity of the traffic from some of the "big boys" dropped like a stone. Up to near 40% off in a couple of cases.<br /><br />Makes you wonder just how much of all the traffic we are sloshing around is real, live human beings <img border="0" title="" alt="[Smile]" src="smile.gif" />

[Dan S]

Jayeff<br /><br />RewriteEngine On<br />RewriteCond %{HTTP_COOKIE} !.*visits.*<br />RewriteRule /* <a href="http://www.yourdomain.com/nocookies.html" target="_blank">http://www.yourdomain.com/nocookies.html</a> [R,L]<br /><br />How does this work actually?<br />I mean *visits.* is not related to the cookie ucj sets, right?

[jayeff]

</font><blockquote><font size="1" face="Verdana, Arial">quote:</font><hr /><font size="2" face="Verdana, Arial">Originally posted by Dan S:<br /><strong>I mean *visits.* is not related to the cookie ucj sets, right?</strong></font><hr /></blockquote><font size="2" face="Verdana, Arial">My apologies to anyone who has been breaking their head over this. In error, I quoted the line that would work for X3 Traffic Trader Pro.<br /><br />The correct line for UCJ is:<br />RewriteCond %{HTTP_COOKIE} !.*ucjc.*

[Dan S]

Thanks jayeff,<br /><br />the code works, and I am currently trying it on one of my sites.

['Plat]

Dan keep me updated on how your site is doing with that htaccess you implemented :c) thx

[DirkG]

Any idea how to do this when you dont use folders? I.E. <a href="http://totally4free.com/main.shtml" target="_blank">http://www.totally4free.com/main.shtml</a> I've been wanting to do this for some time, but havent figured it out.