Proxy Setup

[mccullek]

Jim,

Can you give us the proper settings for the proxy set up? What file do we load them from or where are they being stored? What should the load delay and harvesting delay be set to, etc.? I have everything set up and ran it for short time, but I don't see it loading any proxys or anything, it's just searching and posting, so not sure I'm using it properly.

Thanks!

[jimbobo2779]

All you need to use the proxy harvester is to check "Use Proxy Harvester" and "Use Proxies" in the searching options. The other controls are to load proxies from a file that is output by a third party tool.

As always every option has helpful info when you hover over it.

[_iz_]

What happens if you have private proxies AND you have the built in proxy harvester enabled at the bottom of the settings page? Will all proxies be used? My list PLUS all nhseo harvested proxies?

I added my list of private proxies and have "Use Proxies" checked. I also checked "Use Proxy Harvester" at the bottom. When I clicked the play button, I noticed in the Log window that proxies were being harvested. I've not yet seen anything in the log showing which proxies are being used if any. Is there any way to confirm proxies being used?

Thanks!

[jimbobo2779]

The proxy lists for searching is added to any proxy lists that you add in manually or opt to load in from file. The proxy for each part of the posting is pulled randomly from this combined list. The proxies being used are not stated in the log as each post/search can involve multiple proxies.

[Farrow]

Don't know if i have mine set up correct, ive left it running for over a hour now and had no harvest proxies.
I left mine at 900000
and ticked use proxy harvester.
Looking at the log its checking them and removing them, but still have no harvest proxies.

[fastcooler]

The same here....adding, checking, removing, and so on...endless

[jimbobo2779]

@farrow:
The proxy harvesting works exactly as you described it "not working" it searches for proxies, checks them and removes the non working ones. Most public proxies are bad, this is exactly why a harvester is needed.

The delay is for how long to post before switching back to the harvesting proxies mode. Only so many proxies will be checked before switching back to posting mode, I have outlined how the process works to show that it cannot run endlessly:
1) 5 pages worth of proxies are pulled from random pages (random from a pre-defined list)
2) Each proxy from the 5 pages is added to a list and checked for duplicates
3) Each proxy is then checked one by one with non-working or transparent proxies being disregarded
4) Working proxies are added to a list of working harvested proxies
5) If Working proxies is above the harvest limit set in the settings stop the process and disregard further unchecked proxies
6) If list exhausted switch back to posting mode

There is no loop to prevent switching back to posting mode and the proxy harvesting mode ends once all proxies are checked which unless you are running less than 10 threads is unlikely to run for more than 15minutes with it finishing in 5 or less in the majority of cases.

Also as I replied to fastcooler in his thread the log is truncated when it reachesa certain size, as proxy checking is much quicker (more jobs done in the same amount of time) than posting the log reaches the truncation size very quickly and therefore you cannot reliably see how long a process such as proxy harvesting has actually been running for.