where did everyone go we need #1

[vaughan]

Can I use dial-up on MJ12? I'm using lots of cable bandwidth and don't want to exceed my limit. My 56kbps dial-up a/c is unlimited.

What settings do you guys use for Winrar compression and the other options in this application?

I find I have very large files to upload ~16MB using Winrar setting 5 and LZxx whatever it is turned off. I have a backlog of files waiting to upload and error messages about lost connectivity so upload aborted. It likes to d/l heaps of work and the 15 workers crunch through it before the previous upload has cleared.

/Edit Anyone? /edit

[Evil-Dragon]

MJ12 isn't really dialup friendly due to the amount of data it downloads. You could however create a profile that would only upload while on dialup but generally it's not recommended for crawling on dialup.

At the end of the day if you only do 10,000 urls (1 bucket worth) a day then it is a great help to the project. We are already doing over 24 million collectively and it is more than enough to finish off 700 mln urls in 3-4 weeks.

So don't worry about doing hundreds of thousands of urls, just do what you can, even if it's only 1 bucket a day.

[NeoGen]

We may not be a team of crunchers with super fast connections, but working all together we can do as much or even better than them.

In the end, all the little bits count.

[Lagu]

Hej

To you as is running MJ-12 and lost your connections:

Open the Administrators tools click on Log the on System
Have you a warning about TCP/IP as is saying: You have reached the limit of allowed TCP/IP level…:

Go to this website: http://www.lvllord.de/

Download the patch and click on it. A CMD-windows appear who ask you if you will change the….yes you can read self.

This should help. I have test it self.

Lagu

[Lagu]

Hej

From Alexc, the moderator of Majectis-12

Node supports RAR compression as external archiver in Options->Misc. RAR allows to achieve better compression ratio (13-15% better) than BZ2 and in many cases it runs faster too. In order to enable it you will need to do the following:

2. Enable RAR as external archivers in Options->Misc. Warning: make sure you choose command line version with filename "rar.exe", not "winrar.exe". Make sure you run test!

3. Optional: by default RAR will be invoked with default compression, however if you set "better compression level" in Options->Crawler to 5 or more, then the highest possible RAR's compression level will be used.

Note that while you can control compression ratio it appears that setting it to high value will considerably increase time required to compress the archive without much benefit. It is probably best to keep compression level at 1 as it will provide good enough compression without much wait.[/

Here is a link for downloading of RAR, not WinRAR: http://www.rarsoft.com/download.htm

Have fun
Lagu

[Evil-Dragon]

If you want the best compression from WinRar then set the "Better compression level" to 9 in Options Crawler.

I find that I get good results at level 9.

Regards
Evil-Dragon