Community Project: Retrieval of "Lost Images"

[Asuka]

I'm currently somewhere around 64.000 files and 14GB

Braveheart on! :-D *y*

[Dryw Filtiarn]

Nah, before I run out of webhosts to host the proxy script on will take a while *sweet* And if I do run out before I have been able to get everything, then I'll simply find a new sollution, just like the sollution of the proxy script now *sweet*

BTW, my scripts should also be less detectable now :'-)

I'm now on: 77.000 files and 17.6GB (I could have been further if I would have made a stupid mistake corrupting some of the data :-$ )

Edit: According the the current progress the total data for all the photos currently on Brickshelf will be somewhere between 370GB and 413GB (based upon filesize averages)

Edited July 18, 2007 by Dryw Filtiarn

[Dryw Filtiarn]

Update:

I finally have reached more then 100.000 files. Currently the number of files downloaded is around 101.000 (these files belong to a total of 3821 people) with a total size of 22.5GB.

Some more statistics regarding the average filesizes:

Files < 1MB: ~97.17% of all files

Files > 1MB and < 2MB: ~ 2% of all files

Files > 2MB and < 3MB: ~ 0.68% of all files

Files > 3MB and < 8MB: ~ 0.04% of all files

Files > 8MB: ~ 0.01% of all files

The overall average filesize calculated over de current 100.000 files downloaded is: 235.96kB

The a bit of information on the speed of the whole process:

In 1 hour the following gets processed on average:

17108 files are being downloaded contained in 2520 folders (galleries) belonging to 972 users with a total size of 3.83GB.

Knowing all of these values will mean that the entire downloading process will take another 82 to 100 hours (which will be 3,5 to 4 days). The timeplan though, is based upon the fact that I won't get any interruption from Kevin blocking me again :'-)

[ZeekyBoogeyDoog]

Hope everything works out!

[Dryw Filtiarn]

Over 250.000 files have now been downloaded with a total size of 62.9GB and everything is still running :)

[ups]

I wonder if you are downloading by date (or folder number).

In that case, it is possible that newer pictures are bigger than the ones you already have and hence change the statistics...

[Dryw Filtiarn]

It's entirely random :) It's based on username as I grab on per-user bases.

Edit: I just bought and installed a 500GB harddisk to occomodate for further downloading :)

Edited July 19, 2007 by Dryw Filtiarn

[Dryw Filtiarn]

The end result of my backup processes is as follows:

367.951 files have been downloaded (which is nearly 1/5 of everything that is on BS) which belong to 4562 users and which is a total of 84GB of data :)

Edited July 22, 2007 by Dryw Filtiarn

[Asuka]

It

[CopMike]

Wow 8-

[Dryw Filtiarn]

There won't be any further progress :) As brickshelf will stay online there is no more need at this time to continue downloading stuff. I do use my scripts to backup some folders I really like just in case somewhere in the future BS does actually go down, but that's not a mentionable amount of downloads :)