Forgot your password?
typodupeerror
Google

+ - Google Video Race Against Time Goes Distributed-> 3

Submitted by Bottles
Bottles (1672000) writes "Following Google's announcement to shut down Google Video (previously reported on Slashdot), the Archive Team has inspired a group of volunteers to join together to preserve as much of the content as possible: some 2.5 — 2.8 million videos. In a few short days the effort has evolved from a simple wiki suggesting people band together to download automatically generated lists of video ID's via a crude automated script to a centralised, distributed batch management system which assigns unique video ID's to volunteers' machines for download. The system, developed by Alex Buie in less than 48 hours, is now the recommended way to preserve the content and to avoid duplicate downloads. Watch videos roll in live here thanks to PubNub and read on to find out how you can help.

The clock is ticking to download as much as possible by the 29th of April — before Google throws the switch. Thereafter, Archive.Org has assigned a 140TB buffer for uploads into its 1 petabyte of storage space to house the preserved content. After the cutoff, downloaders can offload their content at their leisure.

The team from around the world, spearheaded and coordinated by Jason Scott, has been working solidly and altruistically. No selection criteria have been applied to the content; the idea is to preserve everything, if possible; however various team members have been working on collating word lists for searches: by concept, year, country etc. In this way they have a growing master list of some 2449000 unique video ID's to be processed of which around 15% are already saved.

You can help out. Please visit the wiki and the #googlegrape irc channel on EFNET, download the scripts and donate a little bandwidth and storage to preserve as much as possible before the cutoff date. There is less than a week left."

Link to Original Source
This discussion was created for logged-in users only, but now has been archived. No new comments can be posted.

Google Video Race Against Time Goes Distributed

Comments Filter:
  • Why didn't google just port everything over to youtube?
    How hard can it be? Surely they have direct databasee and/or filesystem access to the originals and to youtube.

    • by Bottles (1672000)

      Various explanation have been posited from 'legal' to 'rights issues' to 'laziness'. In the end, without an official statement, we are all in the dark.

  • I've created a live updating stats page to show how much we've downloaded so far, and our current rate of downloading, plotted on a nice JS graph. Thanks/props go out once again to PubNub, whom without this wouldn't be possible. See it here http://199.48.254.90/at/charts.html [199.48.254.90] Alex

Going the speed of light is bad for your age.

Working...