Skip to content
0:00 / 0:00

#google#backupsystems#tapebackup

NYC Tech Talk Series: How Google Backs Up the Internet

Google TechTalks

349K subscribers • 56 videos on Hallway

YouTube
  • Recommended by 1 person: 1 on Hacker News.
  • Presented by Raymond Blum, Site Reliability Engineer at Google

Intermediate. Assumes working knowledge.

40K views12 years ago1 recommendation

Distributed systemsDatabases and dataData engineering and warehousesScaling and large-scale architectureFault tolerance and failure

Raymond Blum describes the engineering challenges and site reliability practices Google uses to back up massive cloud data.

Google Tech Talk October 22, 2013 (more info below) Presented by Raymond Blum ABSTRACT Systems like GMail and Picasa keep massive amounts of data in the cloud, all of which has to be constantly backed up to prepare for the inevitable. Typical backup and recovery techniques don't scale, so Google has devised new methods for securing unprecedented volumes of data against every type of failure. There are many unique challenges, both obvious and subtle, in delivering storage systems at this scale; we'll discuss these and their solutions as well as some alternatives that didn't make the grade. About the speaker: Raymond Blum leads a team of Site Reliability Engineers charged with keeping Google's and its users' data safe and durable. Prior to coming to Google he was the IT director for a hedge fund after spending a few lifetimes developing systems at HBO and on Wall Street. In his meager spare time he indulges his interests in robotics and home automation and reads too much science fiction.

Why it's here

1 person recommends this

What people say. Recommended as an insightful look into large-scale backup systems, disaster recovery, and the continued utility of tape storage.

carapaceon Hacker News • Recommends

On “Game developer loses multiplayer service code”

FWIW... "Backups are a tax you pay for the luxury of restore" "How Google Backs Up the Internet" link to this video Detailed notes: link

timothyaon Hacker News • Mentions

On “Dropbox confirms that a bug within Selective Sync may have caused data loss”

There may occasional bugs, but I don't know of any cases when Gmail actually lost emails. According to this talk 0, the bug referred to by that article caused some users' emails to be temporarily inaccessible, but all the emails were eventually recovered. 0: link to this video

driedduston Hacker News • Mentions

On “Code hosting provider ceases trading after “well-orchestrated” DDoS attack”

This should serve as warning to anyone relying blindly on cheap cloud to keep themselves up and running. This also remind me of importance of offline tape backup. Google still uses tapes1, yet some of the companies have started thinking they can eliminate tapes and move their backups to cloud. 1 link to this video

stegro32on Hacker News • Mentions

On “Don’t Mess with The Google”

I also remember that talk. I haven't verified by watching again, but if anyone's interested I suspect this is the one: link to this video

twotwotwoon Hacker News • Mentions

On “Unreliability at Scale”

The "petabyte for a century" problem statement he mentions near the top is fun: can you preserve 1 PB with better-than-even odds of all the bits coming back right in a century? He wrote something about how he saw the durability situation in 2010: link . He seems to define the problem to allow for maintenance, e.g. check-and-repair operations are discussed. Broadening a little, I read it as "if you're trying to be more cautious than you usually want for commercial/academic online storage or even backup, what do you do? And would it work?" A lot (but not all) of the author's Queue piece talks about stats from online storage, which doesn't have some wins you can get if you're entirely about l…