Skip to content

Instantly share code, notes, and snippets.

@peijiehu

peijiehu/GFS.md

Created June 23, 2017 05:04
Show Gist options
  • Save peijiehu/6940f5074e3a868ccdb114a4beefc969 to your computer and use it in GitHub Desktop.
Save peijiehu/6940f5074e3a868ccdb114a4beefc969 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
GFS.md

Google File System has master and chunk servers

  • Master servers keep metadata on the various data files. Data are stored in the file system in 64MB chunks. Clients talk to the master servers to perform metadata operations on files and to locate the chunk server that contains the needed they need on disk.

  • Chunk servers store the actual data on disk. Each chunk is replicated across three different chunk servers to create redundancy in case of server crashes. Once directed by a master server, a client application retrieves files directly from chunk servers.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment