Design and Implement a Network File System for Large Web Services

Due to the rapid growth of World Wide Web and the popularization of personal computer, the number of World Wide Web users is increasing in an incredible speed. It makes the need of disk space for a large web service also increases in the same rate. Therefore, it becomes to an important technique to design and implement a powerful network file system for the large web service providers. We design and implement three important components for this project. They are 1) Control Center: It will take care of the data structures of the files and control how to backup the duplicates for a file. It also coordinates the balance jobs for the bucket servers. 2) Bucket Servers: They store the physic parts of the files. They are designed for ease to use. The space occupation and access traffic can be balanced in a fast way no mater one of bucket server is offline or a new one join into them. 3) Related access interfaces: We will design and implement the related API and NFS protocol. Those access methods can make all kinds of applications use our system easily. We can accomplish this project through above designs. The distinguishing features of our design network file system are fault-tolerance, variable-size of buckets, space loading balance, access loading balance, file caching technique, and ease to manage. It can effectively improve the development and applications of large web service techniques through this project. It also can train people up with relative techniques. The developed key techniques of this project can transfer to the relative industry.

Project ID:PB9709-3557
External Project ID:NSC97-2221-E182-042