Homework Assignment #2 – Calculating Size of Distributed File Systems
Exercise 3-1 Imagine that you want to analyze one terabyte (1 TB) of
data that is residing in a single machine with eight input/output channels,
where each channel has a reading speed of 150 megabytes per second
(MB/s).
1. Calculate the time it takes for the reader to read the entire file.
2. To speed up the reading operation, consider adding more machines
and creating a distributed cluster. What is the minimum number of
machines you should install in the cluster so the entire read time is less
than 10 seconds?
Exercise 3-2 A cluster with 50 machines is storing blocks of data that
belong to customer complaints. The size of the file is 5 TB, and each
machine has four channels with a reading speed of 100 MB/s for each
channel. Is the number of machines (50) sufficient to read the data in
under 20 seconds? If not, how many more similar machines need to be
added to the cluster?
Exercise 3-3 You want to store a 500 MB file into a cluster with 12 nodes, which
are located in four different racks (three nodes per rack) as shown in the figure
below.
1. If a data block can store 128 MB, how many data blocks are needed to split
this file?
2. Use a replication factor of 3 and the write principles discussed earlier to
allocate the data blocks into this cluster.
3. Repeat steps 1 and 2 but with a block size of 256 MB.
Exercise 3-4 Use the same cluster in the figure shown below for a file size of 50
GB. Each Data Node can store up to 8 GB of data. You need to allocate the data
blocks, each of a 256 MB size, in the cluster using a replication factor of 3.
1. Is the number of Data Nodes (12) sufficient to store this data file?
2. If not, how many more Data Nodes are needed? If needed, add them to the
cluster in a separate rack and allocate the blocks in the modified cluster.
3. If 12 is sufficient, allocate the data blocks in the cluster.
4. Repeat steps 1 through 3 but with a block size of 128 MB.
Exercise 3-5 Consider the block allocations shown in the figure below. Using a
replication factor of 3, are all blocks allocated in the correct Rack and Data Node?
If no, reallocate the blocks correctly. Explain your decision.
Exercise 3-6 Consider the block allocations shown in the figure below. Using a
replication factor of 3, are all blocks allocated in the correct Rack and Data Node?
If no, reallocate the blocks correctly. Explain your decision.
Exercise 3-7 Use the HDFS commands provided in Appendix A-Part 2 (HDFS) to
perform the following tasks. Submit a document in which each command is
associated with a screenshot of its result.
1. Create a directory in HDFS.
2. Copy any file from the local machine to the newly created directory.
3. List the directory’s contents.
4. View the contents of the file.
5. Rename any file in HDFS.
6. Create another directory in HDFS and move any file from one directory to
another.
7. Delete any file.
8. Delete any directory.
9. Move any file from HDFS to the local machine.
10. Display the size of files.
11. Change the group of any file or directory.
12. Change permissions of any file or directory.
Get Your Paper Before the Deadline. Our Services are 100% private and Confidential
Useful Links That Will Help You Around
Link to new order https://studentsolutionsusa.com/orders/stud/new
link to login page https://studentsolutionsusa.com/orders/login
New user registration link https://studentsolutionsusa.com/orders/register
Forgot Password https://studentsolutionsusa.com/orders/forgot/password
FREQUENTLY ASKED QUESTIONS
Question: How does this work?
Answer: Good Question. We are a group of a freelance board of students and professional essay writers. At our website, you may get help with any type of academic assignments: essay, coursework, term paper, business plan, case study, article review, research paper, presentation, and speech. Top writers can help with complex assignments such as dissertations, thesis papers, etc. All of them are professionals possessing excellent knowledge in their field of expertise, perfect writing skills, quality, and speed. When you place an order on our website, we assign it to the best writer. Once the writer finishes the work, the paper is submitted to our quality assurance desk who go through it and ensure it is unique and plagiarism free and that the instructions were followed to the detail. After this step we upload the paper in your account, we also send a copy to the email that you used to register the account with. we can guarantee you that the paper will be 100% plagiarism free. Besides, our services are 100% private and confidential
Question: How do I place an Order after getting to the order page
Answer: There are three major steps in the ordering process
Step 1 ....................................................paper details In this step, you will fill in the instructions of your paper; you can upload any materials that you feel will make your assignment a success. Besides, you can also email us at [email protected] Remember to specify the correct academic level. Please note that sources mean the number of references.
Step 2...................................................... Price calculation Kindly specify the number of pages, type of spacing and the correct deadline. This step will give you the estimated cost minus discount -- you may add the extra features if you wish.
Step 3 ....................................................discount and payment Use the discount code HAPPY2018 to enjoy up to 30% discount of your total cost After this step, proceed to safe payment; you can checkout using your card or PayPal Please note we will send the complete paper to the email you will provide while registering. A copy will also be uploaded to your account
Question: How will I know when my paper is complete? or How will I get the complete Paper?
Answer: Once we are done with the paper, we will be uploaded to your account. A copy will also be sent to the email you registered with. We can guarantee you the following:- 1. Our service is private and confidential; we don't spam or share your contacts with anyone 2. The final paper will be plagiarism free. We will send a Turnitin Report to the email you registered with 3. At our company, willing to do free unlimited revisions until you are satisfied with your paper
Question:- Am a new client, How can I get the guarantee that the paper will be completed and sent to me before my deadline?
Answer: Thank you for expressing your concerns. We would love to have you as our loyal customer. We are certain if we do good work, you will come back for me. Besides, you will give us referrals to your friends and family. For that reason, we can’t fail to deliver your paper within your specified time frame. We will ensure we submit the paper on time so that you can have enough time to go through it, if you have problems with the paper delivered, you can request a free revision. You are entitled to as many revisions as you would wish until you get a paper that satisfies you
Useful Links That Will Help You Around
Link to new order https://studentsolutionsusa.com/orders/stud/new
link to login page https://studentsolutionsusa.com/orders/login
New user registration link https://studentsolutionsusa.com/orders/register
Forgot Password https://studentsolutionsusa.com/orders/forgot/password
