CS624: Operating Systems II

Professor

Joel Wein. My office is LC232; telephone number (718) 260 3376 but leaving me a phone message is not a very useful way to contact me. Best way to contact me is email to wein@mem.poly.edu.

I will have office hours Thursday 2-4 or by appointment.

Overview

Course materials, Requirements and Grading

Prerequisites

The main thing is some maturity in the study of computer systems and as a programmer. CS623 would be useful but is not strictly required. I am going to assume you learned about network protocols, TCP/IP, UDP, sockets and threads elsewhere. If you did not you should read up on them as background in the early sections of the textbook -- we don't require in-depth knowledge but rather familiarity.

Textbook

Requirements:

• Project: (45%) Project, which will be the lion's share of the work in the course.
• Homeworks: (15%) There will be a few (3-4) sets of exercises designed to insure that you are on top of the material.
• Examinations: (40%) We will have a final.

Syllabus & Reading Assignments

This is a best guess, not a firm committment.

Numbers refer to week numbers.

1. [1/25/07] Fundamental Notions of Distributed Systems. DNS and name services as an example.
   • CDK Chapter 1.
   • Review briefly (or learn anew) CDK 3.3,3.4,4.1,4.2.
   • CDK 4.3-4.5,5.1-5.5
   • CDK 9.1,9.2
   • Slides
   • Experience with some Principles for Building an Internet-Scale Reliable System, Afergan, Wein, La Meyer, USENIX WORLDS 2005.
2. [1/30/07] Distributed File Systems -- The Basics.
   • Coulouris 8.1-8.4
   • Slides
3. [2/6/07] Time in Distributed Systems. Distributed Snapshots.
   • CDK 4th edition, 11.1-11.5
   • Slides
   • Lamport paper on Logical Clocks
   • Chandy and Lamport paper on Snapshots
4. [2/13/07] Distributed Mutual Exclusion, Leader Election. Coulouris 12.
   • Slides
   • CDK 4th edition, 12.1-12.3
5. [2/20/07] Broadcast and Multicast Algorithms. Agreement and Consensus Protocols.
   • Slides
   • Coulouris 11.1-11.3
6. [2/27/07] Transactions
   • Slides on Transactions
   • CDK 12-13
7. [3/6/07] Replication
   • CDK 14
   • Slides on Replication and Fault Tolerant Services
   • ACMS: Akamai Configuration Management System
   • ACMS: A Few Slides on ACMS
8. [3/13/07] Edge Services. Data Support for Edge Services. Distributed File Systems: Advanced Topics.
   • Slides on CDNs
   • Slides on EdgeServices
   • A paper on the Akamai CDN .
   • Application Specific Data Replication for Edge Services
   • A paper on Akamai's Edge Computing Product
   • A second paper on Akamai's Edge Computing Product
   • Application-Layer Transport for Live Streaming
9. [3/20/07] Peer to Peer Systems: DHTs and the like.
   • Slides on P2P -- Study Section on Distributed Hash Tables. (Section 3)
   • OceanStore Presentation.
   • OceanStore Paper
   • Survey on Bloom Filters, which are used in OceanStore.
10. [3/27/07] More on DHTs.
11. [4/3/07] NO CLASS SPRING BREAK
12. [4/10/07] Professor Suel lectured about various advanced topics in distributed file systems, including the Google File System. Here are links to source information
13. [4/17/07] OceanStore (see papers listed earlier.) Introduction to Sensor Networks.
    • Interesting Presentation by Matt Welsh about some fun applications of sensor networks.
    • And another one on medical applications
    • TinyOS: An Operating System for Sensor Networks
    • The Emergence of Networking Abstractions and Techniques in TinyOS, Philip Levis, Sam Madden, David Gay, Joe Polastre, Robert Szewczyk, Alec Woo, Eric Brewer and David Culler, Proceedings of the First USENIX/ACM Symposium on Networked Systems Design and Implementation (NSDI 2004).
    • Sam Madden, Michael J. Franklin, Joseph M. Hellerstein and Wei Hong. TinyDB: An Acqusitional Query Processing System for Sensor Networks. ACM TODS, 2005.
    • Flexible Power Scheduling for Sensor Networks, Barbara Hohlt, Lance Doherty, Eric Brewer, Information Processing in Sensor Networks (IPSN =9104), April 2004, Berkeley, CA.
    • Decentralized, Adaptive Resource Allocation for Sensor Networks, Geoff Mainland, David C. Parkes, and Matt Welsh. In Proceedings of the 2nd USENIX/ACM Symposium on Networked Systems Design and Implementation (NSDI 2005), May 2005.
14. [4/24/07] TBD
15. [5/8/07] Final Examination

Index to Other Course Information

• How to log in to the PDC Lab
• Project
• Exercises