The Knewton Blog

With the increase use of Hadoop comes an increase in the need for critical safeguards, especially in the financial industry where any data loss could mean millions in penalties. What happens when parts of an Hadoop cluster goes down? How do Hadoop based solutions for the financial industry cope with NameNode failures? We will share the failover issues we’ve encountered and best practices for performing continuous health monitoring, best suited for the financial industry. In addition, we will cover ZooKeeper-based failover for NameNode and other related SPOF services (e.g., JobTracker, Oozie, Kerberos).

Posted in | No comments

In this course you will learn several fundamental principles of algorithm design. You’ll learn the divide-and-conquer design paradigm, with applications to fast sorting, searching, and multiplication. You’ll learn several blazingly fast primitives for computing on graphs, such as how to compute connectivity information and shortest paths. Finally, we’ll study how allowing the computer to “flip coins” can lead to elegant and practical algorithms and data structures.

Posted in | No comments