Big Data
by Nathan Marz · first published 2015
11mentions
7recommended by
10HN commenters
2012–2023first – last mentioned
70% recommend30% neutral
Web-scale applications like social networks, real-time analytics, or e-commerce sites deal with a lot of data, whose volume and velocity exceed the limits of traditional database systems. These applications require architectures built around clusters of machines to store and process data of any size, or speed. Fortunately, scale and simplicity are not mutually exclusive. Big Data teaches you to build big data systems using an architecture designed specifically to capture and analyze web-scale data. This book presents the Lambda Architecture, a scalable, easy-to-understand approach that can be
Affiliate links. As an Amazon Associate I earn from qualifying purchases.
Big Data by Nathan Marz is a Manning Early Acces book (i.e. not fully written yet) that explains how to hand-roll your own custom Datomic style DB in Hadoop/HBase. It might be of interest to you given your current…
on “Thinking in Datomic” ↗Two great books: - "Functional Programming in Scala" by Paul Chiusano and Rúnar Bjarnason - "Big Data: Principles and best practices of scalable realtime data systems" by Nathan Marz and James Warren
on “Ask HN: Books you read in 2015?” ↗…this (for free): http://book.mixu.net/distsys/single-page.html And pay a little to read this book: http://www.amazon.com/Designing-Data-Intensive-Applications-... And this one: http://www.amazon.com/Big-Data-Principles-practices-scalable... Nathan Marz brought Apache Storm to the world, and Martin Kleppmann is pretty well known for his work on Kafka. Both are very good books on building scalable data processing…
on “Ask HN: How to handle 50GB of transaction data each day? (200GB during peak)” ↗For big data, 'Big Data' by Nathan Marz was an excellent read. The conceptual chapters are top notch, and the implementation chapters give you a good look into the tools used for the field at the time of publishing.
on “Ask HN: What is your goto resource for learning about big data, ML, AI etc?” ↗…or manipulation is central to your systems (and what modern app isn't), I'd say it's essential to at least skim through. It's more of a breadth than depth book, but it goes deeper than you'd expect. "Big Data" by Nathan Marz was foundational to the system I ended up designing, usefulness may vary. It describes a specific architecture for a flexible and high throughput data-based application. He has a new framework(?)…
on “Ask HN: What books would you recommend to newly appointed ScaleUp CTO?” ↗Here are a few suggestions by me, tried to pick items that will hopefully stand the test of time, one per major publisher: - Nathan Marz' (of Backtype/Twitter/Storm fame) Big Data (Manning): Don't let the name Big Data make you feel this is only for people with big data needs, in fact Nathan Marz tries to rethink how we store data. Immutable, append-only master data sets and views…
on “Ask HN: Technical books to get during BlackFriday/CyberMonday” ↗…refreshing the reports every 30 minutes. Building these analytics views can be accomplished using Cassandra, Hive or ElephantDB or any other. People have used apache storm also. You can look up the book Big Data principles by Nathan Marz for discussions on scalable architecture. Disclosure: I did not code this. I only participated in architecture reviews.
on “Event processing for an ad network” ↗As much as I'm a huge fan of Nathan Marz and his work with Clojure and Cascalog... I am hoping this book is about how to make Big Data accessible to programmers across multiple languages. Nathan, do you think you'll be including pseudo-code, or will one need to be a clojure programmer to best leverage your book?
on “Big Data: principles and best practices (new book)” ↗In Nathan Marz's (the article author) book, Big Data, he describes this and calls it the Speed Layer. I haven't fully finished the article yet, but the components it's describing seem to be equivalent to what he calls the Batch Layer and the Serving Layer…
on “We reduced the cost of building Mastadon at Twitter-scale by 100x” ↗…Anne Carson Letters from a Stoic, Seneca Three Body Problem, Cixin Liu Tractatus Logico-Philosophicus, Wittgenstein Tyranny of Words, Stuart Chase Golden Mean, Annabel Lyon Disrupted, Dan Lyons Big Data, Nathan Marz Practical OO Design in Ruby, Sandi Metz Brave New World, Aldous Huxley Duino Elegies and Sonnets to Orpheus, Rainier Maria Rilke Anatomy of a City, Kate Ascher Language and Thought by…
on “Ask HN: Books you read in 2016?” ↗Nathan Marz created Apache Storm, coauthored the book "Big Data", and worked at Twitter. It's likely the 'curse of knowledge' of working on this specific problem for so long is responsible for the specific and/or unfamiliar style of communication here.
on “We reduced the cost of building Mastadon at Twitter-scale by 100x” ↗