Issue #122
Four phases of trillion sccale RT data infra, ten year retrospective on newSQL DBs, smartphone lenses are crazy, deification of Alan Turing, build apps with no framework, so you want to learn maths?
“Let everything happen to you Beauty and terror Just keep going. No feeling is final”
―Rainer Maria Rilke
Dear readers!
Thank you for subscribing. I would like to learn how do you like this newsletter and I am open for your feedback. Please feel free to write to me.
- Shekhar
Posts
The Four Innovation Phases of Netflix’s Trillions Scale Real-time Data Infrastructure
Phase 1: Rescue Netflix Logs From the Failing Batch Pipelines (2015)
Phase 2: Scale 100s Data Movement Use Cases (2016)
Phase 3: Support Custom Needs and Scale Beyond 1000s Use Cases (2017–2019)
Phase 4: Expand Stream Processing Responsibilities — Challenges and Opportunities ahead (2020 — Present) - #ZhenzhongXu
How to use undocumented web APIs
I wanted to explain how because it’s pretty straightforward. We’ll also talk a tiny bit about what can go wrong, ethical issues, and how this applies to your undocumented APIs. - #JuliaEvans #jnvs
The Deification of Alan Turing
To sell that message ACM needed founding figures and they settled on a deceased British mathematician named Alan Turing.
Today that choice seems obvious: Turing machines! The Turing test! The cracking of Enigma! Who better to be elevated as a founding father of computer science?
Except most of those aspects of Turing’s life were not known or were not significant at the time ACM members began promoting Turing’s status. Turing’s code breaking work, in particular, was not revealed until the 70ties, and the full collection of documents have still not been declassified to this day. - #MarianneBellotti #bellmar #Medium
Lessons From A Tech Job Search
I wish I had access to a primer on what companies were out there and how to approach each one. How long the process would take from start to finish. How to prepare for each one. I couldn't find such a post then, so I thought I'd write it now. - #KrishnaSundarram #nindalf
So You Want to Study Mathematics…
The secret to learning math is this: accept that it is a difficult subject and that understanding it is going to be hard, study it in small manageable pieces (like the curriculum I’ve put together here), be patient with yourself and with your study, and work diligently to understand it. I promise you that it is worth every moment, every effort, every precious bit of energy.
My goal here is to provide a roadmap for anyone interested in understanding mathematics at an advanced level. Anyone that follows and completes this curriculum will walk away with the knowledge equivalent to an undergraduate degree in mathematics. - #SusanRigetti
In the end, frameworks look like religions (or politics): each of them pretend to have the solution, but each of them is different. Each of them claim to provide the best vision of ̶t̶h̶e̶ ̶w̶o̶r̶l̶d̶ an app, but there are heated debates about which one holds the truth. Each of them require you to follow specific rules and, while there may be similarities, it is always difficult to convert from one to another.
Let’s look at an “atheist” approach of frameworks: use none. - #JérômeBeau #medium
1. Be consistent
2. Use ISO 8601 UTC dates
3. Make an exception for public endpoints
4. Provide a health check endpoint
5. Version the API
6. Accept API key authentication
7. Use reasonable HTTP status codes
8. Use reasonable HTTP methods
9. Use self-explanatory, simple names
10. Use standardized error responses
11. Return created resources upon POST
12. Prefer PATCH over PUT
13. Be as specific as possible
14. Use pagination
15. Allow expanding resources
-#RonaldBlüthl #bluethl
FoundationDB: A Distributed Unbundled Transactional Key Value Store (Sigmod 2021)
The main idea in FDB is to decouple transaction processing from logging and storage. Such an unbundled architecture enables the separation and horizontal scaling of both read and write handling.
The transaction system combines optimistic concurrency control (OCC) and multi-version concurrency control (MVCC) and achieves strict serializability or snapshot isolation if desired.
The decoupling of logging and the determinism in transaction orders greatly simplify recovery by removing redo and undo log processing from the critical path, thus allowing unusually quick recovery time and improving availability. - #MuratDemirbas #murabuffalo
Some benefits of simple software architectures
Despite the unreasonable effectiveness of simple architectures, most press goes to complex architectures. For example, at a recent generalist tech conference, there were six talks on how to build or deal with side effects of complex, microservice-based, architectures and zero how one might build out a simple monolith. - #DanLuu #wave
Data integration technologies were not suffering the storage, computation and bandwidth constraints anymore. This meant organizations could load large bunches of untransformed data in the warehouse without worrying about costs and constraints. And guess what, they did exactly that.
This is why Extract-Load-Transform (ELT) processes have come to replace ETL. - #LouiseDeLeyritz #castordoc
Videos
Alan Kay : July 2007 : A Conversation with CMU Faculty & Students
Pockit: A tiny, powerful, modular computer (2022 demo)
Andy Pavlo — The official ten-year retrospective of NewSQL databases
Contributors
Neha Bhole