Issue #121
Geo distributed databases, What happened to my career after 2010?, Tech predictions for 2022 and beyond, Designing data intensive applications, Single binary executable package ...
We have all the time in the world
Time enough for life
To unfold all the precious things
Love has in storeWe have all the love in the world
If that's all we have
You will find
We need nothing more— David Hal
Posts
Tech Predictions for 2022 and Beyond
We are entering a phase where data is abundant, access to it is almost instantaneous, and our ability to make sense of it in new and subtle ways is practically automatic. But this technology is not replacing humans; it is augmenting how we engage with the world. #allthingsdistributed
What happened to my career after 2010?
So, take care of yourself, pursue your dreams, and remember that it's precious to be able to decide what to work on. Most people don't have that choice. And those that do, as I did, often don't take advantage of it, and live a life that someone else said might be interesting.
There's often an interesting life waiting for you, but only if you decide to look for it. 2010 was when I needed to learn that, and 2019 was when I found it. - #ShawnPresser #github #gist
There seems to be an established truth in programming that code reviews find a lot of bugs. . . . .
This is however not my experience – I rarely find outright bugs when reviewing changes. But I still think code reviews are useful. Below are my thoughts on the value of code reviews, and how to make the process efficient. #henrikwarne
How Feedzai ARMS automates rule management in large scale systems
Using efficient optimization approaches such as greedy and genetic algorithms, Feedzai ARMS significantly reduces the number of active rules, and handles different rule priorities, all while achieving the detection performance #Medium #feedzaitech
Best practices can slow your application down
In software engineering, a number of fairly non-controversial best practices have evolved over the years, which include decoupled modules, cohesive code, and automated testing. These are practices that make for code that’s easy to read and maintain. Many best practices were developed by researchers like David Parnas as far back as the 1970s, people who thought long and hard about what makes maintainable high quality systems.
But in building the codebase for our public Stack Overflow site, we didn’t always follow them. - #stackoverflow #blog
Distributed Rate-Limiting Algorithms
Rate-limiting seems straightforward: we only allow a given client to perform X calls every minute. It’s quite easy to implements on a single server instance, and we can easily find libraries to do that for us. But our API is hosted in 6 data centers (in Europe, North America, and Asia), with multiple instances in each one. This means we need some kind of distributed rate-limiting system. - #criteo #engineering #blog
Twenty years ago, a well-known professor in computer networking field told me that he reviews any paper in 30 minutes. Not just read the paper, but also write the review, mind you. All in 30 minutes!
I said "I am slow it takes me 4 hours to read a paper". I lied. It actually took me 8+ hours to read papers, because I was a graduate student and didn't have much background and paper reading experience. ….
Maybe because of that early encounter with that flamboyant networking professor, I always felt I am very slow in reading a paper. I checked with fellow professors who read 100+ papers a year. They also tell me that it takes them 4-8 hours. #muratbuffalo #blogspot
Data Mesh: The Answer to the Data Warehouse Hypocrisy
Organizational data management processes have been much slower to modernize than technical capabilities. But Zhamak Dehghani has introduced an idea --- the data mesh --- that in retrospect, seems so obviously the right thing to do, it’s hard to believe that the data warehouse has managed to dominate for so long until now.
Dehghani explains the idea in her own words in an extended 6500 word treatise. Below I will summarize the idea, through my own scalability lens. - #starburst #danielabadi
Single binary executable packages
Given today's software landscape, lots of dependencies, lots of building issues, very quick release cycles, many distributions to cover, highly demanding users, I think there is only a single way out of this:
No, it's not Nix, or Guix, or Homebrew... they are just prolonging the illness...
Let's drop the concept of software package, and let's adopt the self-contained binary executable as the new unit of software distribution! - #CiprianDorinCraciun #volution
Podcast
Designing Data Intensive Applications with Martin Kleppmann
Videos
Cockroach Labs Live: The Architecture of a Geo Distributed Database