Issue #105
Hudi - storage abstraction framework, architectural patterns, AWS or GCP?, Being alone, Meta programming lambda functions
“Everything you can imagine is real.”
― Pablo Picasso
Posts
Building a Large-scale Transactional Data Lake at Uber Using Apache Hudi
Apache Hudi is a storage abstraction framework that helps distributed organizations build and manage petabyte-scale data lakes.
Now, almost a year and a half later, Apache Hudi has graduated to a Top Level Project under The Apache Software Foundation. - #eng #uber
Architectural patterns of resilient distributed systems
Repository for the "Architectural patterns of resilient distributed systems" talk given at Strangeloop 2015. - #github
Kafka Streams, co-partitioning requirements illustrated
Among all the possible transformations (filters, map, branch, etc.) joins are special due to their stateful aspect and rely on a concept called co-partitioning. - #medium
Distributed Systems: Physical, Logical, and Vector Clocks
Within the realm of distributed systems, one of the largest problems we gain over a single machine system is attempting to keep a correct timeline of events. - #gitconnected #levelup
Six Rules of Thumb for Scaling Software Architectures
- Cost and scalability are indelibly linked
- Your system has a bottleneck. Somewhere!
- Slow services are more evil than failed services
- The data tier is the hardest to scale
- Cache! Cache! And Cache Some More!
- Monitoring is fundamental for scalable systems
#medium #i.gorton
Why I think GCP is better than AWS
Nothing is perfect. You will surely come across things in GCP that you will hate, as I have in the past, but for most people the amount of headaches will be fewer and farther in between than with AWS, and that alone is a good reason to pick it. - #medium #nandovillalba
Do your installed programs share dynamic libraries?
Over half of your libraries are used by fewer than 0.1% of your executables. - #drewdevault
What I learned from looking at 200 machine learning tools
To better understand the landscape of available tools for machine learning production, I decided to look up every AI/ML tool I could find - #huyenchip
Loneliness is usually framed around your relationships to others—community, friendship, family. But that’s not the whole picture.
To feel less lonely, you have to also build your relationship with yourself, which requires time alone, free from distractions, and that can feel scary.
This is an essay about why you might want to give being alone a try. - #ankit
Podcasts
Meta-programming Lambda functions with Tom Wallace
#apple
#transistor #fm
Videos
Learning Distributed Systems (The Podlets, Ep 12)
There is a common belief that studying computer science is a must if you want to enter this field, but today we talk about the various ways in which individuals can teach themselves everything they need to know.