Issue #124
Does Youtube DB run out of space?, Go generics, id db modelling worth in distributed systems?, Cooking for engineers :)
Posts
YouTube Database – How Does It Store So Many Videos Without Running Out Of Storage Space?
YouTube is the second most popular website on the planet after Google. As of May 2019, more than 500 hours of video content is uploaded to the platform every single minute.
With over 2 billion users, the video-sharing platform is generating billions of views with over 1 billion hours of videos watched every single day. Boy!! These are just incredible numbers. - #ShivangSarawagi#scaleyourapp
Migrations Done Well: Executing Migrations
Migrations are one of the most overlooked topics in software engineering, especially at high-growth startups and companies. As a company’s operations grow, new systems and approaches are adopted to cope with extra load, more use cases, or more constraints. From time to time, engineers need to migrate over from an old system or approach, to a new one.
And this is where things can get interesting, unexpected… and even ugly. - #GergelyOrosz #pragmaticengineer
Is Dimension Modelling worth it in Distributed Systems?
In a Distributed System, your biggest challenge is to make sure that you can work with consistent outcomes as you work with multiple devices. Achieving consistency becomes more challenging when you have to work with underlying data. However, you may find it easier to set up distributed databases that hold data in dimension models. - #KapilVirenAhuja #howtoarchitect
Cascading failures in large-scale distributed systems
Cascading failures are highly critical for three reasons: First, they can shut down an entire service in a short period of time. Second, the affected system does not return to normal as it does with more commonly encountered problems, but it gets progressively worse. This ultimately leads to being dependent on human intervention. Finally, in the worst case, cascading failures can strike seemingly without warning because load distribution, and consequently failures, occur rapidly - #HarriFaßbender #hdm-stuttgart
Things I Learnt The Hard Way (in 30 Years of Software Development)
- #JulioBiason #
There is one code readability trap that is easy to avoid once you are aware of it, yet the trap is pervasive: omitting units. - #RuudVanAsseldonk
Web3 is centralized (and inefficient!)
These days, an app is “decentralized” if it uses the blockchain. As you probably already know, this is part of the so-called “Web3” which hopes to be the next version of the internet.
I’m not the first person to tell you this, and certainly not the last, but Web3 is in fact centralized, just as Web2 was. Web3 is just a worse version of Web2 - #NeelChauhan #neelc
Implementing a toy version of TLS 1.3
Understanding TLS 1.3 by implementing it. - #JuliaEvans #jvns
Generics are the biggest change we’ve made to Go since the first open source release. In this article we’ll introduce the new language features. We won’t try to cover all the details, but we will hit all the important points. - #RobertGriesemer #IanLanceTaylor #go
Aurora uses MySQL or PostgreSQL for the database instance at top, and decouples the storage to a multi-tenant scale-out storage service. In this decoupled architecture, each database instance acts as a SQL endpoint and supports query processing, access methods, transactions, locking, buffer caching, and undo management. Some database functions, including redo logging, materialization of data blocks, garbage collection, and backup/restore, are offloaded to the storage nodes. - #MuratDemirbas #muratbuffalo
Interesting
Have an analytical mind? Like to cook? This is the site to read!
Video
Modelling distributed systems, Irina A. Lomazova