Posts

Showing posts with the label technology

Uber's Michelangelo vs. Netflix's Metaflow

  Uber's Michelangelo vs. Netflix's Metaflow Michelangelo Pain point Without michelangelo, each team at uber that uses ML (that’s all of them - every interaction with the ride or eats app involves ML) would need to build their own data pipelines, feature stores, training clusters, model storage, etc.  It would take each team copious amounts of time to maintain and improve their systems, and common patterns/best practices would be hard to learn.  In addition, the highest priority use cases (business critical, e.g. rider/driver matching) would themselves need to ensure they have enough compute/storage/engineering resources to operate (outages, scale peaks, etc.), which would results in organizational complexity and constant prioritization battles between managers/directors/etc. Solution Michelangelo provides a single platform that makes the most common and most business critical ML use cases simple and intuitive for builders to use, while still allowing self-serve extensibi...

Grow Your Career, Be A Senior Engineer

Image
My personal experience with navigating a career in software engineering has been dotted by fits and starts.  9 years into my professional life I can look back and see what worked, what didn't, and why.  I want to share that knowledge so other young engineers can do more with their first 9 years than I did.  Plus it's just fun to reminisce and will help me visualize the next steps in my career. To be clear, the north star goal in my career is and has always been to learn and grow towards more positive impact on those I serve.  If you have the same or a similar goal, this article will be useful. I wrote up a simple formula which I think can help any aspiring engineers out there.  It can be used as a template for a career plan.  When you're thinking about how to get to the next level, make sure you're putting equal emphasis on all these categories.   1.) ACTION from you, despite imperfect information 2.) COWORKERS whom you respect 3.) MENTOR(s) inves...

The Large Hadron Collider

Image
The LHC (Large Hadron Collider) project began to be thought up way back in the 1980's.  Though just these past couple of years have seen the first experiments conducted in the 27-kilometre long tube, the intellectual beginnings date back 2.5 decades. When fully functional, the LHC will accelerate a stream of particles to 99.99% the speed of light in one direction around the 27km long tube, and do the same to another stream of particles in the other direction.  When at full speed, the two stream will be made to intersect each other, and the particles will collide.  What happens after that is what scientists are anxious to find out. LHC experiments will address questions such as what gives matter its mass, what is the invisible 96% of the Universe made of, why does nature prefer matter to antimatter and how is matter evolved from the first instants of the Universe's existence. The Large Hadron Collider (The Hadrons are particles, the collider points to the fact that i...

Linked Data - Tim Berner-Lee's idea

In 2009, Tim Berner-Lee, creator of the internet :O did a talk about what he called "Linked Data", or the next internet. This is a short update on how those ideas are being put into motion.

Eye-popping use of graphs to show eye-popping information

If anyone's ever wanted to know if there was an awesome way to combine a love for graphics with a desire to understand poverty...

Some inspiration for the techies...

This is part of what inspires me to continue learning