Shipping the Second System

In 2015-2016, the team embarked upon the task of re-envisioning its entire backend technology stack. The goal was to build upon the learnings of more than 2 years delivering real-time web content analytics, and use that knowledge to create the foundation for a scalable stream processing system that had built-in support for fault tolerance, … Continue reading Shipping the Second System

Expanding my mind, once more, with functional programming

The Structure and Interpretation of Computer Programs (SICP) is a classic computer science text written by Gerald Jay Sussman and Hal Abelson. It is widely known in the computer science community as the “wizard book”. It intends to teach the foundations of computer programming from “first principles”, illustrating programming language design using Scheme, a dialect … Continue reading Expanding my mind, once more, with functional programming

Public technical talks and slides

Over the years, I’ve put together a few public technical talks where the slides are accessible on this site. These are only really nice to view on desktop, and require the use of arrow keys to move around. Long-form notes are also available — generated by a sweet Sphinx and reStructuredText plugin. I figured I’d … Continue reading Public technical talks and slides

Simple Lego Blocks for Big Data

Data engineers should abstract their code in the most lightweight way possible to facilitate downstream integration in a large-scale data system. You want lego blocks, not puzzle pieces. The creators of the C programming language once famously said, “first make it work, then make it right, and, finally, make it fast.” This adage still applies … Continue reading Simple Lego Blocks for Big Data brand hacking

There’s some hoopla lately about “weird” startup names in the Wall Street Journal, with specific coverage of “.ly” domains in The Atlantic Wire: The latest start-up boom has led to the creation of at least 161 companies that end in “ly,” “lee,” and “li,” which is, naming consultants tell us, 160 too many. There’s feedly, … Continue reading brand hacking

PyCon 2013: The Debrief

PyCon US 2013 is over! It was a lot of fun — and super informative. The People For me, it was great to finally meet in person such friends and collaborators as @__get__, @nvie, @jessejiryudavis, and @japerk. It was of course a pleasure to see again such Python super-stars as @adrianholivaty, @wesmckinn, @dabeaz, @raymondh, @brandon_rhodes, … Continue reading PyCon 2013: The Debrief

Rapid Web Prototyping with Lightweight Tools

Today, I am teaching a tutorial at PyCon called “Rapid Web Prototyping with Lightweight Tools.” I’ll update this post with how it went, but here are the materials people are using for the course. Video Recording Slides (web) Slides in Note Form (Github) Slides (SpeakerDeck) Code (git) Code (zip) pip requirements