Posts

it’s been slightly north of a month since I joined SpaceXSI to work alongside some insanely cracked folks on high-performance networking for starlink & the data centers (i.e., colossus, macrohard, minihard). my team works specifically on the routing side of things. we’re ass deep in some real-time systems, low-latency networking, and resource-constrained environments. can’t say more than that :) key takeaways so far: less is more. only the paranoid survive. push to physics limits, always! implementations second, let’s talk the first-principles first. have fun, this is some cutting-edge cool shit and not everyone is lucky (and/or skilled) enough to work on it. to understanding the universe! 🥂 ...

in high school, i was extremely good at school. i don’t mean that in the vague, linkedin way where everyone was apparently a visionary at seventeen. i mean that i understood the system, optimized for it, and the system rewarded me. i graduated as a top ontario scholar and received the governor general’s academic medal. i also got accepted into waterloo’s computer engineering program, which felt like the natural conclusion to all of it. ...

i’ve always been trying to learn more from first principles about topics i care about. not because it sounds intellectually impressive, but because i’ve noticed that most shortcuts stop being useful the moment someone asks me a slightly deeper question. analogies are probably the worst offender. they’re supposed to make unfamiliar concepts easier to understand by connecting them to familar ones. most of the time, this shit actually works. but, they also quietly replace the thing being explained (AI explanations do this a lot). instead of understanding the actual mechanism, i end up understanding a watered-down version that behaves similarly under some narrow set of conditions. ...

to be quite frank, i’m very proud of my technical progression as a software engineer. when i was admitted into ece at the university of waterloo, i knew how to code in the sense that i could make things work, but i had very little of the judgment or depth that i now associate with actually being an engineer. i wasn’t thinking seriously about architecture, performance, failure modes, maintainability, or what was happening beneath the abstractions i was using. i was mostly just excited that the code ran lmfao (why did i think commenting was the shit back then). ...

these days, the more i read about modern ai inference, the more i start to draw these web of connections to HFT (high-frequency trading). replace market data with tokens, NICs with GPUs, and order execution with inference, and suddenly… you’re reading the same playbook. not to mention, the underlying skill set is a near exact match. in HFT, engineers obsess over shaving microseconds off the critical path. we bypass the kernel to eliminate unnecessary context switches, build lock-free structures so threads never wait on each other (on a side note: the mutex strategy generally wins over lock-free lol), organize memory to maximize cache locality, vectorize hot-paths with SIMD instructions, and profile everything like maniacs because every cache miss has a measurable cost. ...