XIO

xWire

Posts from every feed QUEST has found across the web — blogs, news, podcasts, channels and more.

Pablo Fernandez

Geek, manager, coder, maker, author, entrepreneur

My First Week Learning vLLM

When I first read about KV caching in AI Engineering by Chip Huyen, I remember wondering why I was reading this. I was never going to use it. This week I spent quite a lot of time looking at KV cache charts. I’ve been learning deep learning for a while now, mostly through books and by building things. I built and trained a small LLM, then implemented multi-head latent attention from the DeepSeek-V2 paper. I also built a non-LLM model at work for aesthetic evaluation of photos. More recently, I…

Tech interviews are not (that) broken

I constantly see the same complaints about job interviews: This is not what the job looks like! I’ve never used big-O notation in my career. Have you ever been asked to reverse a linked list at work? But those can be good software engineering interviews. The industry has become much better than it was when the complaints were: Who cares how many ping pong balls fit in a 747? What do blenders and miniaturization have to do with software engineering? Why would you put the switches downstairs and…

Applying least privilege to end-to-end encrypted dashboards

Years ago I built an application called Dashman. Customers used it to show web dashboards on screens around an office, a factory, a classroom, or a public space: Google Analytics, internal Grafana, shop-floor counters, org announcements, whatever they cared about as long as it was on web pages. This post is a retrospective on how that system was put together: the architecture, the handling of rendering jobs, and the end-to-end encryption that applied least privilege to every machine in the…

I got my hand in Apple’s cookie jar

When I was building Dashman, I hit a wall that Apple’s paid developer support told me was unsolvable. Then I solved it by reading the binaries in assembly until I understood them well enough to swap them out. A note up front: this happened a long time ago and I’m writing it from memory. The shape of the work is right; small specifics, API names, and exact sequence of events may be slightly off. What was Dashman? Dashman was a B2B SaaS for displaying business dashboards (which are, technically,…

When failure was an option

A few years ago, at Wifinity, around 4 in the morning, I made one of the hardest decisions of my career: I rolled back a migration we’d spent months preparing for. We were migrating the production infrastructure of an ISP serving 200k+ customers. Traffic was already flowing through the new environment in read-only mode, the cutover was minutes from its point of no return, and we’d burned every minute of buffer trying to fix the issue that had surfaced. As we hit the edge of the rollback window,…

Your competitive advantage is your agency

I see a lot of grandiose statements floating around: You will not be replaced by AI, you’ll be replaced by someone using AI. AI won’t replace your creativity. AI can’t do THIS or THAT. AI will never be able to do THIS or THAT. And many more. My take: maybe. Who knows! LLMs are getting better at an alarming rate and they behave in unexpected ways. They make the simplest mistakes but at the same time, they have solved some of the hardest math problems. This is well know as the jagged edge. The…

The SaaSpocalypse is real, but not for the reasons you think

SaaS valuations dropped. The narrative is simple: AI lets anyone build anything, so why pay for software? They’re calling it the SaaSpocalypse. I think part of it makes sense. But a big part of it doesn’t. You don’t buy code, you buy decisions When you buy a piece of software you’re not just buying the code. You’re buying the decisions that shaped that code. What to build, what not to build, how to model the domain, which tradeoffs to make. Those decisions were valuable before AI and they are…

Constant Eval in Production, the idea

I’m sure this is not my idea, so I’m not claiming it to be. I’ve been wanting to do a sort of continuous AI eval in production for a while, but the situation never presented at work. It was a mixture of having the data to do the eval off line, and wanting to avoid the risks of doing it in prod. But now I’m going to do it for a side project. I don’t want to reveal what my side project is yet, so I’ll keep it vague. I’m very excited about this part, so I wanted to share it early. And I’m hoping…

Culture goals should be achievable

A company’s overall goals can shape its culture. Take the popular “Employee of the Month” idea, when employees see it as meaningful, it becomes ingrained in the culture and can motivate higher performance. But these goals need to be achievable, and sometimes making them achievable is a small matter of phrasing. Let me show you an example. For Canva, where I work, tenure is important. One way to celebrate tenure would be by marking when people joined. For example, a company can choose to give…

A better monetization model for LLM applications

Bring your own keys into an affiliate relationship I’m starting to observe a problem where a lot of LLM-enhanced apps are starting to pop up. For coding you have Cursor, but now there’s also a terminal called Warp and it costs $15/month. For individuals, consultants, small and even medium sized companies, this isn’t a workable pricing model. All apps were already turning into subscriptions and the cost of LLMs is accelerating that. What compounds the problem is that, because everyone feels…

The Feedback Loop

How Your Response Determines Your Growth I work at a pretty amazing company, Canva, that has a culture of feedback. I came in practicing Kim Scott’s Radical Candor, and Canva has been a strong environment for it. I think I have given and received more feedback in the two years I’ve been here than in the rest of my professional life put together. It has taught me something critical about the importance of a growth mindset. Managing several teams also gave me a lot of perspective here. I always…