~hackernews | Bookmarks (3)

We were building a startup that measured marketing effectivness via a statistical attribution model. For this to work we had to collect a ton of online user behavior. Every click, every field input, every action. Data was stored in postgres and end users, via our UI, ran dashboards and reports that crunched the abov...

Seagull taking off — Picture by AdrianWhen the company stops growing, when the founder moves on, when HR is calling the shots, when the executives care more about real estate than products…It’s time to leave, and find a new company to work for.I joined AWS about seven years ago, when it was growing fast, there was h...

In this article, we’ll be taking a look at how to run a GPU-accelerated open-source Large Language Model (LLM) inference workload using Elastic Kubernetes Service (EKS). Perhaps the most buzzwords I’ve ever unironically strung together in a single sentence. Wondering what inference means? It’s the fancy term for pro...