LLMs: great for business but bad business

LLMs: great for business but bad business

The true value proposition of LLMs lies in their ability to convert unstructured data from sources like websites and documents into structured information with reasonably high accuracy. Yet, the real profit lies in the products built on top of LLM technology. Each year, approximately 4 million books are published worldwide. On average, a book contains fewer than 120,000 words, translating to less than 160,000 tokens in LLM (Large Language Model) terms. Imagine if every single one of these books were generated by GPT-4鈥攊t would amount to an astounding 640 billion tokens. At $5 per million tokens, generating all these books would tally up to about $3.2 million! Let鈥檚 say the book market represents only about 1% of the total LLM text generation opportunity. Even then the total addressable market of LLM text generation is approximately $300 million annually鈥攁 modest figure when compared to AWS, which raked in $90 billion in 2023 as the cloud market leader.

Some data on podcasting

Some data on podcasting

A few years back, I scraped data on podcasters from iTunes. The data was a bit underwhelming and made me realize that podcasters can鈥檛 be a potential market. It is a bit dated but I believe is still relevant.

Timing

Timing

Two cryptocurrency exchanges came out early on from Y Combinator. One is 2012. One in 2013. One returned 1500X to early investors. The other one ceased to exist after 2 years. What happened?

Real vs Theoretical Engineering Productivity

Real vs Theoretical Engineering Productivity

Some engineering productivity is real. Some are theoretical.

Too much documentation is harmful

Too much documentation is harmful

As code changes, documentation becomes stale over time. This happens at big companies. This happens at small companies. Unlike code, documentation is not compiled or tested. The code is executed. If the code execution fails or produces incorrect results, it is fixed with much higher urgency.

Engineering stack

Engineering stack

Most startups think of the engineering stack as if it is a single cohesive thing. However, I believe that there are three different engineering stacks that are loosely coupled to each other.

The Mom Test by Rob Fitzpatrick

Book Summary: The Mom Test by Rob Fitzpatrick

The Mom Test is an intriguing book by Rob Fitzpatrick about how to do user research and validation of one鈥檚 product idea.

Engineering Guardrails

Engineering Guardrails

Guardrails are meant to protect us from tripping over. The same can be said about engineering guardrails.

VCs are anti-personas for a B2C startup

VCs are anti-personas for a B2C startup

The early adopters of Instagram were not VCs.

Staff Engineer by Will Larson

Book Summary: Staff Engineer by Will Larson

The book talks about what it means to be a staff engineer. It is an interesting read for those who would prefer to stay on the engineering as opposed to the management track of career growth.