Sunil Ghimire.
Back to the rest of the site

Notes & long reads

Blog

Things I worked out by writing them down. Mostly about NLP, occasionally about the job of explaining any of it.

Most of what is here started as something I did not understand well enough. I read about it, tried it, got it wrong, and then wrote it down until the explanation held together. If a post reads clearly, that is usually because the confusion came first.

I write about natural language processing because that is where my day goes: tokenisers, embeddings, models that behave beautifully in a notebook and badly in production. But the explaining interests me as much as the thing being explained. A technical idea that only makes sense to people who already understand it has not really been explained.

So I try to stay concrete. Worked examples ahead of analogies where I can manage it, and an honest note where something is still unclear to me. I would rather leave a question open than close it with a sentence that sounds confident and means nothing.

Some posts are long, some are one idea I could not shake. Take whichever is useful and skip the rest. 🙂

Showing 3 of 3

What a tokeniser actually does

Before a language model sees a single word, something has already made hundreds of decisions on its behalf. Most of them are invisible until they break.

Read it

Notes on writing in two languages

I write documentation in English and मुक्तक in Nepali. They have turned out to be very different kinds of thinking.

Read it