I'm so glad you are doing videos on the token/ast stuff in Go! I've recently started using the Go tokeniser to write a code analysis tool for another language and I found it very easy to work with. So far I only have the tokenisation bit fully working so the next episode will be very useful!
Good video. Learnt couple new things. But just wondering why and where would you use this scanner and tokenizer? What real world problem it will solve for me? use case? Thanks