For handwriting recognition does a multimodal model become overkill?

Is a small local model more than I need to change handwritten notes to text?

My agent has a skill I use but I could probably not use up my limited inference bandwidth or maybe not as much if it’s a much smaller model, right? What’s the smallest model that can accurately read handwriting?

Looking to hear others workflows or how they handle note conversion and the like

Thanks