Local LLM Creation

During a break at work, I came across an interesting article in the news about how you can set up an LLM right on your own PC.
That means you can use existing, world-class LLMs for free—completely free and even for commercial use. There’s really no reason not to try it, right?
Here are the details: https://www.lmstudio.ai/docs/app

So, I decided to test it out by replacing the AI component of a custom AI-OCR tool I made previously with a local LLM. However, whether due to limitations in the Python OCR library or something else, "Hoge Co., Ltd." was misread as "naito.
=== [2/6] Loading file: C:\tmp\AIOCR2\infile\Order.pdf ===
=== [3/6] Running company identification... === -> Identified company ID: naito === [4/6] Retrieving company-specific prompt... ===
=== [5/6] Running item extraction... ===
=== [6/6] Outputting JSON file: C:\tmp\AIOCR2\outfile\result.json === Processing completed.
C:\tmp\AIOCR2>
Turns out the issue wasn't the LLM, but rather the OCR library itself. Currently exploring other ways this might be useful.

Comments