top of page

Local LLM Creation

Jul 21
1 min read

During a break at work, I came across an interesting article in the news about how you can set up an LLM right on your own PC.

That means you can use existing, world-class LLMs for free—completely free and even for commercial use. There’s really no reason not to try it, right?

Here are the details: https://www.lmstudio.ai/docs/app


So, I decided to test it out by replacing the AI component of a custom AI-OCR tool I made previously with a local LLM. However, whether due to limitations in the Python OCR library or something else, "Hoge Co., Ltd." was misread as "naito.


=== [2/6] Loading file: C:\tmp\AIOCR2\infile\Order.pdf ===

=== [3/6] Running company identification... === -> Identified company ID: naito === [4/6] Retrieving company-specific prompt... ===

=== [5/6] Running item extraction... ===

=== [6/6] Outputting JSON file: C:\tmp\AIOCR2\outfile\result.json === Processing completed.


C:\tmp\AIOCR2>


Turns out the issue wasn't the LLM, but rather the OCR library itself. Currently exploring other ways this might be useful.


 
 
 

Recent Posts

See All

Comments


bottom of page