AllAccepted answers
Jonathan Zhou · Jul 31

Hi Oliver,

Based on the error message, it looks like your error is coming from your connection to Ollama. Maybe double check the installation of all required packages, and that you are running in the proper python environment if you are using one. 

As a side note, I noticed you said that you are using medical visit progress notes from your Patient Portal as data. Just as a heads up, you probably should not send any private information to OpenAI -- unless you have some kind of business agreement with them, their LLMs are not HIPAA compliant and they can also keep + use whatever data you send them to further train their products. If you are using anonymized or mock/fake data, then that won't be an issue though :)

Jonathan Zhou · Jul 31

From personal experience, systems built solely using AI pile up so much tech debt when there is a lack of testing harnesses developed first. At this point, using AI irresponsibly is even worse than not using AI at all. Trying to undo this tech debt often takes longer than restarting.

As a side note, worked on a finetuned LLM model for ObjectScript this summer! While it's true that ObjectScript is not a mainstream language and many language models currently perform poorly on it, there's no reason this can't improve moving forward. The most challenging part of this is that there is no unified "consensus" style standard for what is "good" styled ObjectScript code, a lack of resources to evaluate LLM-generated ObjectScript, and a lack of enough code usable for training. Worked on addressing all of these points this summer if any of that sounds interesting :)