arrow-left

All pages
gitbookPowered by GitBook
1 of 1

Loading...

Week 7 - Evaluation of LLM outputs and structured outputs

hashtag
today's schedule

  • Quiz

  • Short Recap

  • Short presentation of current status

  • Breakout Session ‘Next Steps’

  • Homework for next week

hashtag
resources

hashtag
homework

  • Take a look at this article:

  • Take a look at some open-source / open-access LLM frameworks:

Ollama (Mac, Linux):

  • https://www.youtube.com/watch?v=Ox8hhpgrUi0arrow-up-right

  • https://www.youtube.com/watch?v=k_1pOF1mj8karrow-up-right

  • LM Studio (Windows, Mac, Linux): - --https://medium.com/@genebernardin/running-llms-locally-using-lm-studio-38070f286413arrow-up-right

  • GPT4All

  • Test some open-source/open-access LLMs either locally downloaded or in HuggingFace spaces or any other test environment (e.g. HuggingChat, H2O.ai, etc.)

    • Do you see significant differences in the output of proprietary and open-source/open-access LLMs?

  • file-pdf
    687KB
    231212_Evaluation of LLM outputs and structured output.pptx (1).pdf
    PDF
    arrow-up-right-from-squareOpen
    https://blog.n8n.io/open-source-llm/arrow-up-right