Build RAG Application Using a LLM Running on Local Computer with Ollama Llama2 and LlamaIndex

Build RAG Application Using a LLM Running on Local Computer with Ollama Llama2 and LlamaIndex

In my previous post, I explored how to develop a Retrieval-Augmented Generation (RAG) application by leveraging a locally-run Large Language Model (LLM) through Ollama and Langchain. This time, I will demonstrate building the same RAG application using a different tool, LlamaIndex. All source codes related to this post have been published on GitLab. Please clone the repository to follow along with the post.

LlamaIndex is a comprehensive framework designed for constructing production-level Retrieval-Augmented Generation (RAG) applications. It provides a user-friendly and flexible interface that allows developers to connect LLMs with external data sources, such as private databases, documents in formats like PDFs and PowerPoints, and applications including Notion and Slack, as well as databases like PostgreSQL and MongoDB.

See Also

Why is chunking important in RAG applications?

As you go deeper down the rabbit hole building LLM-based applications, you may find that you need to root your LLM responses in your source data. Fine

An Introductory Guide to Fine-Tuning LLMs

Fine-tuning Large Language Models (LLMs) has revolutionized Natural Language Processing (NLP), offering unprecedented capabilities in tasks like language translation, sentiment analysis, and text generation.

Fine-Tuning LLMs: Overview, Methods & Best Practices

Fine-tuning is the process of adjusting the parameters of a pre-trained large language model to unlock the full potential of LLMs in specific domains or applications.

How To Test Swift Packages

Swift packages are a neat and simple way to bundle up and share code. They remove the overall complexity by not requiring an Xcode project but instead

Replacing Combine with Async/Await in SwiftUI using a HotSignal Class

The HotSignal class is a custom wrapper designed to expose a sequence of events using Swift’s Async/Await features.

Thread safety with Mutex in Swift 6

Today we will be exploring the Mutex struct, seeing how it can be used to prevent crashes and undefined behaviour due to simultaneous reads & writes to shared mutable data.