At the Adelphi University Innovation Center, we are committed to empowering our community by making advanced technology accessible. One of the most exciting opportunities today is the ability to run large language models (LLMs) – the technology underlying systems like ChatGPT and Gemini – entirely on your own computer. With tools like Ollama and AnythingLLM, installing a powerful AI system can be as straightforward as downloading an application and clicking “install”. No cloud infrastructure, no API keys, no per-token billing. Faculty and students in all disciplines can experiment with cutting-edge AI using their own computers, running software with a familiar look and feel.

Running LLMs locally offers two major advantages: privacy and cost control. Because the programs are running on your own device, your documents never leave your computer. This is especially important when working with unpublished research, student data, institutional materials, or sensitive work. Unlike subscription-based systems, there is no up-front cost and no recurring fee. With systems like AnythingLLM that support Retrieval Augmented Generation (RAG), you can connect to your own curated collection of PDFs, notes, syllabi, archival materials, or datasets, turning the system into a personalized research assistant grounded in your actual knowledge base. While platforms like NotebookLM offer compelling cloud-based document analysis, a local RAG system gives you similar capabilities with full control and customization abilities.

Beyond installation and experimentation, we also actively engage in software development – designing and refining custom front-end interfaces for local LLM systems tailored to individual needs. These lightweight, adaptable prototypes are publicly available through our GitHub repository, reflecting our commitment to using open tools and contributing back to the open-source community. At the same time, we are developing a series of workshops in collaboration with our Faculty Center for Professional Excellence to help participants become conversant with the terminology, core concepts, and practical implementation of these systems. Together, these initiatives support a culture of experimentation and advancement that is accessible, affordable, and capable of generating meaningful impact across the Adelphi community.