Getting Started with Databricks LLM Chatbot with RAG and Vector Search Demo

Introduction I recently setup and have been playing around with the “Deploy LLM Chatbots with RAG and Databricks Vector Search” demo from Databricks. While not a complete step-by-step guide, this article offers insights into what to expect, the necessary steps, how to fix issues that may arise, and how to maximize your trial experience quickly. Getting access to Databricks You can get a free 2-week trial from Databricks. I used AWS, and if you want to follow along, you will need to do the same. Here are the main things to know for setting up the trial. ...

April 17, 2024 · 6 min · Ben Karciauskas
Enterprise Ready Production Gen AI with Databricks

Enterprise Ready Production Gen AI with Databricks

The Rise of Private Generative AI and the Need for Enterprise Tools As the potential of Generative AI becomes increasingly apparent, more and more organisations are looking to harness its power for their specific use cases. However, deploying AI models in a private, secure, and compliant manner presents significant challenges. While public AI models like OpenAI and Anthropic have demonstrated remarkable capabilities, many organisations require the ability to leverage private and often sensitive data sources and deploy them in a controlled environment. This is especially critical for industries with strict data privacy and compliance requirements, such as healthcare, FSI and Government. Private Generative AI allows companies to leverage the power of AI while ensuring that sensitive data remains secure and confidential. ...

April 15, 2024 · 3 min · Ben Karciauskas