Announcing LangChain Templates for MongoDB Atlas

Since announcing the public preview of MongoDB Atlas Vector Search back in June, we’ve seen tremendous adoption by developers working to build AI-powered applications. The ability to store, index, and query vector embeddings right alongside their operational data in a single, unified platform dramatically boosts engineering velocity while keeping their technology footprint streamlined and efficient.

Atlas Vector Search is used by developers as a key part of the Retrieval-Augmented Generation (RAG) pattern. RAG is used to feed LLMs with the additional data they need to ground their responses, providing outputs that are reliable, relevant, and accurate for the business. One of the key enabling technologies being used to bring external data into LLMs is LangChain. Just one example is healthcare innovator Inovaare who is building AI with MongoDB and LangChain for document classification, information extraction and enrichment, and chatbots over medical data.

Now making it even easier for developers to build AI-powered apps, we are excited to announce our partnership with LangChain in the launch of LangChain Templates!

We have worked with LangChain to create a RAG template using MongoDB Atlas Vector Search and OpenAI. This easy-to-use template can help developers build and deploy a Chatbot application over their own proprietary data. LangChain Templates offer a reference architecture that’s easily deployable as a REST API using LangServe.

We have also been working with LangChain to release the latest features of Atlas Vector Search, like the recently announced dedicated vector search aggregation stage $vectorSearch, to both the MongoDB LangChain python integration as well as the MongoDB LangChain Javascript integration. Similarly, we will continue working with LangChain to create more templates, that will allow developers to bring their ideas to production faster.

If you’re building AI-powered apps on MongoDB, we’d love to hear from you. Sign up to our AI Innovators program where successful applicants receive no-cost MongoDB Atlas credits to develop apps, access to technical resources, and the opportunity to showcase your work to the broader AI community.

← Previous

Every Operational Data Layer (ODL) Can Benefit From Search

In today's digital landscape, organizations frequently encounter the daunting challenge of managing complex data architectures. Multiple systems, diverse technologies, and a variety of programming languages become entwined, making smooth operations a significant struggle. A frequent example of this issue is seen in some major banks still relying on a banking system built in the 1970s, continuing to run on a mainframe with minimal updates. The consequence is a complex architecture as seen in Figure 1, where data is scattered across various systems, creating inefficiencies and hindering seamless operations. Offloading the data from one or more monolithic systems is a well-proven approach to increase agility and deliver new innovative services to external and internal customers. In this blog we will speak about how search can make Operational Data Layers (ODL) – an architectural pattern that centrally integrates and organizes siloed enterprise data, making it available to consuming applications – an even more powerful tool. Figure 1: Complex Data Architecture Operational Data Store (ODS) as a solution To tackle the complexities of their existing data architecture, organizations have turned to Operational Data Stores (ODS). An ODS serves as a secondary data store, holding data replicated of primary transactional systems as seen in Figure 2. Organizations can feed their ODS with change data capture technologies. Figure 2: Conceptual model of an Operational Data Layer The evolutionary path of adoption Implementing an ODS requires a thoughtful approach that aligns with the organization's digital transformation journey. Typically, the adoption path consists of several stages as seen in Figure 3. Initially, organizations focus on extracting data from one system into their Operational Data Store, allowing them to operate on a more unified dataset. Gradually, they can retire legacy systems and eliminate the need for intermediate data streams. The key benefit of this incremental approach is that it delivers value (e.g. offloading mainframe operations) to the business at every step by eliminating the need for a complete overhaul and minimizing disruption. Figure 3: Evolution of a basic ODS into a system of records Areas of application ODS are used to support the business in three different ways: Data Access Layers allow organizations to free their data from the limitations imposed by data silos and technological variations. Organizations consolidate data from different sources that often use different data storage technologies and paradigms, creating a unified view that simplifies data access and analysis. This pattern is mainly used to enable modern APIs, speed up development of new customer services, and improve responsiveness and resiliency. Operational Data Layer (ODL): The ODL is an internal-focused layer that aids in complex processing workflows. It serves as a hub for orchestrating and managing data across various stages of processing. The ODL empowers organizations to enrich and improve data iteratively, resulting in more powerful and accurate insights. It provides a holistic view of data and process information, an improved customer experience, and reduced operational costs. Developer ODL: Building a developer-focused ODL can provide significant advantages during the development cycle. By making data readily available to developers, organizations can accelerate the development process and gain a comprehensive understanding of their data structures. This, in turn, helps in identifying and addressing issues early on, leading to improved data models and better system performance. In a nutshell, this pattern helps reduce developer training time, streamlines development and speeds up testing and test automation. The power of search in ODS So how can every ODL benefit from search capabilities and how can MongoDB Atlas Search help? Atlas Search plays a crucial role in maximizing the value of an ODS. When we have questions or are searching for an answer, our natural interaction with information is primarily through search. We excel at interpreting imprecise queries and extracting relevant information from vast datasets. By incorporating search capabilities with Atlas Search into an ODS, organizations can empower their users to explore, analyze, and gain valuable insights from their data. Consider the example of a banking organization with a complex web of interconnected systems. Searching for specific transactions or identifying patterns becomes a daunting task, especially when dealing with numeric identifiers across multiple systems. Traditionally, this involved manual effort and navigating through numerous systems. However, with a search-enabled ODS, users can quickly query the relevant data and retrieve candidate matches. This greatly streamlines the process, saves time, and enhances efficiency. Practical examples: Leveraging ODS and Atlas Search Let's explore a few practical examples that demonstrate the power of ODS and the Atlas Search functionality. Operational Data Layer for Payments Processing: A financial institution implemented an ODS-based operational layer for processing payments. By aggregating data from multiple sources and leveraging search capabilities, they achieved faster and more accurate payment processing. This enabled them to investigate issues, ensure consistency, and deliver a superior customer experience. Customer 360 View: Another organization leveraged an ODS to create a comprehensive view of their customers, empowering relationship managers and bank tellers with a holistic understanding. With search functionality, they could quickly locate customer information across various systems, saving time and improving customer service. Post-trade Trading Platform: A global broker operating across 25 different exchanges utilized an ODS to power their post-trade trading platform. By leveraging search capabilities, they simplified the retrieval of data from various systems, leading to efficient and reliable trading operations. Conclusion In the dynamic world of data management, Operational Data Stores (ODS) have emerged as a crucial component for organizations seeking to streamline their data architectures. By adopting an incremental approach and leveraging search functionality such as Atlas Search , organizations can enhance data accessibility, improve operational efficiency, and drive valuable insights. The power of search within ODS lies in its ability to simplify data retrieval, accelerate development cycles, and enable users to interact with data in a more intuitive and efficient manner. By embracing these practices, organizations can unlock the true potential of their data, paving the way for a more productive and data-driven future. For more information on Atlas Search, check out the following resources: Watch this MongoDB.local talk which expands on this blog: Every ODS Needs Search: A Practical Primer Based on Client Experiences Discover MongoDB’s search functionalities Learn how Helvetia accelerates cloud-native modernization by 90% with MongoDB Atlas and MongoDB Atlas Search

November 1, 2023
Next →

Hanabi Technologies Uses MongoDB to Power AI Assistant, Hana

For all the hype surrounding generative AI, cynics tend to view the few real-world implementations as little more than “fancy chatbots.” But for Abhinav Aggarwal, CEO of Hanabi Technologies, the idea of a generative AI-powered bot that is more than just an assistant was intriguing. “I’d been using ChatGPT since it launched,” said Aggarwal. “That got me thinking: How could we make a chatbot that was like a team member?” And with that concept, Hana was born. The problem with bots “Most generative AI chatbots do not act like people; they wait for a command and give a response,” said Aggarwal. “We wanted to create a human-like chatbot that would proactively help people based on what they wanted—automating reminders, for example, or fetching time zones from your calendar to correctly schedule meetings.” Hanabi’s flagship product, Hana, is an AI assistant designed to enhance team collaboration within Google Chat, working in concert with Google Workspace and its suite of products. “Our target customers are smaller companies of between 10 and 50 people. At this size you’re not going to build your own agent from scratch,” he said. Hana integrates with Google APIs to deliver a human-like assistant that chimes in with helpful interventions, such as automatically setting reminders and making sure meetings are booked in the right time zone for each participant. “Hana is designed to bring AI to smaller companies and help them collaborate in a space where they are already working—Google Workspace,” Aggarwal explained. The MongoDB Atlas solution For Hana to act like a member of the team, Hanabi needed to process massive amounts of data to support advanced features like retrieval-augmented generation (RAG) for better information retrieval across Google Docs and many other sources. And with a rapidly growing user base of over 600 organizations and 17,000+ installs, Hanabi also required a secure, scalable, and high-performing data storage solution. MongoDB Atlas provided a flexible document model, built-in vector database, and scalable cloud-based infrastructure, freeing Hanabi engineers to build new features for Hana rather than focusing on rote tasks like data extract, transform, and load processes or manual scaling and provisioning. Now, MongoDB Atlas handles a variety of responsibilities: Scalability and security: MongoDB Atlas’s auto-scaling and automatic backup features have enabled Hanabi to seamlessly grow its user base without the need for manual database management. RAG: MongoDB Atlas plays a critical role in Hana’s RAG functionality. The platform enables Hanabi to split Google Docs into small sections, create embeddings, and store these sections in Atlas’s vector database. Development Processes: According to Aggarwal, MongoDB’s flexibility in managing changing schemas has been essential to the company’s fast-paced development cycle. Data Visualization: Using MongoDB Atlas Charts has enabled Hanabi to create comprehensive dashboards for real-time data visualization. This has helped the team track usage, set reminders, and optimize performance without needing to build a manual dashboard. Impact and results With MongoDB Atlas, Hanabi can successfully scale Hana to meet the demands of its rapidly expanding user base. The integration is also enabling Hana to offer powerful features like automatic interactions with customers, advanced information retrieval from Google Docs, and manually added memory snippets, making it an essential tool for teams around the world. Next steps Hanabi plans to continue integrating more tools into Hana while expanding its reach to personal Gmail users. The company is also rolling out a new automatic-interaction feature, further enhancing Hana’s ability to proactively assist users without direct commands. MongoDB Atlas remains a key component of Hanabi’s stack, alongside Google Kubernetes Engine, NestJS, and LangChain, enabling Hanabi to focus on innovating to improve the customer experience. Tech Stack MongoDB Atlas Google Kubernetes Engine NestJS LangChain Are you building AI apps? Join the MongoDB AI Innovators Program today! Successful participants gain access to free MongoDB Atlas credits, technical enablement, and invaluable connections within the broader AI ecosystem. If your company is interested in being featured, we’d love to hear from you. Connect with us at ai_adopters@mongodb.com.

November 21, 2024