Today on the show we're talking about streaming data and streaming applications with Apache Kafka. We're joined by Kris Jenkins, Developer Advocate from Confluent, and Rob Walters, Product Manager at MongoDB, who will discuss how you can leverage this technology to your benefit and use it in your applications.

Kafka is traditionally used for building real time streaming data pipelines and real time streaming applications. It began its life in 2010 at LinkedIn and made its way to the public open-source space through a relationship with Apache, the Apache Foundation, in 2011. Since then, the use of Kafka has grown massively and it's estimated that approximately 30% of all Fortune 500 companies are already using Kafka in one way or another.

A great example for why you might want to use Kafka would be perhaps capturing all of the user activity that happens on your website. As users visit your website, they're interacting with links on the page and scrolling up and down. This is potentially large volumes of data. You may want to store this to understand how users are interacting with your website in real time. Kafka will aid in this process by ingesting and storing all of this activity data while serving up reads for applications on the other side.

Conversation highlights include:

• [03:38] What is Kafka?
• [05:29] At the heart of every database
• [08:03] The difference between Kafka and a database
• [09:03] What Kafka's architecture looks like
• [12:03] Kafka as a data backbone of system architecture
• [14:06] MongoDB and Kafka working together
• [15:40] What are "Topics" in Kafka?
• [17:53] Chain stream events
• [19:58] Kafka's history
• [22:07] MongoDB Connector, and Kafka via Confluent Cloud
• [25:53] Popular use cases using Kafka and MongoDB
• [27:48] Kafka and stream processing with games and event data
• [29:13] KSQL and processing against the stream of data
• [30:59] Developer.Confluence.io, a place to learn everything about Kafka

Kunal Lanjewar, a senior software engineer, joins host Michael Lynn to discuss how thatgamecompany is making use of MongoDB to support the video game "Sky."

Conversation highlights include:

• Kunal talks about his role as a senior software engineer at thatgamecompany
• Using MongoDB to store terabytes worth of customer gameplay data
• How Kunal became interested in game and software development
• The people, games, and creativity of thatgamecompany
• Using MongoDB and Atlas to automatically scale

Prisma is an open-source ORM for Node.js and TypeScript that helps developers build faster and make fewer errors. On this episode, host Mike Lynn sits down with Nikolas Burk and Matt Miller of the Prisma team to discuss the Prisma + MongoDB Launch Week. Nikolas is a Developer Advocate and Matt is a Product Manager at Prisma, and together they're here to outline what Prisma is now capable of with MongoDB support, including effects on developer workflows and efficiency.

Other topics of conversation include:

• How Prisma's introspection capabilities allow for flexible schemas in database management.
• Relational databases, embedded documents, and inferring relationships
• What the Prisma + MongoDB relationship was like throughout preview phase to production ready
• How Matt and Nikolas ended up at Prisma
• Prisma and making the experience of modeling data really easy
• Impacts on data migration, emphasis on typescript and type safety, and other benefits

Check out Prisma:

• https://www.prisma.io/
• https://twitter.com/prisma
• https://www.linkedin.com/company/prisma-io/
• https://www.prisma.io/blog/

More about Prisma + MongoDB Launch Week

• https://www.prisma.io/mongodb-launch/

It's not every day that you get to spend time with a database industry legend. Today is that day. Dr. Michael Cahill is the VP Labs at MongoDB. Prior to leading Labs, he co-founded, and co-architected WiredTiger, the company and the storage engine respectively. His work on multiversion concurrency control and serializable isolation snapshotting has won the SIGMOD Test of Time award and his groundbreaking work on the Berkeley Database remains some of the most popular open source database software ever written. WiredTiger became the default storage engine after MongoDB acquired WiredTiger the company in 2015.

MongoDB World 2022 - June 7-9th Register today using code "PODCAST" for a 25% discount.

https://mongodb.prakticum-team.ru/world-2022

MongoDB World Hackathon '22

Build your way to MongoDB World this year by competing in our hackathon. This year’s theme is “Data as news - A hackathon for information overload”.  On this episode, Shane McAllister joins us along with Mark Smith, and Adrienne Tacke from the MongoDB Developer Relations team to talk about the MongoDB World Hackathon '22

Visit https://mongodb.prakticum-team.ru/world-2022/agenda-and-activities for more information.

Humanity faces massive challenges with news & information overload! Fortunately, there are public datasets that enable developers to build useful insights on top of public data. Put on your thinking hat, enter on your own or form a team, and participate in the largest MongoDB sponsored hackathon, bring your ideas to life and compete to win one-of-a-kind prizes.

The MongoDB World Hackathon is a 6 week long competition for the world's hackers, designers, and makers. The MongoDB World Hackathon is a great opportunity to gain experience with new technologies and learn new skills.

Submissions close at 5pm EST on May 20th.

Visit https://mongodb.prakticum-team.ru/world-2022/agenda-and-activities for more information.

Don't forget to use code PODCAST when registering for MongoDB World for a 25% discount! https://mongodb.prakticum-team.ru/world-2022