Leanpub Header

Skip to main content

Kafka Up and Running for Network DevOps

Set Your Network Data in Motion

Kafka Up and Running for Network DevOps will take you on a journey to get up and running with the Apache Kafka data message system in a network engineering context. By the end of the book, you will have a new tool in your network engineering toolbox for a highly reliable, redundant data message system.

Minimum price

$9.99

$9.99

You pay

$9.99

Author earns

$7.99
$

...Or Buy With Credits!

You can get credits monthly with a Reader Membership
PDF
EPUB
WEB
163
Readers
165
Pages
About

About

About the Book

Today's network is about agility, automation, and continuous improvement. In Kafka Up and Running for Network DevOps, we will be on a journey to learn and set up the hugely popular Apache Kafka data messaging system. Kafka is unique in its principle to treat network data as a continuous flow of information that can adapt to the ever-changing business requirements. Whether you need a system to aggregate log messages, collect metrics, or something else, Kafka can be the reliable, highly redundant system you want.

We will begin by learning about the core concepts of Kafka, followed by detailed steps of setting up a Kafka system in a lab environment. For the production environment, we will take advantage of the various public cloud provider offerings. Next, we will set up our Kafka cluster in Amazon Managed Kafka Service to host our Kafka cluster in the AWS cloud. We will also learn about AWS Kinesis, Azure Event Hub, and Google Cloud Put/Sub. Finally, the book will illustrate several use cases of how to integrate Kafka with our network from data enhancement, monitoring, to an event-driven architecture.

The Network DevOps Series is a series of books targeted for the next generation of Network Engineers who wants to take advantage of the powerful tools and projects in modern software development and the open-source communities.

Author

About the Author

Eric Chou

Eric Chou is a seasoned technologist with over 20 years of experience. He has worked on some of the largest networks in the industry while working at Amazon AWS, Microsoft Azure, and other Fortune 500 companies. Eric is passionate about network automation, Python, and helping companies build better security postures. Eric is the author of the top-selling title, 'Mastering Python Networking' (Packt Publishing). Eric is the primary inventor for two U.S. patents in IP Telephony. He shares his deep interest in technology through his books, classes, blog, and contributes to some of the popular Python open-source projects.

Leanpub Podcast

Episode 222

An Interview with Eric Chou

Contents

Table of Contents

Introduction

  1. What is Kafka
  2. Why do we need Kafka
  3. Prerequisites for this book
  4. Who this book is for
  5. What this book covers
  6. Download the example code files
  7. Conventions used
  8. Get in touch

Chapter 1. Kafka Introduction

  1. History of Kafka
  2. Kafka Use Cases
  3. Disadvantages of Kafka
  4. Kafka Concepts
  5. Conclusion

Chapter 2. Kafka Installation and Testing

  1. Network Lab Setup
  2. Kafka Installation Overview
  3. Install Java
  4. Download Kafka
  5. Configure Zookeeper
  6. Configure Kafka
  7. Start Zookper and Kafka manually
  8. Test the Kafka operations
  9. Configure System Services
  10. Conclusion

Chapter 3. Kafka Concepts and Examples

  1. Producers: Writing Messages
  2. Consumers: Receiving Messages
  3. Offsets in Action
  4. Kafka Topic Administration
  5. Replication
  6. Conclusion

Chapter 4. Hosted Kafka Services

  1. AWS Managed Kafka Service
  2. Amazon MSK Costs
  3. Launch Amazon MSK Cluster
  4. Client Setup
  5. Produce and Consume Data
  6. Conclusion

Chapter 5. Cloud Provider Messaging Services

  1. Amazon Kinesis
  2. Amazon Kinesis Example
  3. Azure Event Hub
  4. Azure Event Hub Example
  5. Google Cloud Pub/Sub
  6. GCP Pub/Sub Python Example
  7. Conclusion

Chapter 6. Network Operations with Kafka

  1. Install Docker
  2. Install Elasticsearch
  3. Install Kibana
  4. Network Data Feed
  5. Network Data Pipeline
  6. Network Log as a Service
  7. Conclusion

Chapter 7. Other Kafka Considerations and Looking Ahead

  1. Hardware Considerations
  2. Kafka Broker and Topic Configurations
  3. Schema Registry
  4. Kafka Stream Processing
  5. Cross-Cluster Data Mirroring
  6. Additional Resources
  7. Conclusion

Appendix A. Installing Lab Instance in Public Cloud

Get the free sample chapters

Click the buttons to get the free sample in PDF or EPUB, or read the sample online here

The Leanpub 60 Day 100% Happiness Guarantee

Within 60 days of purchase you can get a 100% refund on any Leanpub purchase, in two clicks.

Now, this is technically risky for us, since you'll have the book or course files either way. But we're so confident in our products and services, and in our authors and readers, that we're happy to offer a full money back guarantee for everything we sell.

You can only find out how good something is by trying it, and because of our 100% money back guarantee there's literally no risk to do so!

So, there's no reason not to click the Add to Cart button, is there?

See full terms...

Earn $8 on a $10 Purchase, and $16 on a $20 Purchase

We pay 80% royalties on purchases of $7.99 or more, and 80% royalties minus a 50 cent flat fee on purchases between $0.99 and $7.98. You earn $8 on a $10 sale, and $16 on a $20 sale. So, if we sell 5000 non-refunded copies of your book for $20, you'll earn $80,000.

(Yes, some authors have already earned much more than that on Leanpub.)

In fact, authors have earned over $14 million writing, publishing and selling on Leanpub.

Learn more about writing on Leanpub

Free Updates. DRM Free.

If you buy a Leanpub book, you get free updates for as long as the author updates the book! Many authors use Leanpub to publish their books in-progress, while they are writing them. All readers get free updates, regardless of when they bought the book or how much they paid (including free).

Most Leanpub books are available in PDF (for computers) and EPUB (for phones, tablets and Kindle). The formats that a book includes are shown at the top right corner of this page.

Finally, Leanpub books don't have any DRM copy-protection nonsense, so you can easily read them on any supported device.

Learn more about Leanpub's ebook formats and where to read them

Write and Publish on Leanpub

You can use Leanpub to easily write, publish and sell in-progress and completed ebooks and online courses!

Leanpub is a powerful platform for serious authors, combining a simple, elegant writing and publishing workflow with a store focused on selling in-progress ebooks.

Leanpub is a magical typewriter for authors: just write in plain text, and to publish your ebook, just click a button. (Or, if you are producing your ebook your own way, you can even upload your own PDF and/or EPUB files and then publish with one click!) It really is that easy.

Learn more about writing on Leanpub