26 January 2017

IoT Messaging at scale with MQTT and Kafka



Kafka vs. MQTT for IoT:

Kafka is a very famous streaming platform. It scales well because you can cluster the brokers and it has intelligent but relatively THICK clients. These intelligent clients make it good for server to server communication and it keeps the brokers quite lightweight. However, heavy clients are not well suited for IoT where you have tiny devices with very little CPU and memory resources. For these type of environments, MQTT is an often used light weight protocol.





However, MQTT is weak when it comes to scaling it horizontally (you’d need load balances from both sides, publishers and subscribers and http which is too heavy and not reliable (subscribers must always be on)).  In this video, Tim Kellog describes a method where MQTT environments have been made salable with Kafka! Quite interesting approach to combine the strength of MQTT (lightweight on the client side) with Kafka (very scale-able streaming plattform). 

33 comments:

  1. Interesting blog post.This blog shows that you have a great future as a content writer.waiting for more updates...
    SEO Company in Chennai

    ReplyDelete
  2. This comment has been removed by the author.

    ReplyDelete
  3. This comment has been removed by the author.

    ReplyDelete
  4. Thanks a lot very much for the high quality and results-oriented help. I won’t think twice to endorse your blog post to anybody who wants and needs support about this area.

    amazon web services training in bangalore

    ReplyDelete
  5. Thanks for your great and helpful presentation I like your good service. I always appreciate your post. That is very interesting I love reading and I am always searching for informative information like this. Well written article Thank You for Sharing with Us pmp training class in chennai | pmp training near me | pmp training courses online | pmp training fee | | project management training in chennai

    ReplyDelete
  6. This comment has been removed by the author.

    ReplyDelete
  7. Al-Fares International Tents is the leading manufacturer and supplier of event marquees and tents all across UAE, Gulf, Middle East, and Africa. We provide our tents/marquees and shades structures for different occasions like wedding, trade expo, corporate events, branding events, event, and exhibitions. Exhibition Tents Rental Dubai | Tent Rental Dubai | Tent Manufacturer Dubai | Tent Supplier Dubai | Tent Rental Company Dubai | Event Tent Rental Dubai | Wedding Tent Rental Dubai | Outdoor Tent Rental Sharjah | Warehouse Tent Rental Abu-Dhabi | Tents and Marquees Supplier | Tents Manufacturers UAE

    ReplyDelete
  8. Thanks for this Article.
    For your Information, if you need Synzronize Genset for any events or something else, you can contact us Arthur Teknik. We'll provide it for you.

    ReplyDelete
  9. Thanks for this Article.
    Python has been the top most powerful and flexible open source language that is really very easy to learn. In our instructor based Python Training in Bangalore Advance Level we will teach you how to use the powerful libraries for data analysis and manipulation https://indiancybersecuritysolutions.com/python-training-in-bangalore-advance-level/

    ReplyDelete
  10. IMPRESSED WITH SUCH A GOOD CONTENT!!
    VERY INTERESTING
    GREAT WORK
    nas storage dubai

    ReplyDelete
  11. THANKS FOR SHARING SUCH A GREAT WORK
    GOOD CONTENT!!
    SAN Solutions in Dubai

    ReplyDelete
  12. Thanks for sharing an informative blog keep rocking bring more details.I like the helpful info you provide in your articles. I’ll bookmark your weblog and check again here regularly. I am quite sure I will learn much new stuff right here! Good luck for the next!
    Artificial Intelligence Training in Chennai

    Ai Training in Chennai

    Artificial Intelligence training in Bangalore

    Ai Training in Bangalore

    Artificial Intelligence Training in Hyderabad | Certification | ai training in hyderabad

    Artificial Intelligence Online Training

    Ai Online Training

    Blue Prism Training in Chennai

    ReplyDelete
  13. I got some clear information from this blog.. Thanks for taking a time to share this blog.. keep it up.Nice blog,I understood the topic very clearly,And want to study more like thisJava training in Chennai

    Java Online training in Chennai

    Java Course in Chennai

    Best JAVA Training Institutes in Chennai

    Java training in Bangalore

    Java training in Hyderabad

    Java Training in Coimbatore

    Java Training

    Java Online Training

    ReplyDelete
  14. Expected to form you an almost no word to thank you once more with respect to the decent recommendations you've contributed here.It's a very attractive and useful blog .I has found the solution, Thanks for the share.
    DevOps Training in Chennai

    DevOps Online Training in Chennai

    DevOps Training in Bangalore

    DevOps Training in Hyderabad

    DevOps Training in Coimbatore

    DevOps Training

    DevOps Online Training

    ReplyDelete
  15. Nice article i was really impressed by seeing this article, it was very interesting and it is very useful for me.It was very interesting and meaningful.I gained many unknown information, the way you have clearly explained is really fantastic.keep posting such useful information.
    Data Science Training In Chennai

    Data Science Online Training In Chennai

    Data Science Training In Bangalore

    Data Science Training In Hyderabad

    Data Science Training In Coimbatore

    Data Science Training

    Data Science Online Training

    ReplyDelete
  16. There are many interesting information included and i can easily understand all given information.I post something on my blog to post something, or wait to post something worth saying. Keep update more information....


    AWS Course in Bangalore

    AWS Course in Hyderabad

    AWS Course in Coimbatore

    AWS Course

    AWS Certification Course

    AWS Certification Training

    AWS Online Training

    AWS Training

    ReplyDelete
  17. I am curious about some of them and hope you will give more information on these topics in your next articles.
    IOT institute in hyderabad

    ReplyDelete
  18. If you are interested, you should check out this comprehensive guide to installment loans at www.bigpictureloans.com/installment-loans. There are also FAQs to help answer any questions.

    ReplyDelete
  19. NordVPN 2022 Crack is the software of your best choice to hide your identity from the internet endeavors to attack your personal information.! Nord VPN Cracked pc

    ReplyDelete
  20. Useful Article
    Thanks for sharing best content with us
    Visit my site for learning:

    SAP SD Training in Hyderabad

    ReplyDelete