Skip to main content

IoT on Google Cloud Platform

Google wants people to use its Cloud Platform for connecting and managing IoT devices through IoT Core and use other GCP components like BigQuery to analyze data produced by those devices. While these products are fantastic, they also have some real world challenges.

IoT Core provides a managed service for connecting IoT devices. It talks with both HTTP and MQTT protocols and features one-click integration with Cloud PubSub easing most of the infrastructure tasks. However there are some limitations:

  1. You cannot use any random MQTT topic to send/receive messages as you would expect on a custom MQTT bridge. There are special topic formats to send messages and also to receive commands.
  2. IoT Core uses Public-Private Key cryptography to secure devices. All IoT devices must first authenticate using the Public Key in a JWT token and then start sending and receiving messages.
While these may seem like reasonable restrictions, one has to keep in mind that hardware vendors are still stuck in the 90's. Many of them use outdated languages and are reluctant to change any aspect of their devices script to make them talk to IoT Core. Vendors also want to move a subscription model where they charge a monthly fee to access the MQTT bridge hosted by them where their devices would send messages. As such their reluctance to adapt to IoT Core is much higher. The only real option left is to create a component which bridges the gap between hardware vendor's MQTT bridge and IoT Core which is a bad idea for so many reasons. Google must release a pre-approved list of vendors whose devices are compatible with IoT Core so that they can increase the adoption of GCP.

The other problem that one faces while using GCP is in building the UI. Most of IoT customers want real-time graphs for their devices and while Google does have Data Studio, it is not meant for real-time streaming data. To create a custom solution, one has to hook directly into PubSub and plot the streaming data received from there. For historical graphs, Data Studio along with BigQuery might be a option but one has to be very wary of costs which can escalate quickly while using BigQuery. Also the only way to embed a DataStudio graph in a web page is to use IFrame which leaves a very bad user experience. Google must provide a managed service for building charts (real-time or historical) which should be much better than what they currently provide with DataStudio.

GCP is a fantastic platform for building IoT solutions and if Google listens to its customers and provides a fully managed end-to-end solution for most scenarios, it will be a game changer and real challenger to Azure and AWS IoT solutions.

Comments

Popular posts from this blog

The IKEA Pilgrimage

"Hez!". If you were in Hyderabad for the opening of first IKEA store in India, you would be forgiven for thinking that it's a religious chant for followers of a religion who are trampling over themselves for getting into their place of worship. Except they were visitors to the new IKEA store.
For the past few days, the news had been carrying multitude of articles related to IKEA opening. The marketing by IKEA team only hyped the situation. Since I was looking to buy a bed, I made the unfortunate decision of going to the IKEA store for a quick in-n-out shopping with my wife on my way to office. The first red flag should have been when we couldn't get parking at 10 am in the morning of a weekday and were asked to park at one of external parking locations. The IKEA folks were kind enough to handout a map of the same.

We were asked to park near ITC Kohenur. From that location, like every well organized pilgrimage, there was a shuttle service to IKEA after every 30 minut…

Book Review - The Girl In Room 105

There are couple of reasons why I pre-ordered Chetan Bhagat's latest - its price is less than a cup of decent coffee making it an impulse purchase and more importantly the book's claim that it is an "unlove story", whatever that means. Bhagat had pioneered the trend of bubblegum IIT college love stories targeted at teens and college-going population which inspired a generation of wannabe writers. But you can chew bubblegum only for so long. After some time you have to spit it out. With this book Bhagat threw away the bubblegum only for it to stick to his shoes.
The story starts the same way as have Bhagat's previous books - in a college and more specifically in an IIT. For initial few chapters you would be forgiven if you think you have picked up one of Bhagat's previous works by mistake. Bhagat is still obsessed with fair skin, women's churidar kurta and how she arranges her hair. The English is still pedestrian which Bhagat justifies as this is how rea…

Centralized Configuration for .NET Core using Azure Cosmos DB and Narad

We are living in a micro services world. All these services are generally hosted in Docker container which are ephemeral. Moreover these service need to start themselves up, talk to each other, etc. All this needs configuration and there are many commercially available configuration providers like Spring Cloud Config Server, Consul etc. These are excellent tools which provide a lot more functionality than just storing configuration data. However all these have a weakness - they have a single point of failure - their storage mechanism be it a file system, database etc. There are ways to work around those but if you want a really simple place to store configuration values and at the same time make it highly available, with guaranteed global availability and millisecond reads, what can be a better tool than Azure Cosmos DB!
So I set forth on this journey for ASP.NET Core projects to talk to Cosmos DB to retrieve their configuration data. For inspiration I looked at Steeltoe Configuratio…