Part 2 : Guidelines for Moving Real time data processing from Cloud to Edge

Continuing on Part1 , In this article, I will highlight the strategy, steps to follow, things to consider and possibly the best practices to do before moving the real time data analytics load from Cloud to edge. This is mostly aimed to serve as a guideline in architecture and process drafting while the enterprise is moving towards the edge. I have captured a common set of challenges and considerations.

While the use case I have worked on was specific to IoT and processing the data nearby the place of data generation, the principles can be applied to moving your processing to other type of Edge (i.e Geo location edge for smart city applications or to a edge at factory site for processing the data from machines and shop floors etc ). 

Continue reading the rest of the post in Medium

Minimizing cost over-runs in IoT services with Hardware traceability Matrix

I got myself involved in IoT out of my pure interest and passion. With engineering background in Textiles and significant software industry experience, Managing delivery in IoT services is a big challenge. I will describe a approach I have adopted from Waterfall SDLC to control cost and slippages.

When we think about IoT, many people attribute to startups and enterprise which are involved in custom hardware or create devices or a service for a specific use cases. However, planning and deploying Bespoke IoT solution, which is mostly done by services company is different and have its own unique challenges. Few of the key challenges I have observed are

Continue reading the rest of the post in Medium

Part 1 : Apache Beam : Key Pillar in IoT driven Digital Transformation

This is the first of three part series where I will be covering Apache Beam. While this part talks about features and benefits, the next part will give code examples and the last part will detail on how to migrate existing data streaming logics from cloud to edge.

Digital transformation has been an overused and a raging topic for the most part of the last decade. As the different channels of data generation, acquisition increased and data processing with cloud increased, enterprises and startups came up with innovative products and frameworks to add value.

Continue to read the rest of the post in Medium.

Containerizing Python based AI Model for ARM64 Devices(Raspberry Pi )

At Techolution we are working on deploying complex AI model to edge. While Intel based industrial gateways are generally used in our production deployments, for our experiments and trying out prototypes, we use RaspberryPi. Specially RaspberryPi4 to be specific. Since Linux is the OS which we use for production, we use Linux in our Pi’s as well, instead of standard Rasbian OS.

Continue reading the rest of the post in Medium

How we migrated from GKE to CloudRun and saved Infra costs

GKE is one of the wonderful service offerings from Google cloud. However, just that your services or functionalities are dockerized, does not mean that GKE should be the only choice of runtime to achieve a scalable solution. As cloud providers, especially GCP, keep adding new services in its portfolio, it is essential to see if any of the new services could match our requirement and solve our problem or make our solution more efficient.

Continue reading the rest of the post in Medium

TR Pattinam Beach visit

Myself, my family consisting of my parents, wife, children along with my chitappa,chitti, his son, his wife, their son and nephew visited beach at TR Pattinam beach yesterday (10th July 2010). While it is a beach predominantly used by fisher men, quite a few families also visited there. Beach was pretty clean and serene with trees dotting the shore.

Waves were mild and enjoyable and the depth was bit less. You can confidently get onto the waters upto a couple of meters. We had a nice time with our kids and family. If you are visiting Karaikal, Nagore, Nagapattinam this is one of the beach worth considering to visit.

On the flipside, you do not see amenities generally seen in beach. There are no bajji or sundal stalls. No food outlets are restaurants in the beach(you should come to the town, couple of kilometers away) and you should carry everything including water. There is also no lighting facility. So security after the sunset is not certain. If you are visiting with family, plan to depart from there by 5.30PM.

Nagai Nostalgia

I took my father and his younger brother (my chitappa) to Nagai (Nagapattinam) on July 9th 2021, to buy few medicines from their bank approved doctor. It is always a pleasure to watch two guys and especially two brothers dicsuss when they are not with their wives.

That too the fun improves multiple times when they visit a place where they grew up. My father and his siblings spent their entire childhood in Nagapattinam. They grew up there only. Doctors clinic was also near by the place where they started their career in bank. So they had lot of fun in relishing their childhood days, their secret hangouts, the places near by their home.

The moments like these make your life more memorable. It increases your bond with your parents and makes you feel closer to them. The fun was also amplified because we travelled in our own car. Though I was initially skeptical to buy it, but such fun and emotionally satisfying moments were because of our own car. In a rented car, there will always be a inhibition.