Innovations in Comfort, Efficiency, and Safety Solutions.
EMAIL INTERVIEW – Ken Sinclair and Nicolas Waern
Nicolas Waern, CEO, Go-IoT
"The Building Whisperer" - Making
buildings talk to people
Your Building with Artificial Intelligence on the Edge
Sinclair: Hi Nicolas! How have you been since Atlanta? I know you have two small kids, and that usually means sleepless nights. Maybe you have a need for some Artificial Intelligence?
Hey Ken, everything is great here in
Sweden, can’t complain! And even though it was great in Atlanta, it
certainly feels like it happened a lifetime ago. Yes, there are the
occasional sleepless nights with Isabeli and Maximus. But there’s so
much going on at the moment that I feel like my intelligence level is
increasing every minute! Maybe, I, don’t need artificial intelligence
in the future, but I know for certain that our customer’s buildings do!
Because as you know, if you want to sleep better, you should invest in
a smarter building. Not sure if it would help, yet, getting toddlers
back to sleep, but combined with sensors and wearables, it would give
me insights as to what might be the problem.
And that should be the starting point
for any future AI/ML _Insert technology here_ initiative. Not directly
see what AI could do, but think about it from a company perspective,
“How ready are we for AI to begin with?”
That’s what I
wanted to talk about. AI – Artificial intelligence, ML –
Machine learning, Big data, Data lakes, all of these things, are they
for real? Or just buzzwords?
Waern: You forgot Brain-Computer interface, Quantum Computing, IoT, BioT, Edge computing, Fog computing, Distributed intelligence and probably 10 000s more examples like these. According to Gartner, we’ve got our hands full, and a lot of the hype hasn’t gotten through widespread adoption just yet. But I would say that things are moving. A lot of buzzwords 2-3 years ago have materialized into real products and solutions in the market, and I thought I’ll briefly go through some thoughts that I have had.
building from the future
Running your building two hours from the future might be interesting to know more about, and it’s actually not that difficult. I am often asked about the need for historical data in buildings. And as always, I answer “it depends.” The data quality plays a major role in current AI/ML initiatives, and not all data is something you can work with straight off the bat. It’s often vice versa that a lot of effort goes to cleaning historical data and where new targeted data can lead to faster times to value creation. And that’s why having more logic on the edge (in the buildings), such as ML/AI running on a box, could offset that fact and at certain times even replace the need for historical data.
Let me give you a real example. We have a customer who owns a mall.
They want to run this mall from a digital twin operating two hours into
the future, which is an actual use case which we are in the process of
developing for them.
Ideally, they want to optimize energy usage, improve tenant well-being,
sell some services to their customers in the food court (restaurants)
so that they can improve their customer experience. This, in turn, will
lead to more people in the mall and gain additional insights on how to
save energy, predict equipment failure and to get the whole 3/30/300
rule benefits that come with a smarter building.
What to do
One approach that is quite easily executed is to put one of our DINGO BMS Controllers/Microcomputers in the building. Connect HVAC-R, meeting booking system, outside temperature, CO2 sensors, occupancy, camera and we pool that data in the microcomputer in the building, connecting it easily via RESTful APIs, and BACnet Web Services. We start feeding the DINGO data, standardize it underneath a BACnet umbrella, and an algorithm created from a 3rd party small-footprint library will learn how the building behaves during any given day or week. It will create a DNA for the building from scratch. This algorithm can be distributed at sensor level as well as cloud level, making use of brain power where it needs to be.
The building (with some human help to get it going) will learn that on
Thursdays, at lunch-time, there’s a 30% guest increase to one of the
restaurants in the food court because of the daily special “Pea-Soup
and Pancakes.” The camera, who’s also got some logic through a 3rd
party application, detects the long lines, as well as disgruntled
faces, and combined with social media ratings, we can see the
restaurants get 0,6 stars lower rating because of this fact exactly at
this point in time.
So, how can AI/ML help? Well, it can then deduce that the next time,
the building will mitigate the 30% increase in people by supplying more
air before lunch, off-setting any negative impacts it might have. A
third party app connected to the network translates machine-to-text-to
voice, sends a WhatsApp message to the office manager, reminding the
restaurant that they need to staff up and prepare, because “remember
what happened the last time.”
In summary, the building will learn when
people are moving where, how
they behave and become aware of what it needs to become aware of.
Furthermore, if we have 200 buildings connected, these can also learn
from each other, which is where the true value lies in that building
to building communication will lead to exponential increase in value,
insights, new business models and of course, ease of innovation.
And this is all possible today, quite easily as well if I say so.
Getting things connected, forming a platform of data to draw
conclusions from is a must for any AI/ML driven approach.
that sounded… very far off! But I like it! Having the
building talk to you is definitely humanistic and inclusive. But isn’t
this a bit scary?
A bit scary? This is terrifying! But
anything and everything is terrifying if you put it in the wrong hands.
So yes, there are definitive challenges with data security, privacy,
and technical challenges as well, and there are immediate concerns with
hacking and not least the ethical perspective to think about.
But maybe the real question is if this approach is really needed? Maybe
there’s no room for traditional food courts anyway so this approach to
innovation is just obsolete and we need to think about deletion,
instead of evolution. Maybe the answer is just these self-checkout
That’s the thing. Companies need to identify what is there right now,
where do we want to go in terms of functionality, and possibly feelings
as well? The existing status is to be annoyed, warm, irritated, because
of the long lines and poor indoor climate. The solution is to get rid
of those feelings with any means necessary. And that’s what AI/ML and
any parts of technological improvements are all about. To make things
The whole ransomware movement for
Personal Computers will slowly but surely find its way into buildings
as well. And that will be very scary. Imagine if someone would hold
your entire HR department (no offense to HR) hostage, locking doors,
supplying too much air to the room, short circuit some stuff, and cause
an explosion. Or just suck all the air from the room, or something else
made possible having a “connected building.” They will only release the
hostages if headquarters wire $20M to some company on the other side of
Without the correct skill-set in securing the IT and OT infrastructure,
we will see this more and more.
more than scary, terrifying even! Is there anything AI/ML
can do to help offset these risks? Any real value to the HVAC-R part
Going back to the HVAC/R parts of the equation I think that “the
connected everything” has its pros and cons.
“Because Building Automation is simple,” right? David Peters, General Manager at Elliot Controls Inc, started a very interesting discussion on Linkedin the other day, that has got a lot of attention worldwide. He posted this image below arguing that;
“All we have to do is control three variables (flow, temperature, and pressure) in two types of media (fluid or air) using four pieces of equipment (valves, pumps, fans, and dampers). The logic is very easy to arrange. The sequences of operation may not take long to write.”
But it’s the variables
of all the dependencies and the physics around it which makes it
extremely easy to wreck any setup. And also extremely difficult to get
the full perspective.
Whereupon James Cheesewright, District Technical leader at Honeywell, made this interesting comment, highlighting on the importance of AI/ML from a BAS perspective.
“It also helps highlight why A.I. has such great potential in helping radically improve the way we commission and optimise the built environment.”
Wherever there’s complexity, there’s room for technology to help make it easier.
Getting things connected also means that
security must be a close first thing you think about; not a close
second. Addressing these challenges beforehand how things should be
connected is vital for everyone. But most of the time, there are
already existing infrastructures in the building, and it’s here you
might run into challenges, where AI/ML can help. There’s something
called “Predictive - self-healing” which basically is what it sounds.
If errors occur in the network, the network itself will try to fix
these issues, as well as send alarms to the people who need to be
notified. AI/ML algorithms constantly detect anomalies and networks can
adapt to changes instantly modifying its response depending on what is
happening. These robots or procedures can scan the network at all times
and detect if something is wrong. And of course, we also see the
emergence of hybrid clouds, private clouds, where servers are
controlled by companies themselves, instead of having data sent to the
other side of the world.
I haven’t seen that many companies are offering in-depth security
enterprise solutions for building automation and the OT-side of things
(Operational Technology) yet. But this is definitely where companies
like NanoHeal and Site1001 will have a
huge impact in addressing these
security concerns in a sophisticated way. I really want to find more
companies like them.
And as discussed earlier, the building automation
industry can only do
so much, and it is here other companies with AI/ML powered solutions
can come in and add value for system integrators, owners, as well as
improving security for tenants and end-users of the buildings.
There was an article coming out just now that machine learning predictions are making all the wrong plays and this could lead to a negative value in the end. Because one of the most dangerous things when it comes to ML and AI, is the possibility to corrupt data at the source. AI and ML can’t be super rigid. It’s like you say to someone that they should walk 1000 steps in the x-direction, and only after the 1000 steps, think about where they are going. If they are just 1cm off to start with, they’ll end up in a totally different place than you want, and definitely what they want. But if we have mechanisms for self-correction, improvement, or some kind of human control at set intervals, we build more robustness into models as well where we self adjust and validate after every 10 steps or 1 step for that matter. The amount of data can be bad, but equally great. It depends.
The dangers of getting everything connected could be mitigated through
rigorous security, but maybe that the most important form of data is
additional knowledge and extensive data sets. If you think that
something is wrong in a building, but you are not sure, you (might) be
much more comfortable seeing that all of your other 300 buildings have
the same problem/or that they don’t have this problem and that it might
be an anomaly. However, this leads back to the question if there’s an
underlying problem with the model, or if it’s with the data, which
might lead to different models and approaches being applied as well
because that is the value of Big data. That you have options, and
multiple sources of information to choose from to decide what might be
the best outcome.
Furthermore, regarding the tagging craze that is going on at the
moment, AI and ML can also help to identify products and technologies
by their unique DNA.
Now you lost
me again, Nicolas. I know about tagging in the sense of
the BACnet 223p standard, and that Project Haystack tagging, is doing
wonders for this industry in terms of increased interoperability and
faster time to value creation? Yes? So what do you actually mean?
I am not saying that tagging will be
useless, obsolete and unnecessary in the future. In fact, it is
absolutely vital today that a company has a clear understanding of the
relationships between standards and data to enable a solid platform to
stand on. It’s important to get started, and for companies to realize
that they are in control of the information, processes within their
organization. And also, that they should be in control of the data, but
allow others to make sense of the data and to create value from it.
But what I am saying is that there are
more ways than one to increase time to faster value creation. For
instance, let’s say we have a portfolio of 1000 assets of commercial
real estate. Hundreds of AHU’s VAV Boxes, meters talking different
standards, products from different vendors, and we want to connect all
of these in an interoperable way as soon as humanly (?) possible. Even
though we see a race to the IP level, raising digital maturity in
buildings can be extremely painful. But it’s getting a lot easier every
day thanks to technological advances, open standards, service
transparency and a more IT-driven approach to traditional BAS thinking.
Let’s start with two buildings and get
them 100% connected from an existing system- HVAC-R point of view.
We’ve got Modbus meters; we’ve got controllers from different brands,
we’ve got BACnet MS/TP, BACnet/Ethernet, we’ve got BACnet/IP, some LON,
it’s Siemens, Tridium, Schneider, Trend, Saia, etc. etc.
Let’s also put in some IoT sensors from different manufacturers and standards into the mix, and then we’ll say that we collect all of this in a data lake. No standardization in the building, no edge data strategy, basically no data strategy what so ever. Data lake = is a fancy term for a landfill of data. This is usually where the cleaning happens and without any meta tagging, of who’s it from, how the data is structured, possibly also where in the buildings they are, etc. etc., this goes from data lake to landfill, to toxic waste dump pretty fast. Because API’s might mean trouble if not done correctly.
But here is where AI/ML might come in handy and make things easier if
done correctly. I wouldn’t say a picnic, but it has the potential to
revolutionize the speed of getting value from buildings on a large
scale. This is a collaboration act if I ever saw one, and first, we get
capable hands onboard from a Super MSI like Hepta to do a
process on everything that exists and doesn’t exist in the building.
Once we have the information what is there, we can easily deploy
sensors that talk to each other, will be absorbed
by existing BMS
systems, and that can scale up and down without ANY manual
configuration. Boom, all the IoT gadgets will instantly become virtual
BACnet devices, and off to the cloud, we go.
So once the data is in the cloud, we do the arduous job together with
Data scientists, system integrators, asset managers, real estate
owners, as well as vendor specialists and tag the data manually, or
utilizing Haystack to the full extent as it is now, at the application
level. We know that this is a SWEGON Gold AHU at the roof, it talks
Modbus, it has these register setup, and the process goes on with
everything. This might take weeks, months, or even years, depending on
how urgent it is. But for argument's sake, let’s say we get it done in
one month to start with. We encapsulate both new and old, IoT and
existing HVAC, underneath an umbrella and we get one API to the whole
The sensor part is pure magic to how things are done today, but the real use case of AI/ML starts here as well. Because with these two buildings that we started with, we can after a while pinpoint a unique signature coming from devices, in combination with crawling the web for datasheets, scan PDFs of blueprints and designs, and reverse engineer information for future reference.
For the next 300 buildings, we’ll just get things connected through
BACnet and BACnet/WS, utilizing security within the new BACnet/SC
standard as well as the upcoming BACnet/IT standard, taking data in and
out in a secure way. AND the data will be filtered through algorithms
and Artificial intelligence measures to automatically populate the
BACnet network with correct tagging and structures. Will this be 100%
correct to start with? No. But companies will learn a lot in the
Will it save an enormous amount of time getting it 85% correct? Abso-BACnet-lutely. And with the third building, this will get easier… the fourth, the fifth, and so on.
In no time, your whole portfolio has the potential to be digitized and
digitalized, and the race to IP will be no more. Value creation can
begin for real where metadata tagging will play a pivotal role in
getting qualitative data to the cloud, and for interoperability to
happen much faster. But what I’m saying is there might be other ways as
well of creating value, in addition to that of tagging the data.
But, one should not forget. There’s the reverse Pareto rule to think
about, and that’s a challenge for the short-sighted companies to get if
they will ever get it.
was a lot of information to absorb, but according to you, it
sounds like BACnet/Mesh might be an absolute game changer for the
industry? Only time will tell. I understand that you have more to say
about this, but we need to wrap things up. What’s the Pareto rule and
what’s the problem? You can’t be that sly to finish with a cliffhanger!
love the pun that you made there, but
okay, I’ll try to wrap this up. The Pareto rule means that 20% of the
work you do represents 80% of the total value. It’s the same here, with
the difference that it is a total opposite.
Connecting a building to 80% will only get you the 20% value you are
looking for, and it’s the last 20% that is the most interesting. And
that’s why short-sighted companies won’t get it. Because they will
struggle to get to even 50% connected and then they will only see a
fraction of the value.
The question you first need to ask is
“Let’s investigate how ready we are for AI and ML.” And if you can’t
answer it, ask someone that can perform an investigation for you.
Companies don’t need to know anything about technology. Zero.
But they need to know where they are
today, and where they want to be tomorrow. Start small. Start focused.
But do start. Investigate. Because even if you have bountiful data, it
might not be qualitative data; which means that you might be looking at
a cleaning period of XYZ.
And that’s where we come in, where we collect data from different sources, standardize them underneath the BACnet umbrella creating an interface where others can empty the building for information.
The ones that have seen our approach to BACnet/Mesh are saying it is
revolutionary in that aspect because there’s no manual configuration.
Everything legacy and new will appear as BACnet devices instantly,
ready to be absorbed by AI/ML algorithms and models in an instant. And
that is a game changer when it comes to speeding up the time to value
creation in creating smarter buildings!
whisperer – Making buildings talk to people…!” You sure
live up to your name! Thanks a lot for the interview. I am sure our
readers will like this and the ones that read to the end, how can they
reach you? Any final words? (be brief!)
Waern: Thank you! Well, I just reached a milestone of 10 000 connections on my Linkedin Profile so please reach out that way if you can. Or just send me an email at Nicolas@Go-IoT.io. I’d love to connect, and I do have a love for this industry and the people who want to know more about what we do.
Let’s finish this with five bullets.
That said, even if the true value comes
at 100% you’ll learn so much more by doing, than just saying or
thinking about it. To the ones questioning IoT and AI/ML saying or
anything new, stating,
“But how do you know it will be better?”
I just say, “How do you know it will be
/ ”The Building Whisperer”
[Click Banner To Learn More]
[Home Page] [The Automator] [About] [Subscribe ] [Contact Us]