home automation server that doesn’t connect to the internet?

Well if uses wireless connectivity with either range broader than your place or is connected to a device that is itself online it can still be a risk. Sure it’s very VERY specific but scanning techniques also improve.