An official website of the United States government
Homes are becoming more intelligent due to the growth of smart sensors and devices found in typical homes. However, most of these sensors and devices function independently from one another, limiting the amount of utility and services a truly "smart" home can provide. In this demonstration, we introduce two key ideas towards more intelligent homes. First, we explore the usage of mobile drones in the home environment. Second, we propose DIA, a system that seamlessly connects to the home environment and automatically discovers and jointly utilizes smart sensors and actuators around the home to provide services that are otherwise not possible. We demonstrate three services that DIA enables.
more »
« less
A modular and reconfigurable sensing and actuation platform for smarter environments and drones: demo abstract
There has been an immense growth in sensors, actuators, and smart devices in recent years, which enable us to better sense, actuate, and understand the physical world. Despite this growth, we have yet to achieve fully intelligent environments. This is, in part, due to the large number of different organizations creating smart devices with proprietary technologies and communication protocols that are not compatible with each other and require significant engineering to incorporate and adapt to specific applications. In this work, we present an easy-to-install and low-cost embedded platform that allows users to rapidly configure a mixture of sensors and actuators. The system is based on the commonly-used Raspberry Pi ecosystem, easily configurable, and does not require users to have prior knowledge of programming, which allows anyone, regardless of background, to use. We also introduce a battery-powered wireless extension module that is suitable for mobile drone applications, where a chord-powered Raspberry Pi is not suitable. We demonstrate the impact our system has on enabling drones with flexible sensing modalities and creating smarter environments by integrating our platform into a variety of intelligent home applications.
more »
« less
- PAR ID:
- 10416031
- Date Published:
- Journal Name:
- MobiSys '22: Proceedings of the 20th Annual International Conference on Mobile Systems, Applications and Services
- Page Range / eLocation ID:
- 626 to 627
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Internet of Things, Smart Home, and Smart Cities have become hot topics in recent years. The development of these areas grows spirally due to the emergence of advanced smart devices. Smart mirrors are a new addition to the smart home family that has been getting a lot of attention nowadays by both commercial manufacturers and academia. This paper describes how a Raspberry Pi device can be used to enhance such mirrors with intelligence and security. The goal is to develop a cost effective intelligent mirror system that not only works as a regular mirror, but also be able to display various kinds of information, such as weather, time and location, current events, and users. The mirror can provide multimedia services while ensuring high end security across the entire system.more » « less
-
Large Language Models (LLMs) offer significant potential for enhancing smart home assistants through more natural and responsive automation. However, solely relying on cloud-based LLMs raises concerns about network dependency and user privacy. In this paper, we conduct a comprehensive evaluation to assess the feasibility of deploying LLMs on low-cost devices, enabling smart home automation in terms of latency and energy consumption. In particular, we first build a comprehensive and reproducible testbed that integrates benchmark and well-trained LLMs with the Home Assistant platform on low-cost edge devices, such as Raspberry Pi 4 and Pi 5. Leveraging this testbed, we evaluate on-device LLM inference performance in terms of inference latency, energy consumption, and thermal characteristics, and provide theoretical estimates of remaining runtime in battery-powered settings. We evaluate the on-device performance on two benchmark quantized models (e.g., Home-1B-v3 and Home-3B-v3) for smart homes. Experimental results show that the Raspberry Pi 5 significantly outperforms the Raspberry Pi 4 in terms of low latency and high energy efficiency across both models, due to its superior processing capabilities. In particular, for the Home-1B-v3 model, the mean inference energy decreases from 264.3 J to 133.9 J, representing a 49.3% reduction in consumption, and the mean latency decreases from 40.3 s to 18.7 s, resulting in a 53.4% improvement in delay in Pi 5 compared to Pi 4. The findings of the paper provide valuable empirical insights for energy and latency-aware smart home automation using quantized LLMs on low-cost edge hardware. This work lays the groundwork for future research on the energy efficiency of LLM applications.more » « less
-
The growth of smart devices is making typical homes more intelligent. In this work, in collaboration with therapists, we introduce a home-based AI therapist that takes advantage of the smart home environment to screen the day-to-day functioning and infer mental wellness of an occupant. Unlike existing “chatbot” works that identify the mental status of users through conversation, our AI therapist additionally leverages smart devices and sensors throughout the home to infer mental well-being and assesses a user's daily functioning. We propose a series of 37 dimensions of daily functioning, that our system observes through conversing with the user and detecting daily activity events using sensors and smart sensors throughout the home. Our system utilizes these 37 dimensions in conjunction with novel natural language processing architectures to detect abnormalities in mental status (e.g., angry or depressed), well-being, and daily functioning and generate responses to console users when abnormalities are detected. Through a series of user studies, we demonstrate that our system can converse with a user naturally, accurately detect abnormalities in well-being, and provide appropriate responses consoling users.more » « less
-
Abstract The dissemination of sensors is key to realizing a sustainable, ‘intelligent’ world, where everyday objects and environments are equipped with sensing capabilities to advance the sustainability and quality of our lives—e.g. via smart homes, smart cities, smart healthcare, smart logistics, Industry 4.0, and precision agriculture. The realization of the full potential of these applications critically depends on the availability of easy-to-make, low-cost sensor technologies. Sensors based on printable electronic materials offer the ideal platform: they can be fabricated through simple methods (e.g. printing and coating) and are compatible with high-throughput roll-to-roll processing. Moreover, printable electronic materials often allow the fabrication of sensors on flexible/stretchable/biodegradable substrates, thereby enabling the deployment of sensors in unconventional settings. Fulfilling the promise of printable electronic materials for sensing will require materials and device innovations to enhance their ability to transduce external stimuli—light, ionizing radiation, pressure, strain, force, temperature, gas, vapours, humidity, and other chemical and biological analytes. This Roadmap brings together the viewpoints of experts in various printable sensing materials—and devices thereof—to provide insights into the status and outlook of the field. Alongside recent materials and device innovations, the roadmap discusses the key outstanding challenges pertaining to each printable sensing technology. Finally, the Roadmap points to promising directions to overcome these challenges and thus enable ubiquitous sensing for a sustainable, ‘intelligent’ world.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript
- Conference Paper:
- https://doi.org/10.1145/3498361.3538667
