Search for: All records

After a large language model (LLM) is deployed on edge devices, it is desirable for these devices to learn from user-generated conversation data to generate user-specific and personalized responses in real-time. However, user-generated data usually contains sensitive and private information, and uploading such data to the cloud for annotation is not preferred if not prohibited. While it is possible to obtain annotation locally by directly asking users to provide preferred responses, such annotations have to be sparse to not affect user experience. In addition, the storage of edge devices is usually too limited to enable large-scale fine-tuning with full user-generated data. It remains an open question how to enable on-device LLM personalization, considering sparse annotation and limited on-device storage. In this paper, we propose a novel framework to select and store the most representative data online in a self-supervised way. Such data has a small memory footprint and allows infrequent requests of user annotations for further fine-tuning. To enhance fine-tuning quality, multiple semantically similar pairs of question texts and expected responses are generated using the LLM. Our experiments show that the proposed framework achieves the best user-specific content-generating capability (accuracy) and fine-tuning speed (performance) compared with vanilla baselines. To the best of our knowledge, this is the very first on-device LLM personalization framework. 

Plant growth generally responds positively to an increase in ambient temperature. Hence, most Earth system models project a continuous increase in vegetation cover in the future due to elevated temperatures. Over the last 40 years, a considerable warming trend has affected the alpine ecosystem across the Tibetan Plateau. However, we found vegetation growth in the moderately vegetated areas of the plateau were negatively related to the warming temperatures, thus resulting in a significant degradation of the vegetative cover (LAI: slope  = −0.0026 per year, p  < 0.05). The underlying mechanisms that caused the decoupling of the relationship between vegetation growth and warming in the region were elaborated with the analysis of water and energy variables in the ecosystem. Results indicate that high temperatures stimulated evapotranspiration and increased the water consumption of the ecosystem (with an influence coefficient of 0.34) in these degrading areas, significantly reducing water availability (with an influence coefficient of −0.68) and limiting vegetation growth. Moreover, the negative warming effect on vegetation was only observed in the moderately vegetated areas, as evapotranspiration there predominantly occupied a larger proportion of available water (compared to the wet and highly vegetated areas) and resulted in a greater increase in total water consumption in a warmer condition (compared to dry areas with lower levels of vegetation cover). These findings highlight the risk of vegetation degradation in semi-arid areas, with the degree of vulnerability depending on the level of vegetation cover. Furthermore, results demonstrate the central role of evapotranspiration in regulating water stress intensity on vegetation under elevated temperatures. 

Abstract Capitalizing on the photoacoustic effect, we developed a new fingerprint sensing system that can reveal both fingerprints and underlying vascular structures at a high spatial resolution. Our system is built on a 15 MHz linear transducer array, a research ultrasound system, and a 532-nm pulsed laser. A 3D image was obtained by scanning the linear array over the fingertip. The acquired fingerprint images strongly agreed with the images acquired from ultrasound. Additional experiments were also conducted to investigate the effect of acoustic coupling. We discovered that high-quality fingerprint and vessel images can be acquired from both wet and dry fingers using our photoacoustic system. The reduced subdermal features in dry coupling can be enhanced through post-processing. Compared to existing fingerprint scanners, the photoacoustic approach provides a higher quality 3D image of the fingerprint, as well as unique subdermal vasculature structures, making the system almost impossible to counterfeit.