skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: An Expansion of the User Support Services for the Research Computing Group at the University of Colorado Boulder
In any research computing (RC) environment, the role of the user support group is a combination of education, consulting, and outreach. As this role is the most public-facing of a research computing group's team, it is important to ensure an excellent level of support is provided to users. The Research Computing group at the University of Colorado (CURC) Boulder maintains a large-scale computing cluster with several hundred active users, among other services, and has done so since 2011. The user support group at CURC provides a variety of services intended to support these users. This paper describes those services the CURC group provides, as well as explores the various ways that these services have been improved in 2018-19. The impact on users is also assessed.  more » « less
Award ID(s):
1659425
PAR ID:
10141805
Author(s) / Creator(s):
; ; ; ; ; ; ; ;
Date Published:
Journal Name:
PEARC '19: Proceedings of the Practice and Experience in Advanced Research Computing on Rise of the Machines (learning)
Page Range / eLocation ID:
1 to 8
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. De_Vita, R; Espinal, X; Laycock, P; Shadura, O (Ed.)
    The large data volumes expected from the High Luminosity LHC (HL-LHC) present challenges to existing paradigms and facilities for end-user data analysis. Modern cyberinfrastructure tools provide a diverse set of services that can be composed into a system that provides physicists with powerful tools that give them straightforward access to large computing resources, with low barriers to entry. The Coffea-Casa analysis facility (AF) provides an environment for end users enabling the execution of increasingly complex analyses such as those demonstrated by the Analysis Grand Challenge (AGC) and capturing the features that physicists will need for the HL-LHC. We describe the development progress of the Coffea-Casa facility featuring its modularity while demonstrating the ability to port and customize the facility software stack to other locations. The facility also facilitates the support of batch systems while staying Kubernetes-native. We present the evolved architecture of the facility, such as the integration of advanced data delivery services (e.g. ServiceX) and making data caching services (e.g. XCache) available to end users of the facility. We also highlight the composability of modern cyberinfrastructure tools. To enable machine learning pipelines at coffee-casa analysis facilities, a set of industry ML solutions adopted for HEP columnar analysis were integrated on top of existing facility services. These services also feature transparent access for user workflows to GPUs available at a facility via inference servers while using Kubernetes as enabling technology. 
    more » « less
  2. Globerson, A; Mackey, L; Belgrave, D; Fan, A; Paquet, U; Tomczak, J; Zhang, C (Ed.)
    This paper investigates ML systems serving a group of users, with multiple models/services, each aimed at specializing to a sub-group of users. We consider settings where upon deploying a set of services, users choose the one minimizing their personal losses and the learner iteratively learns by interacting with diverse users. Prior research shows that the outcomes of learning dynamics, which comprise both the services' adjustments and users' service selections, hinge significantly on the initial conditions. However, finding good initial conditions faces two main challenges:(i)\emph {Bandit feedback:} Typically, data on user preferences are not available before deploying services and observing user behavior;(ii)\emph {Suboptimal local solutions:} The total loss landscape (ie, the sum of loss functions across all users and services) is not convex and gradient-based algorithms can get stuck in poor local minima. We address these challenges with a randomized algorithm to adaptively select a minimal set of users for data collection in order to initialize a set of services. Under mild assumptions on the loss functions, we prove that our initialization leads to a total loss within a factor of the\textit {globally optimal total loss, with complete user preference data}, and this factor scales logarithmically in the number of services. This result is a generalization of the well-known k-means++ guarantee to a broad problem class which is also of independent interest. The theory is complemented by experiments on real as well as semi-synthetic datasets. 
    more » « less
  3. PEARC'25 (Ed.)
    The Rosen Center for Advanced Computing at Purdue University has recently released two Generative AI inference tools, AnvilGPT and Purdue GenAI Studio, to the research and campus communities. These services support over 1000 users who use 10+ open-source GenAI models to aid their work. Building on HPC’s long history of using open-source tools, these services are based on customized open-source frameworks and hosted entirely on-prem. This pa- per argues that building custom GenAI services from open-source frameworks is a scalable and cost-effective solution for providing access to Generative AI models. This paper shares the methodology and resources required to develop and host these services and seeks to be a resource for other research computing centers that wish to leverage their HPC investment to create similar services. 
    more » « less
  4. Edge Computing is a new computing paradigm where applications operate at the network edge, providing low-latency services with augmented user and data privacy. A desirable goal for edge computing is pervasiveness, that is, enabling any capable and authorized entity at the edge to provide desired edge services--pervasive edge computing (PEC). However, efficient access control of users receiving services and edge servers handling user data, without sacrificing performance is a challenge. Current solutions, based on "always-on" authentication servers in the cloud, negate the latency benefits of services at the edge and also do not preserve user and data privacy. In this paper, we present APECS, an advanced access control framework for PEC, which allows legitimate users to utilize any available edge services without need for communication beyond the network edge. The APECS framework leverages multi-authority attribute-based encryption to create a federated authority, which delegates the authentication and authorization tasks to semi-trusted edge servers, thus eliminating the need for an "always-on" authentication server in the cloud. Additionally, APECS prevents access to encrypted content by unauthorized edge servers. We analyze and prove the security of APECS in the Universal Composability framework and provide experimental results on the GENI testbed to demonstrate the scalability and effectiveness of APECS. 
    more » « less
  5. Autonomous vehicles (AVs) aim to improve safety and comfort of road users while contributing to the reduction of traffic congestion, air pollution, fuel consumption, and enabling mobility and accessibility of disabled and older people. As AV technology is rapidly advancing, there is an urgent need to explore how those new mobility services will impact urban transport systems, including the users, the infrastructure, and the design of future urban areas. This paper applies a systematic review to assess the role of AVs in urban areas. It reviews 41 articles published between 2003 and 2023, and uses inductive and deductive coding approaches to identify seven themes and thirty sub-themes within the literature. The seven include: benefits, attitudes, and behaviours and user perception, climate adaptation, climate mitigation, legislation and regulations, sustainability, and infrastructure. Studies related to benefits accounted for 25% of the sample, followed by behaviours and user perception (24%) and sustainability (22%). The least amount of research has been undertaken on the role of AVs to support climate adaptation. Geographically, almost half (#22) of the papers originate within Europe, followed by America (#10) and Asia (#7). There is only limited research originating from the Global South. This systematic review sets the scene for considering how AVs in public transport can be implemented in urban areas by establishing the current state of knowledge on user attitudes, perceptions, and behaviour, the benefits of AVs, the infrastructure and legislation and regulations required for AVs, and the role AVs have in climate mitigation, adaptation, and sustainability. 
    more » « less