Towards Real-Time LLM Inference on Heterogeneous Edge Platforms

Jayanth, Rakshith; Gupta, Neelesh; Kundu, Souvik; Mathaikutty, Deepak A; Prasanna, Viktor

doi:10.1109/HiPCW63042.2024.00076

skip to main content

An official website of the United States government Here's how you know

Official websites use .gov

A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS

A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Attention:

The NSF Public Access Repository (PAR) system and access will be unavailable from 5:00 PM ET until 8:00 PM ET on Friday, September 11 due to maintenance. We apologize for the inconvenience.

Citation Details

Towards Real-Time LLM Inference on Heterogeneous Edge Platforms

Award ID(s):: 2009057

PAR ID:: 10609883

Author(s) / Creator(s):: Jayanth, Rakshith; Gupta, Neelesh; Kundu, Souvik; Mathaikutty, Deepak A; Prasanna, Viktor

Publisher / Repository:: IEEE

Date Published:: 2024-12-18

ISBN:: 979-8-3315-0911-8

Page Range / eLocation ID:: 197 to 198

Format(s):: Medium: X

Location:: Bangalore, India

Sponsoring Org:: National Science Foundation

Free Publicly Accessible Full Text
Accepted Manuscript
Conference Paper:
https://doi.org/10.1109/HiPCW63042.2024.00076

More Like this