LLMxHPC: 2024 International Workshop on Large Language Models (LLMs) and HPC

September 24, 2024 in Kobe, Japan

Co-hosted with the 2024 IEEE Cluster Conference

https://llmhpc.github.io/2024/

Submission deadline: June 19, 2024

=============================================

## WORKSHOP SCOPE

High-Performance Computing (HPC) systems have become critical for meeting the computational and data-intensive needs of training Large Language Models (LLMs). Simultaneously, in the domain of HPC research, LLMs are emerging as transformative tools to understand and improve HPC system productivity and efficiency. There are clear synergies between these areas and meaningful coordination of efforts holds great promise. This workshop brings together researchers and developers to explore the intersection of HPC and LLMs, offering a comprehensive look at how these two domains can mutually benefit and drive each other's advancement. The workshop has two key focus areas: (i) co-design and deployment of HPC systems to support LLM training and (ii) using LLMs to understand and optimize/tune HPC systems. A combination of paper presentations, panel discussion, and keynote will be included in the program to highlight salient research and development activities, promote diverse perspectives and visions, and stimulate discussion in the community.

## TOPICS

Topics to be covered in this workshop include, but are not limited to,

• The computational and data needs of LLM training
• Exploring architectural advancements that support LLM training
  • GPU-accelerated computing 
  • High-bandwidth memory systems 
  • Advanced networking capabilities
• LLM-HPC co-design efforts
• Utilizing LLMs to improve HPC deployment and operations
  • Analyzing extensive system logs for performance
  • Energy efficiency
  • Reliability
• Fine-tuning complex HPC hardware and software stacks;
• HPC design space exploration using LLMs

## SUBMISSION GUIDELINES 

We welcome novel research contributions in the topic areas discussed in the scope above. Papers should be submitted using the IEEE conference template in one of the following formats:

• Full (or invited) paper (8 pages + 2 additional pages)
• Short (or invited) paper (4 pages + 1 additional page

**Submission page

https://easychair.org/conferences/?conf=llmxhpc2024

**Important Dates

Submission Deadline: June 19, 2024

Author Notification: July 19, 2024

CLUSTER Author Registration: August 02, 2024

Camera Ready Deadline: August 09, 2024

PLEASE CHECK THE WORKSHOP'S WEBSITE FOR ADDITIONAL SUBMISSION DETAILS: 

https://llmhpc.github.io/2024/

## ORGANIZERS

• Kevin A. Brown (Argonne National Laboratory)
• Tanwi Mallick (Argonne National Laboratory)
• Juliane Mueller (National Renewable Energy Laboratory)
• Aleksandr Drozd (RIKEN Center for Computational Science)

Organizers email: llmhpc-workshop@anl.gov