MICRO 2023 Real-World PIM Tutorial

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
~~NOCACHE~~

===== Real-world Processing-in-Memory Systems for Modern Workloads =====

==== Tutorial Description ====
Processing-in-Memory (PIM) is a computing paradigm that aims at overcoming the data movement bottleneck (i.e., the waste of execution cycles and energy resulting from the back-and-forth data movement between memory units and compute units) by making memory compute-capable. 

Explored over several decades since the 1960s, PIM systems are becoming a reality with the advent of the first commercial products and prototypes. 

A number of startups (e.g., UPMEM, Neuroblade) are already commercializing real PIM hardware, each with its own design approach and target applications. Several major vendors (e.g., Samsung, SK Hynix, Alibaba) have presented real PIM chip prototypes in the last two years. Most of these architectures have in common that they place compute units near the memory arrays. This type of PIM is called processing near memory (PNM). 

{{:micro-pim-tutorial.jpg?400 |}}

PIM can provide large improvements in both performance and energy consumption for many modern applications, thereby enabling a commercially viable way of dealing with huge amounts of data that is bottlenecking our computing systems. Yet, it is critical to (1) study and understand the characteristics that make a workload suitable for a PIM architecture, (2) propose optimization strategies for PIM kernels, and (3) develop programming frameworks and tools that can lower the learning curve and ease the adoption of PIM. 

This tutorial focuses on the latest advances in PIM technology, workload characterization for PIM, and programming and optimizing PIM kernels. We will (1) provide an introduction to PIM and taxonomy of PIM systems, (2) give an overview and a rigorous analysis of existing real-world PIM hardware, (3) conduct hand-on labs about important workloads (machine learning, sparse linear algebra, bioinformatics, etc.) using real PIM systems, and (4) shed light on how to improve future PIM systems for such workloads. 

==== Livestream ====
[[https://ethz.zoom.us/j/68459763236?pwd=NEIzK1JGV0pHTjRaUzV5NmRna3JkZz09|Zoom livestream]]

[[https://youtube.com/live/ohU00NSIxOI?feature=share|YouTube livestream]]
{{youtube>ohU00NSIxOI?large}}


==== Organizers ====
^ Name ^ E-mail ^
|[[https://ee.ethz.ch/the-department/people-a-z/person-detail.MjQxMjgy.TGlzdC8zMjc5LC0xNjUwNTg5ODIw.html|Juan Gómez Luna]]| <juan.gomez@safari.ethz.ch> | 
|[[https://people.inf.ethz.ch/omutlu/index.html|Onur Mutlu]]| <onur.mutlu@safari.ethz.ch> | 
|[[https://ee.ethz.ch/the-department/people-a-z/person-detail.MjUzNDIw.TGlzdC8zMjc5LC0xNjUwNTg5ODIw.html|Ataberk Olgun]] | <ataberk.olgun@safari.ethz.ch> |
|[[https://ee.ethz.ch/the-department/people-a-z/person-detail.MjQzODA4.TGlzdC8zMjc5LC0xNjUwNTg5ODIw.html|Geraldo F. Oliveira]] | <geraldod@safari.ethz.ch> |

===== Agenda (October 29, 2023) =====
==== Lectures (tentative schedule, time zone: EDT GMT-4) ====
  * 7:55am-8:00am, Dr Juan Gómez Luna, “Welcome & Agenda.”
  * 8:00am-9:20am, Prof. Onur Mutlu / Geraldo F. Oliveira, "Memory-centric Computing: Introduction to PIM as a Paradigm to Overcome the Data Movement Bottleneck."
    * PIM taxonomy: PNM (processing near memory) and PUM (processing using memory).
    * DAMOV Workload Characterization Methodology.
  * 9:20am-10:20am, Dr. Juan Gómez Luna, “Processing-Near-Memory: Real PNM.”
    * PNM prototypes: Samsung HBM-PIM, SK Hynix AiM, Samsung AxDIMM, Alibaba HB-PNM. 
    * UPMEM PIM: Architecture Characterization, Programming.

  * Coffee break (10:20am-10:40am)

  * 10:40am-11:20am, Prof. Youngsok Kim (Yonsei University), "PID-Join: A Fast In-Memory Join Algorithm for Commodity PIM-Enabled DIMMs."
  * 11:20am-12:00pm, Dr. Abu Sebastian (IBM Research - Zürich), "PUM Based on Memristive Devices: The IBM HERMES Project Chip."

  * Lunch break (12:00pm-1:00pm)

  * 1:00pm-2:00pm, Geraldo F. Oliveira, "Processing-Using-DRAM: Ambit, SIMDRAM, pLUTo."
  * 2:00pm-3:15pm, Dr. Juan Gómez Luna, “Accelerating Modern Workloads on a General-purpose PIM System: Machine leaning, Genomics...”
  * 3:15pm-3:45pm, Dr. Juan Gómez Luna, “Adoption Issues: How to Enable PIM?”
  * 3:45pm-4:15pm, Dr. Juan Gómez Luna, "SimplePIM: A Software Framework for High-level PIM Programming."
  * 4:15pm-5:00pm, Ataberk Olgun, "Processing-Using-Memory Prototypes: PiDRAM."
  * 5:00pm-5:10pm, Dr. Juan Gómez Luna, “Introduction/Preparation for Hands-on Labs.”
    * Optional - Hands-on Lab: Programming and Understanding a Real PIM Architecture.

==== Tutorial Materials ====

^ Time ^ Speaker ^ Title ^ Materials ^
| 7:55am-8:00am  | Dr. Juan Gómez Luna | Welcome & Agenda |{{realpimtutorial-micro23-agenda-juan-slides.pdf|(PDF)}} {{realpimtutorial-micro23-agenda-juan-slides.pptx|(PPT)}}|
| 8:00am-9:20am  | Prof. Onur Mutlu / Geraldo F. Oliveira | Memory-Centric Computing |{{geraldo-_micropimtutorial-2023-memory-centric-computing-beforetalk.pdf|(PDF)}} {{geraldo-_micropimtutorial-2023-memory-centric-computing-beforetalk.pptx|(PPT)}}|
| 9:20am-10:20am  | Dr. Juan Gómez Luna | Processing-Near-Memory: Real PNM Architectures / Programming General-purpose PIM |{{realpimtutorial-micro23-processingnearmemory-juan-slides.pdf|(PDF)}} {{realpimtutorial-micro23-processingnearmemory-juan-slides.pptx|(PPT)}}|
| 10:40am-11:20am  | Prof. Youngsok Kim | PID-Join: A Fast In-Memory Join Algorithm for Commodity PIM-Enabled DIMMs |{{Real-World PIM Tutorial - MICRO 2023.pdf|(PDF)}} \\ [[https://dl.acm.org/doi/10.1145/3589258|SIGMOD'2023]]||
| 11:20am-12:00pm  | Dr. Abu Sebastian | PUM Based on Memristive Devices: The IBM HERMES Project Chip |{{.pdf|(PDF)}} {{.pptx|(PPT)}} \\ [[https://www.youtube.com/watch?v=wNmqQHiEZNk&t=1s|Lecture (ETH Zürich, Fall 2020]] \\ [[https://github.com/IBM/aihwkit|IBM Analog Hardware Acceleration Kit]] \\ [[https://www.nature.com/articles/s41565-020-0655-z|Nature Nanotechnology (2020)]] \\ [[https://www.nature.com/articles/s41928-023-01010-1|Nature Electronics (2023)]] \\ [[https://ieeexplore.ieee.org/abstract/document/9957094|IEEE VLSI (2023)]] \\ [[https://www.nature.com/articles/s41467-023-40770-4|Nature Communications (2023)]]|
| 1:00pm-2:00pm  | Geraldo F. Oliveira | Processing-Using-DRAM: Ambit, SIMDRAM, pLUTo |{{geraldo-_micropimtutorial-2023-processing-using-memory-beforetalk.pdf|(PDF)}} {{geraldo-_micropimtutorial-2023-processing-using-memory-beforetalk.pptx|(PPT)}}|
| 2:00pm-3:15pm  | Dr. Juan Gómez Luna | Accelerating Modern Workloads on a General-purpose PIM System: Machine leaning, Genomics... |{{realpimtutorial-micro23-modernworkloads-juan-slides.pdf|(PDF)}} {{realpimtutorial-micro23-modernworkloads-juan-slides.pptx|(PPT)}}|
| 3:15pm-3:45pm  | Dr. Juan Gómez Luna | Adoption Issues: How to Enable PIM? |{{realpimtutorial-micro23-enablingpim-juan-slides.pdf|(PDF)}} {{realpimtutorial-micro23-enablingpim-juan-slides.pptx|(PPT)}}|
| 3:45pm-4:15pm  | Dr. Juan Gómez Luna | SimplePIM: A Software Framework for High-level PIM Programming |{{realpimtutorial-micro23-simplepim-juan-slides.pdf|(PDF)}} {{realpimtutorial-micro23-simplepim-juan-slides.pptx|(PPT)}}|
| 4:15pm-5:00pm  | Ataberk Olgun | Processing-Using-Memory Prototypes: PiDRAM |{{realpimtutorial-micro23-pidram_drambender-ataberk-slides.pdf|(PDF)}} {{realpimtutorial-micro23-pidram_drambender-ataberk-slides.pptx|(PPT)}}|
| 5:00pm-5:10pm  | Dr. Juan Gómez Luna | Hands-on Lab: Programming and Understanding a Real Processing-in-Memory Architecture |{{lab_micro2023.pdf|(Handout)}} \\ {{realpimtutorial-micro23-lab-juan-slides.pdf|(PDF)}} {{realpimtutorial-micro23-lab-juan-slides.pptx|(PPT)}}| 

==== Learning Materials ====

=== Recommended Materials ===
  * Gómez-Luna, J., and Mutlu, O., Data-Centric Architectures: Fundamentally Improving Performance and Energy (227-0085-37L), ETH Zürich, Fall 2022.
    * [[https://safari.ethz.ch/projects_and_seminars/fall2022/doku.php?id=processing_in_memory | Course Website]]
    * [[https://youtube.com/playlist?list=PL5Q2soXY2Zi8KzG2CQYRNQOVD0GOBrnKy | Lecture Playlist]]
  * Mutlu, O., Ghose, S., Gómez-Luna, J., and Ausavarungnirun, R. A Modern Primer on Processing in Memory. In Emerging Computing: From Devices to Systems, 2023.
    * [[https://arxiv.org/pdf/2012.03112.pdf | PDF (arXiv)]]
  * Gómez-Luna, J., El Hajj, I., Fernandez, I., Giannoula, C., Oliveira, G. F., and Mutlu, O. Benchmarking a New Paradigm: Experimental Analysis and Characterization of a Real Processing-in-Memory System. IEEE Access, 2022.
    * [[https://arxiv.org/pdf/2105.03814.pdf | PDF (arXiv)]] 
    * [[https://github.com/CMU-SAFARI/prim-benchmarks | Repository (GitHub)]] 
  * Giannoula, C., Fernandez, I., Gómez-Luna, J., Koziris, N., Goumas, G., and Mutlu, O. SparseP: Towards Efficient Sparse Matrix Vector Multiplication on Real Processing-In-Memory Architectures. SIGMETRICS 2022.
    * [[https://arxiv.org/pdf/2201.05072.pdf | PDF (arXiv)]] 
    * [[https://github.com/CMU-SAFARI/SparseP | Repository (GitHub)]] 
  * Olgun, A., Gómez-Luna, J., Kanellopoulos, K., Salami, B., Hassan, H., Ergin, O., and Mutlu, O. PiDRAM: A Holistic End-to-end FPGA-based Framework for Processing-in-DRAM. ACM TACO, 2022.
    * [[https://arxiv.org/pdf/2111.00082.pdf | PDF (arXiv)]] 
    * [[https://github.com/cmu-safari/pidram  | Repository (GitHub)]] 

=== More Learning Materials ===
  * Mutlu O., Memory-Centric Computing (IMACAW Keynote Talk at DAC 2023), July 2023:
    * [[https://people.inf.ethz.ch/omutlu/pub/onur-IMACAW-Keynote-MemoryCentricComputing-9-July-2023.pdf | PDF]] [[https://people.inf.ethz.ch/omutlu/pub/onur-IMACAW-Keynote-MemoryCentricComputing-9-July-2023.pdf | PPT]] [[https://www.youtube.com/watch?v=npr5zMEkANQ | Video]]
  * Processing-in-memory: A workload-driven perspective (summary paper about recent research in PIM):
    * [[https://people.inf.ethz.ch/omutlu/pub/processing-in-memory_workload-driven-perspective_IBMjrd19.pdf | PDF]]
  * Processing Data Where It Makes Sense: Enabling In-Memory Computation (summary paper about recent research in PIM):
    * [[https://people.inf.ethz.ch/omutlu/pub/ProcessingDataWhereItMakesSense_micpro19-invited.pdf | PDF]]
  * Processing-in-Memory course (Spring 2022):
    * [[https://safari.ethz.ch/projects_and_seminars/spring2022/doku.php?id=processing_in_memory | Course website]]
  * [[https://sdk.upmem.com/2023.1.0/ | UPMEM SDK documentation: The first real-world PIM architecture]]