StorageのMap of Contentsページ。 ## General - [[BPF for storage]] - [[io_uring]] - [[SStable]] - [[CXL]] - [[カラム指向ストレージとカラムファミリー]] - [[データベースがディスクにデータを書き込む流れ]] ## Parallel / Distributed File Systems ### Lustre - [[Lustre]] - [[Lustre Meta-data Service]] - [[NECのAI研究用スーパーコンピュータとDDN Lustreストレージシステム]] - [[Lustre Monitoring and Statistics Guide - Lustre Wiki]] ### Papers - [[2019__arXiv__The Lustre Storage Architecture]] (Lustre Book) - [[2025__TOS__Lustre Unveiled Evolution Design Advancements and Current Trends]] - [[2026__ACCESS__Convergence of HPC and Cloud Storage Systems for Deep Learning Workflows An Evaluation of LustreFS and S3 - Compatible Object Storage]] - [[2024__FAST__Combining Buffered IO and Direct IO in Distributed File Systems]] - [[2019__SC__LPCC - Hierarchical Persistent Client Caching for Lustre]] (SSD-based persistent client caching for Lustre) - [[2021__TOS__NVMM-Oriented Hierarchical Persistent Client Caching for Lustre]] (NVMM-LPCC, extension of LPCC) ## Object Storage - [[CNCF Storage Whitepaper]] - [[GCP Cloud Storage Class]] - [[GCP Cloud Storage Free Tier]] ### Papers - [[2024__APSys__Toward an Edge-Friendly Distributed Object Store for Serverless Functions]] - [[2023__SOSP__Project Silica - Towards Sustainable Cloud Archival Storage in Glass]] ## Local / Block Storage ### Papers - [[2012__FAST__SFS - random write considered harmful in solid state drives]] - [[2024__TOS__An End-to-End High-Performance Deduplication Scheme for Docker Registries and Docker Container Storage Systems]] - [[2024__VLDB__BonsaiKV - Towards Fast, Scalable, and Persistent Key-Value Stores with Tiered, Heterogeneous Memory System]] ## I/O Stack & Virtualization ### Papers - [[2024__SC__EXO - Accelerating Storage Paravirtualization with eBPF]] - [[2021__HotOS__BPF for storage - an exokernel-inspired approach]] - [[2025__MODA__A Unified IO Monitoring Framework Using eBPF]] - [[2023__TPDS__Optimizing IO Performance through Effective vCPU Scheduling Interference Management]] - [[2024__SBAC-PADW__The Tracer Files - Cracking the Case of Performance Impact in Tracing Linux File I-O for I-O-Intensive Applications]] ## AI/ML Training Storage - [[PFIO のプロファイル機能実装 - Preferred Networks Research & Development]] - [[操作ログ方式に基づくOptunaストレージ実装とNFS経由の分散最適化 - Preferred Networks Research & Development]] ### Papers - [[2025__ACM-IEEE__EMLIO - Minimizing I-O Latency and Energy Consumption for Large-Scale AI Training]] - [[2024__arXiv__Parallel IO Characterization and Optimization on Large-Scale HPC Systems - A 360-Degree Survey]] ## Storage Reliability ### Papers - [[2024__TSC__Towards Close-To-Zero Runtime Collection Overhead - Raft-Based Anomaly Diagnosis on System Faults for Distributed Storage System]] ## Related MOCs - [[Database - MOC]] - [[TSDB - MOC]] - [[System Software - MOC]] - [[HPC - MOC]]