Table of Contents Author Guidelines Submit a Manuscript
Scientific Programming
Volume 21, Issue 3-4, Pages 65-78
http://dx.doi.org/10.3233/SPR-130365

Compiler-Directed File Layout Optimization for Hierarchical Storage Systems

Wei Ding,1 Yuanrui Zhang,2 Mahmut Kandemir,1 and Seung Woo Son3

1The Pennsylvania State University, University Park, PA, USA
2Intel Corporation, University Park, PA, USA
3Northwestern University, Evanston, IL, USA

Copyright © 2013 Hindawi Publishing Corporation. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

File layout of array data is a critical factor that effects the behavior of storage caches, and has so far taken not much attention in the context of hierarchical storage systems. The main contribution of this paper is a compiler-driven file layout optimization scheme for hierarchical storage caches. This approach, fully automated within an optimizing compiler, analyzes a multi-threaded application code and determines a file layout for each disk-resident array referenced by the code, such that the performance of the target storage cache hierarchy is maximized. We tested our approach using 16 I/O intensive application programs and compared its performance against two previously proposed approaches under different cache space management schemes. Our experimental results show that the proposed approach improves the execution time of these parallel applications by 23.7% on average.