Abstract: Aiming at super-node indexed large scale distributed system (LSDS), a kind of novel hierarchical index compression mechanism is put forward for replica location. It is implemented by mapping all sub nodes of higher-up node to corresponding bit string at first, then compressing record number of redundant replica index by bottom-up index publish and index aggregating on higher-up node. Accordingly, replicas in system can be located by query on bit string conversely. The experimental results indicate that this mechanism achieves high record compression ratio and has some active impacts on efficiency of replica location in LSDS.