Considerable optimizations have been implemented (found greater than 220% in testing) when updating large index files.