fix leveldb mount bug

[whynotAC]

index--->leveldb

operation:

unmount volume(vid=3)
mount volume(vid=3)
error:
I0502 16:02:19 03815 disk_location.go:59] new volume 3.dat error resource temporarily unavailable

fix:

add l.volumes[vid].close() in file storage/disk_location.go line 171 before delete(l.volumes, vid);

[chrislusf]

use the volume variable ignored at line 167.

[chrislusf]

thanks!

[whynotAC]

use leveldb index. but after loading leveldb database, you use Btree statistics zhe deleted file size，wo don't think this is a good way.

when I loading 100 million index，Btree will use 3.6G memory，and GC don't work well。

but in my filesystem, don't care the deleted file size, so I ingore the Btree Code.

I know the deleted file size will influences Compact.

[chrislusf]

Not very clear about what you mean. Maybe let me see what you have changed in code.

[whynotAC]

func doLoading(file *os.File, nm NeedleMap, flag bool) (NeedleMap, error) {
e := WalkIndexFile(file, func(key uint64, offset, size uint32) error {
if key > nm.MaximumFileKey {
nm.MaximumFileKey = key
}
if offset > 0 && size != TombstoneFileSize {
nm.FileCounter++
nm.FileByteCounter = nm.FileByteCounter + uint64(size)
if flag {
oldOffset, oldSize := nm.m.Set(needle.Key(key), offset, size)
glog.V(3).Infoln("reading key", key, "offset", offsetNeedlePaddingSize, "size", size, "oldSize", oldSize)
if oldOffset > 0 && oldSize != TombstoneFileSize {
nm.DeletionCounter++
nm.DeletionByteCounter = nm.DeletionByteCounter + uint64(oldSize)
}
}
} else {
oldSize := nm.m.Delete(needle.Key(key))
glog.V(3).Infoln("removing key", key, "offset", offsetNeedlePaddingSize, "size", size, "oldSize", oldSize)
nm.DeletionCounter++
nm.DeletionByteCounter = nm.DeletionByteCounter + uint64(oldSize)
}
return nil
})
glog.V(1).Infof("max file key: %d for file: %s", nm.MaximumFileKey, file.Name())
return nm, e
}

add parameter flag in function doLoading，if index--->leveldb/boltdb，flag--->flase；other, flag-->true

[chrislusf]

right. need a way to do metrics better.