cubefs / cubefs-blobstore

BlobStore is a highly reliable,highly available and ultra-large scale distributed storage system.

BlobStore

• Overview
• Documents
• Build BlobStore
• Deploy BlobStore
• Manage BlobStore
• License

Overview

BlobStore is a highly reliable,highly available and ultra-large scale distributed storage system. The system adopts Reed-Solomon code, which provides higher data durability with less storage cost than use three copies backup technology, and supports multiple erasure code modes multiple availability zones,and optimizes for small file to meet the storage needs of different scenarios. Some key features of BlobStore include:

• ultra-large scale
• high reliability
• flexible deployment
• low cost

Documents

English version: https://cubefs.readthedocs.io/en/latest/

Chinese version: https://cubefs.readthedocs.io/zh_CN/latest/

Build BlobStore

$ git clone http://github.com/cubefs/blobstore.git
$ cd blobstore
$ source env.sh
$ ./build.sh 

Deploy BlobStore

For more details please refer to documentation.

Manage BlobStore

For more details please refer to documentation.

License

BlobStore is licensed under the Apache License, Version 2.0. For detail see LICENSE and NOTICE.

cubefs-blobstore's Issues

[performance] common crc32block Read more block once

【Deprecated】This repository has been replaced by cubefs/blobstore.

Cubefs: https://github.com/cubefs/cubefs

blocking key deadlock problem

问题场景：

if kl == nil {
		l.lock.RUnlock()
		l.lock.Lock()
		kl = newBlocker(l.limit)
		l.keyMap[key] = kl
		kl.addRef()
		l.lock.Unlock()

1. In a concurrent scenario, when aquire a single key, the obtained key maybe nil and no secondary check is performed, which may result in the same key being overwritten.

if kl.loadRef() < 0 {
			l.lock.Unlock()
			panic("internal error: refs < 0")
		}
		if kl.loadRef() == 0 {
			delete(l.keyMap, key)
		}
		kls = append(kls, kl)
	}
	for _, kl := range kls {
		kl.release()
	}

2. When the key is released, there is a problem with the reference count judgment, resulting in the repeated release of the key's lock