Comments (1)
I looked into doing this. I was thinking I could just use the min and max rows from the load mapping to scan the metadata table. However if a tablet at the min or max row has split then it may copy some load flags outside of the range. There are three possible ways to avoid this :
- Ignore this edge case because metadata compaction will eventually clean up load flags.
- Make the split code smarter about copying load flags. Currently all load flags go to both children, even if the loaded file does not. This may be impossible though for the case the file was compacted away.
- Get the min and max row in the metadata table at the beginning of the fate operation and use these rows to limit the cleanup at the end. Since the min and max would be recorded before anything is loaded splits occurring after/during the fate load step would fall within this range. The could be done in the first fate step when it checks for merges.
Option 3 allows the final fate step to avoid opening the load mapping file to find the min and max row.
from accumulo.
Related Issues (20)
- Increase coverage of conditional mutation rejection handling code. HOT 7
- Upgrade from 4.0 to 4.1 may need to consider new fate table.
- SessionManager properties are not updated dynamically HOT 2
- Replace ReferenceDirectory class with static constructor HOT 1
- Look at collapsing MutableByteSequence into ArrayByteSequence HOT 4
- Add methods to Key that populate existing ArrayByteSequence HOT 2
- GarbageCollectWriteAheadLogs leaves CloseableIterators unclosed HOT 5
- Help flag for admin command does not work for subcommands HOT 1
- Add metric to count zombie scans threads in tablet server HOT 3
- Zombie scan thread can indefinitely block tablet from closing.
- Negative numbers are allowed in Configuration for memory and duration types. HOT 1
- Fix String-to-bytes and bytes-toString for UTF-8 for all remaining code HOT 3
- Variable redirection logic could be simplified HOT 2
- Broken or Flaky test: ScanServerMetadataEntriesIT
- Rework OpTimer and NanoTime HOT 1
- listcompactions summary with optional group filter HOT 2
- Static cache in VolumeManagerImpl has potential to cause memory leak HOT 6
- TEMP Testing creating draft issue
- CompactionDriver.cleanupTabletMetadata is untested HOT 1
- Post-vote release checklist for version 2.1.3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from accumulo.