Comments (5)
I'm not sure what to do from here.
I think the following needs to be done.
- Determine how one process can close a file using GCSC such that any other processes writing to the file will fail. Then implement this as a
org.apache.accumulo.server.master.recovery.LogCloser
. - Put this implementation on Accumulo classpath
- Set the accumulo property
master.walog.closer.implementation
to use the impl
I am really curious about the overall write ahead log behavior with GCSC. It would be interesting to intentionally kill tablet servers and see if the data recovers correctly.
from accumulo.
Looking at GCS, that WAL file doesn't even exist, so I'm not sure where it's storing that upon restar. Is it somewhere in zookeeper I can wipe out, at least to temporarily negate this issue?
from accumulo.
Is it somewhere in zookeeper I can wipe out, at least to temporarily negate this issue?
Try looking in /accumulo/<uuid>/root_tablet/walogs
in zookeeper.
from accumulo.
I'm not sure there's a general solution in Accumulo we can provide for this scenario. We can't really know how to react to unknown FileSystem
implementations. If it's not one of the ones we support, the user must provide a LogCloser implementation for that specific FileSystem
.
This is really more of a question, than an issue. I'm inclined to close it as answered. Does that seem reasonable?
from accumulo.
Yup, makes sense @ctubbsii . Closing.
from accumulo.
Related Issues (20)
- admin stopManager command does nothing HOT 1
- Conditional writer creation does not always use client properties. HOT 3
- Increase coverage of conditional mutation rejection handling code. HOT 7
- Upgrade from 4.0 to 4.1 may need to consider new fate table.
- SessionManager properties are not updated dynamically HOT 2
- Replace ReferenceDirectory class with static constructor HOT 1
- Look at collapsing MutableByteSequence into ArrayByteSequence HOT 4
- Add methods to Key that populate existing ArrayByteSequence HOT 2
- GarbageCollectWriteAheadLogs leaves CloseableIterators unclosed HOT 5
- Help flag for admin command does not work for subcommands HOT 1
- Add metric to count zombie scans threads in tablet server HOT 3
- Zombie scan thread can indefinitely block tablet from closing.
- Negative numbers are allowed in Configuration for memory and duration types. HOT 1
- Fix String-to-bytes and bytes-toString for UTF-8 for all remaining code HOT 3
- Variable redirection logic could be simplified HOT 2
- Broken or Flaky test: ScanServerMetadataEntriesIT
- Rework OpTimer and NanoTime HOT 1
- listcompactions summary with optional group filter HOT 2
- Static cache in VolumeManagerImpl has potential to cause memory leak HOT 6
- TEMP Testing creating draft issue
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from accumulo.