Comments (7)
HDFS is unusable as a MergeTree disk with the current Clickhouse implementation
from clickhouse.
Hey @den-crane,
Thank you for the quick response.
After reviewing the mentioned issue, it seems ClickHouse doesn't support HDFS. Is it possible to use a mounted or external disk for 'cold' storage instead?
Any references or documentation on this would be greatly appreciated.
Thank you!
from clickhouse.
it seems ClickHouse doesn't support HDFS.
right.
Is it possible to use a mounted or external disk for 'cold' storage instead?
HDFS as an mounted/external disk? Never heard about such technology, I doubt it will work.
from clickhouse.
Hey @den-crane
No not HDFS as mounted disk.
Can i just use any storage disk like HDD or SSD as cold storage, which is mounted to the Clickhouse server machine ?
Thank you!
from clickhouse.
Can i just use any storage disk like HDD or SSD as cold storage, which is mounted to the Clickhouse server machine ?
Yes, you can.
from clickhouse.
Hey @den-crane,
I'm trying to use an external disk mounted to the ClickHouse server machine for cold storage, but I'm encountering the following error:
<Error> Application: std::exception. Code: 1001, type: std::__1::__fs::filesystem::filesystem_error, e.what() = filesystem error: in posix_stat: failed to determine attributes for the specified path: Permission denied [/home/server-user/cold-storage/]
I have verified that the specified path /home/server-user/cold-storage/
has the correct permissions set for server-user
. However, when ClickHouse attempts to write data to this path, it throws the above error.
Additional Information:
- The path does not have root permissions, it is owned by
server-user
. - I have come across several issues suggesting downgrading ClickHouse to version 22.x.x as a potential solution.
Could you please advise on the best approach to resolve this issue? Is downgrading ClickHouse a viable solution, or is there another recommended method to address this permission error?
Thank you!
from clickhouse.
- how do you run Clickhouse-server?
- check
sudo -u server-user 'mkdir /home/server-user/cold-storage/test'
- what is this
/cold-storage/
sortof USB disk? what filesystem does it have?
from clickhouse.
Related Issues (20)
- Unexpected query result with MergeTree and order by HOT 3
- Error with toDate function HOT 2
- `have_compressed` is not copied in `HashJoin::reusedJoinedData` HOT 1
- JSONStringsEachRowWithProgress output format always contain zero values in the result_rows, result_bytes, elapsed_ns fields
- Sort order of blocks violated for column logical error HOT 1
- connection loss while table creation leave dangling files and further creation fails HOT 1
- Clickhouse server fails to start due to syntax error in a valid view
- Default storage_policy for a whole database or group of users (settings profiles)
- Can't use same function twice for two materialized columns in the same table: MULTIPLE_EXPRESSIONS_FOR_ALIAS
- Values format ignores format settings during conversion of expressions to the destination type HOT 3
- dictGetDescendants+arrayMap process only first row for root node of for HIERARCHICAL dictionary HOT 1
- Enable RocksDB in Keeper in CI with randomization
- Backup concurrency HOT 1
- do_not_merge_across_partitions in ReplacingMergeTree with is_deleted
- min_age_to_force_merge_on_partition_only and ReplacingMergeTree with is_deleted HOT 2
- CI: Integration tests timeout
- GROUP BY WITH ROLLUP does not use default column value HOT 1
- Test `test_s3_aws_sdk_has_slightly_unreliable_behaviour/test.py::test_dataloss` is very slow HOT 1
- TabSeparatedWithNames create empty records HOT 4
- Failing to parse error hints after failed query parsing with comments when `ignore_errors` is `true`
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from clickhouse.