datafuselabs / bendsql

Databend Native Client

BendSQL

Databend Native Client in Rust

Components

• core: Databend RestAPI Rust client

• driver: Databend SQL client for both RestAPI and FlightSQL

• cli: Databend native CLI

Installation for BendSQL

Cargo:

cargo-binstall is recommended:

cargo binstall bendsql

Or alternatively build from source:

cargo install bendsql

Homebrew:

brew install databendcloud/homebrew-tap/bendsql

Apt:

• Using DEB822-STYLE format on Ubuntu-22.04/Debian-12 and later:

sudo curl -L -o /etc/apt/sources.list.d/datafuselabs.sources https://repo.databend.rs/deb/datafuselabs.sources

• Using old format on Ubuntu-20.04/Debian-11 and earlier:

sudo curl -L -o /usr/share/keyrings/datafuselabs-keyring.gpg https://repo.databend.rs/deb/datafuselabs.gpg
sudo curl -L -o /etc/apt/sources.list.d/datafuselabs.list https://repo.databend.rs/deb/datafuselabs.list

Then install bendsql:

sudo apt update

sudo apt install bendsql

Manually:

Check for latest version on GitHub Release

Usage

❯ bendsql --help
Databend Native Command Line Tool

Usage: bendsql [OPTIONS]

Options:
      --help                       Print help information
      --flight                     Using flight sql protocol, ignored when --dsn is set
      --tls                        Enable TLS, ignored when --dsn is set
  -h, --host <HOST>                Databend Server host, Default: 127.0.0.1, ignored when --dsn is set
  -P, --port <PORT>                Databend Server port, Default: 8000, ignored when --dsn is set
  -u, --user <USER>                Default: root, overrides username in DSN
  -p, --password <PASSWORD>        Password, overrides password in DSN [env: BENDSQL_PASSWORD]
  -r, --role <ROLE>                Downgrade role name, overrides role in DSN
  -D, --database <DATABASE>        Database name, overrides database in DSN
      --set <SET>                  Settings, overrides settings in DSN
      --dsn <DSN>                  Data source name [env: BENDSQL_DSN]
  -n, --non-interactive            Force non-interactive mode
  -A, --no-auto-complete           Disable loading tables and fields for auto-completion, which offers a quicker start
      --check                      Check for server status and exit
      --query=<QUERY>              Query to execute
  -d, --data <DATA>                Data to load, @file or @- for stdin
  -f, --format <FORMAT>            Data format to load [default: csv] [possible values: csv, tsv, ndjson, parquet, xml]
      --format-opt <FORMAT_OPT>    Data format options
  -o, --output <OUTPUT>            Output format [possible values: table, csv, tsv, null]
      --quote-style <QUOTE_STYLE>  Output quote style, applies to `csv` and `tsv` output formats [possible values: always, necessary, non-numeric, never]
      --progress                   Show progress for query execution in stderr, only works with output format `table` and `null`.
      --stats                      Show stats after query execution in stderr, only works with non-interactive mode.
      --time[=<TIME>]              Only show execution time without results, will implicitly set output format to `null`. [possible values: local, server]
  -l, --log-level <LOG_LEVEL>      [default: info]
  -V, --version                    Print version

Custom configuration

By default bendsql will read configuration from ~/.bendsql/config.toml and ~/.config/bendsql/config.toml sequentially if exists.

• Example file

❯ cat ~/.bendsql/config.toml
[connection]
host = "127.0.0.1"
tls = false

[connection.args]
connect_timeout = "30"

[settings]
display_pretty_sql = true
progress_color = "green"
no_auto_complete = true
prompt = ":) "

• Connection section

Parameter	Description
host	Server host to connect.
port	Server port to connect.
user	User name.
database	Which database to connect.
args	Additional connection args.

• Settings section

Parameter	Description
display_pretty_sql	Whether to display SQL queries in a formatted way.
prompt	The prompt to display before asking for input.
progress_color	The color to use for the progress bar.
show_progress	Whether to show a progress bar when executing queries.
show_stats	Whether to show statistics after executing queries.
no_auto_complete	Whether to disable loading tables and fields for auto-completion on startup.
max_display_rows	The maximum number of rows to display in table output format.
max_width	Limit display render box max width, 0 means default to the size of the terminal.
max_col_width	Limit display render each column max width, smaller than 3 means disable the limit.
output_format	The output format to use.
expand	Expand table format display, default auto, could be on/off/auto.
time	Whether to show the time elapsed when executing queries.
multi_line	Whether to allow multi-line input.
replace_newline	whether replace '\n' with '\\n'.

Commands in REPL

Commands	Description
!exit	Exit bendsql
!quit	Exit bendsql
!configs	Show current settings
!set	Set settings
!source file	Source file and execute

Setting commands in REPL

We can use !set CMD_NAME VAL to update the Settings above in runtime, example:

❯ bendsql

:) !set display_pretty_sql false
:) !set max_display_rows 10
:) !set expand auto

DSN

Format:

databend[+flight]://user:[password]@host[:port]/[database][?sslmode=disable][&arg1=value1]

Examples:

• databend://root:@localhost:8000/?sslmode=disable&presign=detect

• databend://user1:[email protected]:443/benchmark?enable_dphyp=1

• databend+flight://root:@localhost:8900/database1?connect_timeout=10

Available Args:

Common:

Arg	Description
tenant	Tenant ID, Databend Cloud only.
warehouse	Warehouse name, Databend Cloud only.
sslmode	Set to disable if not using tls.
tls_ca_file	Custom root CA certificate path.
connect_timeout	Connect timeout in seconds

RestAPI client:

Arg	Description
wait_time_secs	Request wait time for page, default to 1
max_rows_in_buffer	Max rows for page buffer
max_rows_per_page	Max response rows for a single page
page_request_timeout_secs	Timeout for a single page request, default to 30
presign	Whether to enable presign for data loading, available arguments are auto/detect/on/off. Default to auto which only enable presign for Databend Cloud

FlightSQL client:

Arg	Description
query_timeout	Query timeout seconds
tcp_nodelay	Default to true
tcp_keepalive	Tcp keepalive seconds, default to 3600, set to 0 to disable keepalive
http2_keep_alive_interval	Keep alive interval in seconds, default to 300
keep_alive_timeout	Keep alive timeout in seconds, default to 20
keep_alive_while_idle	Default to true

Query Settings:

see: Databend Query Settings

Development

Cargo fmt, clippy, deny

make check

Unit tests

make test

integration tests

Note: Docker and Docker Compose needed

make integration

bendsql's Issues

Support USE WAREHOUSE

We don't need open any new terminal window for bendsql if we support:

show warehouses;

... ...
use wearehouse 'xx';

bug: display error

root@localhost:8000/> select 'a\nb' as a, hex(a);

SELECT
  'a\nb' AS a,
  hex(a)

┌─────────────────┐
│    a   │ hex(a) │
│ String │ String │
├────────┼────────┤
│ a      │ 610a62 │
│ b      │        │
└─────────────────┘
1 row in 0.007 sec. Processed 1 rows, 1B (149.15 rows/s, 149B/s)

mysql client:

mysql> select 'a\nb' as a, hex(a);
+------+--------+
| a    | hex(a) |
+------+--------+
| a
b  | 610a62 |
+------+--------+
1 row in set (0.00 sec)
Read 1 rows, 1.00 B in 0.001 sec., 999.27 rows/sec., 999.27 B/sec.

support send kill query into server Ctrl + C/D event

support multiline sql

like clickhouse client -mA

bendsql upload file Behavior inconsistency

Summary

bendsql upload file to stage

CREATE stage tmp_stage url = 's3://mystage' connection =(
  endpoint_url = 'http://192.168.1.100:9900' access_key_id = 'minioadmin' secret_access_key = 'minioadmin'
)

list @tmp_stage; -> ok

put fs:///xxxx @tmp_stage;

APIError: ParsingError: Invalid stage location: @tmp_stage

But a month ago this feature was ok.
docs: https://databend.rs/doc/load-data/stage/stage-files#uploading-with-put-command

bug: parse error when do select

how to reproduce:

root@localhost:8000/d1> SELECT -0.000000000000000000000000000000000673299310, [], minus(a), to_bitmap(837), to_bitmap(526) FROM test GROUP BY GROUPING SETS (
(-0.000000000000000000000000000000000673299310, [], minus(a), to_bitmap(837), to_bitmap(526)));


ParseError: Unknown type: TypeDesc { name: "Nothing", args: [] }

feat: support PUT and GET semantics on bendsql

https://docs.snowflake.com/en/sql-reference/sql/put

https://docs.snowflake.com/en/sql-reference/sql/get

feture: support dislpay one in multi rows

1. Want get table define ddl

show create table ontime;
┌───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┐
│  Table │                                                                               Create Table                                                                               │
│ String │                                                                                  String                                                                                  │
├────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┤
│ ontime │ CREATE TABLE `ontime` (\n  `Year` SMALLINT UNSIGNED,\n  `Quarter` TINYINT UNSIGNED,\n  `Month` TINYINT UNSIGNED,\n  `DayofMonth` TINYINT UNSIGNED,\n  `DayOfWeek` TIN... │
└───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
1 row result in 0.550 sec. Processed 0 rows, 0 B (0 rows/s, 0 B/s)

2. Want get presign url

bendsql> presign upload @~/a.csv;

presign upload @ ~ / a.csv

┌───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┐
│ method │        headers       │                                                                        url                                                                        │
│ String │        Variant       │                                                                       String                                                                      │
├────────┼──────────────────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┤
│ PUT    │ {"host":"s3.us-ea... │ https://s3.us-east-2.amazonaws.com/query-storage-53b9412/tn3ftqihs/stage/user/cloudapp/a.csv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential... │
└───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
1 row result in 1.332 sec. Processed 0 rows, 0 B (0 rows/s, 0 B/s)

want display result in multi rows.

unexpected `use db` behavior after `use warehouse`

BendSQL 0.4.7-dev

USE warehouse 'test-medium'

deploy@(test-medium)/> use bohu;

USE bohu

0 row in 8.618 sec. Processed 0 rows, 0B (0 rows/s, 0B/s)

deploy@(test-medium)/> show tables;

SHOW TABLES

┌───────────────────────────────────────┐
│           Tables_in_default           │
│                 String                │
├───────────────────────────────────────┤
│ _airbyte_raw_airbyteontimetest        │
│ _airbyte_raw_append_stream            │
│ _airbyte_raw_arrays                   │
│ ·                                     │
│ ·                                     │
│ ·                                     │
│ users__dbt_tmp                        │
│ 185 rows                              │
│ (40 shown)                            │
└───────────────────────────────────────┘
185 rows in 7.976 sec. Processed 185 rows, 185B (23.19 rows/s, 4.87 KiB/s)

deploy@(test-medium)/> use bohu;

USE bohu

0 row in 0.508 sec. Processed 0 rows, 0B (0 rows/s, 0B/s)

deploy@(test-medium)/bohu> show tables;

SHOW TABLES

┌────────────────┐
│ Tables_in_bohu │
│     String     │
├────────────────┤
│ c              │
│ c_random       │
│ employees      │
│ hits           │
│ hits_1         │
│ hits_2         │
│ hits_raw       │
│ random_source  │
│ student        │
│ t1             │
│ t2             │
│ test_order     │
└────────────────┘
12 rows in 0.551 sec. Processed 12 rows, 12B (21.78 rows/s, 4.41 KiB/s)

catalog auto compeletion

String display caused an error line

select message from T limit 3;

select * from T limit 3;

select * exclude message from T limit 3;

bendsql -o csv
select message from T limit 3;

feat: suppor auth with bearer token

bug: max_display_rows, max_width, max_col_width not effect in settings

https://github.com/datafuselabs/bendsql/blob/main/cli/src/config.rs#L34-L41

cat ~/.config/bendsql/config.toml
[settings]
max_display_rows=1000
max_width=10000
max_col_width=1000

use:

show settings;

just only display 40 rows.

None of them work.

Query results show escaped newline character

Currently, only the explain statement displays the escaped newline character. This results in a query string result not being displayed correctly, especially for functions like json_pretty that almost always have multiple lines of results.
For example:

root@127.0.0.1:8000/default> select json_pretty(parse_json('[1,2,[4,5,6,{"k":"v"}]]'));


SELECT
  json_pretty(parse_json('[1,2,[4,5,6,{"k":"v"}]]'))

┌──────────────────────────────────────────────────────────────────────────────────┐
│                json_pretty(parse_json('[1,2,[4,5,6,{"k":"v"}]]'))                │
│                                      String                                      │
├──────────────────────────────────────────────────────────────────────────────────┤
│ [\n  1,\n  2,\n  [\n    4,\n    5,\n    6,\n    {\n      "k": "v"\n    }\n  ]\n] │
└──────────────────────────────────────────────────────────────────────────────────┘
1 row result in 0.067 sec. Processed 1 rows, 1B (14.89 rows/s, 14B/s)

please show numbers column with right-align

bendsql> select avg(number) from numbers(10);
┌───────────────────┐
│    avg(number)    │
│ Nullable(Float64) │
├───────────────────┤
│ 4.5               │
└───────────────────┘

to

┌───────────────────┐
│    avg(number)    │
│ Nullable(Float64) │
├───────────────────┤
│                4.5│
└───────────────────┘

run select sql shows Processed 0 rows

bendsql> SELECT avg(number) FROM numbers(1e9) group by number%5;

SELECT
  avg(number)
FROM
  numbers(1 e9)
GROUP BY
  number % 5;

┌───────────────────┐
│    avg(number)    │
│ Nullable(Float64) │
├───────────────────┤
│       499999997.5 │
│       499999998.5 │
│       499999999.5 │
│       500000000.5 │
│       500000001.5 │
└───────────────────┘

5 rows in 2.638 sec. Processed 0 rows, 0B (0 rows/s, 0B/s)

bendsql> create table t2 storage_format = 'native' compression = 'lz4'  as SELECT number FROM numbers(200000000);
200000000 rows affected in (32.957 sec)

bendsql> SELECT avg(number) FROM t2 group by number%5;

SELECT
  avg(number)
FROM
  t2
GROUP BY
  number % 5;

┌───────────────────┐
│    avg(number)    │
│ Nullable(Float64) │
├───────────────────┤
│        99999997.5 │
│        99999998.5 │
│        99999999.5 │
│       100000000.5 │
│       100000001.5 │
└───────────────────┘

5 rows in 1.266 sec. Processed 0 rows, 0B (0 rows/s, 0B/s)

clickhouse

localhost.localdomain :) SELECT avg(number) FROM numbers_mt(1e9) group by number%5;

SELECT avg(number)
FROM numbers_mt(1000000000.)
GROUP BY number % 5

Query id: 50e19812-8edb-47ec-81a4-12165e9a5244

┌─avg(number)─┐
│ 499999997.5 │
│ 499999998.5 │
│ 499999999.5 │
│ 500000000.5 │
│ 500000001.5 │
└─────────────┘

5 rows in set. Elapsed: 0.929 sec. Processed 989.11 million rows, 7.91 GB (1.06 billion rows/s., 8.51 GB/s.)

bendsql upload file Behavior inconsistency

Summary

bendsql upload file to stage

CREATE stage tmp_stage url = 's3://mystage' connection =(
endpoint_url = 'http://192.168.1.100:9900' access_key_id = 'minioadmin' secret_access_key = 'minioadmin'
)

list @tmp_stage; -> ok

put fs:///xxxx @tmp_stage;

APIError: ParsingError: Invalid stage location: @tmp_stage

image
But a month ago this feature was ok.
docs: https://databend.rs/doc/load-data/stage/stage-files#uploading-with-put-command

feat: support datatype variant

Variant field is json in REST API, but not in FlightSQL.

feat: Allow specify a progress option in the nodejs client

maybe we can take a similiar api like databrik-sql-nodejs:

const result = await operation.fetchAll({
  progress: true,
  callback: (stateResponse) => {
    console.log(stateResponse.taskStatus);
  },
});

https://github.com/databricks/databricks-sql-nodejs/blob/main/docs/readme.md

feat: FlightSQL support nested datatypes

FlightSQL support nested datatypes

• Array
• Map
• Tuple

bug: get completion meta panic bendsql panic too

BendSQL supports completion with the query when connection:

SELECT name FROM system.tables UNION ALL SELECT name FROM system.columns UNION ALL SELECT name FROM system.databases UNION ALL SELECT name FROM system.functions

But the server may return error:

Connected to DatabendQuery v1.2.55-nightly-a74f88a1b603390742a536ba6cde1683ab1f9cd6(rust-1.72.0-nightly-2023-08-10T07:56:10.137121045Z)

thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: Api(InvalidResponse(QueryError { code: 1025, message: "Unknown table '_airbyte_raw_simple_stream_with_namespace_resulting_into_long_names'" }))', cli/src/session.rs:69:62

Then the BendSQL will not work anymore.

We should ignore the completion if the init phase something wrong.

please add arguments describe in --help output and documents

https://github.com/datafuselabs/bendsql/blob/main/cli/src/config.rs

Support driver level query id for e2e performance profiling and tracing

feat: keep the previous database when reconnecting

I was using the tpcds database, and when I reconnected to databend, I was switched to the default database, which was inconsistent with the behavior of mysql client.

feat: support custom CA certificate

bendsql support position column parser

❯ bendsql
Welcome to BendSQL 0.3.9-fea6039(2023-05-16T15:35:52.365502375Z).
Trying connect to localhost:8000 as user root.
Connected to DatabendQuery v1.1.33-nightly-7b4b3399dc08c10ee4d4a01b3e08c135ae8c0406(rust-1.70.0-nightly-2023-06-14T03:07:48.718011874Z)

databend :) select * from aa;

SELECT
  *
FROM
  aa

┌────────────────────────────────────┐
│   a   │              b             │
│ Int32 │          Timestamp         │
├───────┼────────────────────────────┤
│     3 │ 2023-06-15 02:28:43.049592 │
│     3 │ 2023-06-15 02:28:35.255629 │
│     3 │ 2023-06-15 02:28:34.772536 │
│     3 │ 2023-06-15 02:28:34.144613 │
└────────────────────────────────────┘
4 rows in 0.061 sec. Processed 4 rows, 4B (65.04 rows/s, 2.03 KiB/s)

databend :) select $1 from aa;
>

Support \G suffix

arch :) select number, number + 3 from numbers(4) \G


Row 1:
──────
number:          0
plus(number, 3): 3

Row 2:
──────
number:          1
plus(number, 3): 4

Row 3:
──────
number:          2
plus(number, 3): 5

Row 4:
──────
number:          3
plus(number, 3): 6

bug: The delete operation can't return effect row, aways 0

handle WarehousePrivisionTimeout error with retry

currently on connecting warehosues from databend cloud, if the resource is still in scheduling, it will return a timeout error. this error is actually retriable.

use PRESIGN instead of stream upload on the PUT statement

PRESIGN is prefered on uploading big files on a remote server, it may save lots of cost on the bandwidth.

however, we still need a option to allow upload via stream upload when the backend storage did not offer PRESIGN support (like HDFS)

bendsql puts a transmeaning symbol on '"'

I'm not sure this is normal.

`databend_driver::rows::RowIterator` which is not `Send`

When use the databend-driver with poem, it shows this error

error: future cannot be sent between threads safely
   --> src\api\query.rs:18:1
    |
18  | #[handler]
    | ^^^^^^^^^^ future created by async block is not `Send`
    |
    = help: the trait `Send` is not implemented for `(dyn Future<Output = Result<databend_client::response::QueryResponse, anyhow::Error>> + 'static)`
note: future is not `Send` as this value is used across an await
   --> src\db\db.rs:129:42
    |
128 |         let mut rows = self.conn.query_iter(&sql).await?;
    |             -------- has type `databend_driver::rows::RowIterator` which is not `Send`
129 |         while let Some(row) = rows.next().await {
    |                                          ^^^^^^ await occurs here, with `mut rows` maybe used later
...
135 |     }
    |     - `mut rows` is later dropped here

Any advice?

not return exit code as 1 on sql failed on one line execution

I have a CI job using bendsql in the databend-perf repo.

but it seems not return an exit code 1 on execution failed:

feature: add --servertime to fetch server execution time

Databend benchmark TPC-H CI can be change to the --servertime instead of client time.

make a brew cask release

currently the bendsql is released as source code in brew, however it takes actually a long time to actually compiles it in local machines.

how about making a brew cask release which allows install binary directly?

bug: Decimal256 display is not correct

Decimal256 display padding zero is missed.

root@localhost:18000/default> select 0.0000000000000000000000000000000001234;

SELECT
  0.0000000000000000000000000000000001234

┌─────────────────────────────────────────┐
│ 0.0000000000000000000000000000000001234 │
│             Decimal(37, 37)             │
├─────────────────────────────────────────┤
│ 0.0000000000000000000000000000000001234 │
└─────────────────────────────────────────┘
1 row read in 0.020 sec. Processed 1 row, 1 B (51.04 row/s, 51 B/s)

root@localhost:18000/default> select 0.0000000000000000000000000000000000001234;

SELECT
  0.0000000000000000000000000000000000001234

┌────────────────────────────────────────────┐
│ 0.0000000000000000000000000000000000001234 │
│               Decimal(40, 40)              │
├────────────────────────────────────────────┤
│ 0.1234                                     │
└────────────────────────────────────────────┘
1 row read in 0.019 sec. Processed 1 row, 1 B (51.46 row/s, 51 B/s)

feat: use client generated query id

Bug: panic when creating or dropping table.

When creating a non-existed table or dropping an existed table, the client will panic.

Howerever, the creating/dropping is successful

> CREATE TABLE t1(a FLOAT, b INTEGER);
thread 'main' panicked at 'called `Option::unwrap()` on a `None` value', $HOME/.cargo/registry/src/mirrors.ustc.edu.cn-12df342d903acd47/arrow-flight-36.0.0/src/sql/client.rs:194:55
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

> DROP TABLE t1;
thread 'main' panicked at 'called `Option::unwrap()` on a `None` value', $HOME/.cargo/registry/src/mirrors.ustc.edu.cn-12df342d903acd47/arrow-flight-36.0.0/src/sql/client.rs:194:55
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

bendsql put is very slow

In the same region

use bendsql put file to stage

use presign and curl upload file to same stage

Bug: `show indexes` failed.

> show indexes;

SHOW INDEXES

error happens after fetched 0 rows: ParseError: input contains invalid characters
> 

sslmode=false doesn't make sense.

see https://github.com/datafuselabs/bendsql/blob/main/core/src/client.rs#L118-L121, when use
"DATABEND_DSN="databend://root:@localhost:8000/?sslmode=false&enable_experimental_merge_into=1" cargo run -r -- 3000 2>&1 | tee rr.log", we can't work.

feat: support `ALTER WAREHOUSE 'wh' suspend`

Suspend the warehouse with bendsql.

`~/.config/bendsql/config.toml` to `~/.bendsql/config.toml`

It's more simple and general for default config path.

feat: support to generate fake data in parquet, csv format for a table

Mask password argument with command line in process list

change to

❯ ps -ef | grep bendsql
everpcpc 1338305 1337414  0 19:01 pts/28   00:00:00 bendsql -h xxx.databend.com -u everpcpc -P 443 -p xxxxxxxx --tls

loading auto complete keywords failed

loading auto complete keywords failed: APIError: ResponseError with 2601: , cause: failed to decode Protobuf message: buffer underflow
(while get UDFs).

bug: can't execute copy into with path

bendsql --version
bendsql 0.9.1-homebrew

bendsql> copy into supplier from @tpch_data2/tpch_100/supplier/ pattern='.*[.]parquet' file_format=(type=parquet);
error: APIError: ResponseError with 1005: error:
  --> SQL:3:15
  |
1 | copy INTO supplier
2 | FROM
3 |   @tpch_data2 / tpch_100 / supplier / pattern = '.*[.]parquet' file_format =(TYPE = parquet)
  |               ^ expected `FILES`, `PATTERN`, `FILE_FORMAT`, `VALIDATION_MODE`, `SIZE_LIMIT`, `MAX_FILES`, `SPLIT_SIZE`, `PURGE`, `FORCE`, `ON_ERROR`, `DISABLE_VARIANT_CHECK`, `RETURN_FAILED_ONLY`, `FORMAT`, or `;`


bendsql> list @tpch_data2/tpch_100/;
error: APIError: ResponseError with 1005: error:
  --> SQL:1:18
  |
1 | list @tpch_data2 / tpch_100 /
  |                  ^ expected `PATTERN`, `FORMAT`, or `;`

Tracking issue to improve the bendsql

To make the databend-cli works better, there are some tasks to do:

• Better error message #22
• Support loading file as cli side settings #31
• Support display server progress (use indicatif crate) #26
• Support control command #95 95
• Support display server logs
• #182

bug: can not execute multi line query

Query:

-- TPC-H 1
select l_returnflag, l_linestatus, sum(l_quantity) as sum_qty, sum(l_extendedprice) as sum_base_price, sum(l_extendedprice * (1 - l_discount)) as sum_disc_price, sum(l_extendedprice * (1 - l_discount) * (1 + l_tax)) as sum_charge, avg(l_quantity) as avg_qty, avg(l_extendedprice) as avg_price, avg(l_discount) as avg_disc, count(*) as count_order from lineitem where l_shipdate <= add_days(to_date('1998-12-01'), -90) group by l_returnflag, l_linestatus order by l_returnflag, l_linestatus;

Error:

❯ bendsql -q "-- TPC-H 1
select l_returnflag, l_linestatus, sum(l_quantity) as sum_qty, sum(l_extendedprice) as sum_base_price, sum(l_extendedprice * (1 - l_discount)) as sum_disc_price, sum(l_extendedprice * (1 - l_discount) * (1 + l_tax)) as sum_charge, avg(l_quantity) as avg_qty, avg(l_extendedprice) as avg_price, avg(l_discount) as avg_disc, count(*) as count_order from lineitem where l_shipdate <= add_days(to_date('1998-12-01'), -90) group by l_returnflag, l_linestatus order by l_returnflag, l_linestatus;" --time
error: unexpected argument '-- TPC-H 1
select l_returnflag, l_linestatus, sum(l_quantity) as sum_qty, sum(l_extendedprice) as sum_base_price, sum(l_extendedprice * (1 - l_discount)) as sum_disc_price, sum(l_extendedprice * (1 - l_discount) * (1 + l_tax)) as sum_charge, avg(l_quantity) as avg_qty, avg(l_extendedprice) as avg_price, avg(l_discount) as avg_disc, count(*) as count_order from lineitem where l_shipdate <' found

Error on brew install: failed to compile

╰─$ brew install databendcloud/homebrew-tap/bendsql

==> Tapping databendcloud/tap
Cloning into '/opt/homebrew/Library/Taps/databendcloud/homebrew-tap'...
remote: Enumerating objects: 37, done.
remote: Counting objects: 100% (37/37), done.
remote: Compressing objects: 100% (34/34), done.
remote: Total 37 (delta 20), reused 5 (delta 2), pack-reused 0
Receiving objects: 100% (37/37), 11.42 KiB | 2.28 MiB/s, done.
Resolving deltas: 100% (20/20), done.
Tapped 1 formula (14 files, 28.3KB).
Warning: You are using macOS 13.
We do not provide support for this pre-release version.
You will encounter build failures with some formulae.
Please create pull requests instead of asking for help on Homebrew's GitHub,
Twitter or any other official channels. You are responsible for resolving
any issues you experience while you are running this
pre-release version.

==> Downloading https://ghcr.io/v2/homebrew/core/libssh2/manifests/1.10.0
######################################################################## 100.0%
==> Downloading https://ghcr.io/v2/homebrew/core/libssh2/blobs/sha256:f9dab718cfa591fa90dc716a337e4c2c1da2db651b669565c3cc08e6a6074
==> Downloading from https://pkg-containers.githubusercontent.com/ghcr1/blobs/sha256:f9dab718cfa591fa90dc716a337e4c2c1da2db651b6695
######################################################################## 100.0%
==> Downloading https://ghcr.io/v2/homebrew/core/rust/manifests/1.62.1
######################################################################## 100.0%
==> Downloading https://ghcr.io/v2/homebrew/core/rust/blobs/sha256:a559acc618a575bd0e05b3a7f0dc5317556a77cd61ee71caf09eb7e79bf54c01
==> Downloading from https://pkg-containers.githubusercontent.com/ghcr1/blobs/sha256:a559acc618a575bd0e05b3a7f0dc5317556a77cd61ee71
######################################################################## 100.0%
==> Downloading https://github.com/datafuselabs/databend-client/archive/v0.2.6.tar.gz
==> Downloading from https://codeload.github.com/datafuselabs/databend-client/tar.gz/refs/tags/v0.2.6
-#O#- #   #
==> Installing bendsql from databendcloud/tap
==> Installing dependencies for databendcloud/tap/bendsql: libssh2 and rust
==> Installing databendcloud/tap/bendsql dependency: libssh2
==> Pouring libssh2--1.10.0.arm64_monterey.bottle.tar.gz
🍺  /opt/homebrew/Cellar/libssh2/1.10.0: 184 files, 1MB
==> Installing databendcloud/tap/bendsql dependency: rust
==> Pouring rust--1.62.1.arm64_monterey.bottle.tar.gz
🍺  /opt/homebrew/Cellar/rust/1.62.1: 35,381 files, 849.4MB
==> Installing databendcloud/tap/bendsql
==> cargo install
Last 15 lines from /Users/yazhou/Library/Logs/Homebrew/bendsql/01.cargo:
  Downloaded idna v0.3.0
  Downloaded http-body v0.4.5
  Downloaded hashbrown v0.13.2
  Downloaded half v2.2.1
  Downloaded http v0.2.9
  Downloaded futures v0.3.28
  Downloaded sync_wrapper v0.1.2
  Downloaded heck v0.4.1
  Downloaded hashbrown v0.12.3
  Downloaded dyn-clone v1.0.11
  Downloaded crossterm v0.25.0
error: failed to compile `bendsql v0.2.6 (/private/tmp/bendsql-20230421-30276-jh62y1/databend-client-0.2.6/cli)`, intermediate artifacts can be found at `/private/tmp/bendsql-20230421-30276-jh62y1/databend-client-0.2.6/target`

Caused by:
  package `clap_derive v4.2.0` cannot be built because it requires rustc 1.64.0 or newer, while the currently active rustc version is 1.62.1

Do not report this issue to Homebrew/brew or Homebrew/core!


Error: You are using macOS 13.
We do not provide support for this pre-release version.
You will encounter build failures with some formulae.
Please create pull requests instead of asking for help on Homebrew's GitHub,
Twitter or any other official channels. You are responsible for resolving
any issues you experience while you are running this
pre-release version.

however when I view my version of rustc, it shows it's 1.66.0:

╰─$ rustc --version                                                                                                            1 ↵
rustc 1.66.0-nightly (8b0c05d9a 2022-10-07)