bblfsh / performance Goto Github PK

Currently e2e works only with bblfshd docker tags which is not enough for development.

The following functionality requested:

1. Pull driver repo at a specific commit.
2. Build Docker image.
3. Run bblfshd:some-tag (configurable).
4. Command it to install the driver from Docker daemon (docker-daemon:image-name).
5. Test as usual.

Now CLI is only able to dump data to influxdb, after several discussions we agreed to support prometheus pushgateway as well.

https://raw.githubusercontent.com/bblfsh/documentation/master/languages.json

Currently, all benchmark names contain the bench_ prefix. It's useful for filtering fixture files but is not informative for the dashboard. I propose to trim the prefix when adding the benchmark name as a label.

Use either

• go-git functionality
• git rev-parse HEAD

Currently only transformations and end-to-end level supported.
Performance benchmark has to support running benchmark over driver container without intermediate bblfsh level

Environment
OSX host

FROM docker:latest

COPY ./bblfsh-performance /usr/bin/
WORKDIR /usr/bin

ENTRYPOINT ["./bblfsh-performance"]

Command

docker run --privileged \
--rm \
-e LOG_LEVEL=debug \
-e INFLUX_ADDRESS="http://localhost:8086" \
-e INFLUX_USERNAME="" \
-e INFLUX_PASSWORD="" \
-e INFLUX_DB=mydb \
-e INFLUX_MEASUREMENT=benchmark \
-v /var/run/docker.sock:/var/run/docker.sock \
-v ./data/fixtures:/data \
--name bblfsh-performance \
bblfsh-performance end-to-end --language=go --commit=3d9682b --extension=".go" /data

Observed
docker client cannot dial address because of hostport localhost:9432

Possible solution
Use another docker client and bind to address in the docker network 172.17...

The issue is similar to #15, but the driver should be tested using the native protocol (JSON lines over stdin/stdout), example