skyapmtest / agent-auto-integration-testcases

Notice

This repo doesn't accept any pull request anymore. It is archived and read-only. All plugin tests are moving into Apache main repo.

Agent Test Cases

This repository includes all javaagent test cases. Each case based on docker and docker-compose tech. The collector simulator receives the segments， and the test tool checks the result and report the report repository.

Test Result

The master branch result is root folder. The other branches and tags test results are in the folder of branch or tag name.

Document

• English
• 中文

License

Apache 2.0

agent-auto-integration-testcases's Issues

yaml.parser.ParserError

Not sure what I'm doing wrong here. I've tried it on multiple scenarios and I get the same result.

git clone https://github.com/SkyAPMTest/agent-auto-integration-testcases
cd agent-auto-integration-testcases/spring-scenario
mvn package docker:build

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] skywalking-spring-scenrio .......................... SUCCESS [  0.410 s]
[INFO] spring-projectA .................................... SUCCESS [  2.680 s]
[INFO] spring-projectB .................................... SUCCESS [  1.074 s]
[INFO] spring-projectC .................................... SUCCESS [  0.725 s]
[INFO] spring-projectD .................................... SUCCESS [  0.939 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 6.011 s
[INFO] Finished at: 2019-03-10T19:36:25-06:00
[INFO] Final Memory: 51M/1035M
[INFO] ------------------------------------------------------------------------

cd config
docker-compose up

ERROR: yaml.parser.ParserError: while parsing a block collection
  in "./docker-compose.yml", line 20, column 6
expected <block end>, but found '<scalar>'
  in "./docker-compose.yml", line 20, column 25

I've tried formatting the file and it gives the same error with different offsets.

Docker compose version: 1.23.2
OS: Ubuntu 18.04

how to integreation testcases

Hi all,
I am trying to write an agent's auto-testcases. But something puzzle me for long time.

1. Can I run testcases without deploy-test.sh. That means I run the docker-compose.yml only. If I can, how to get the report.
2. to execute deploy-test.sh, it has to clone the Apache Skywalking's source everytime?
3. How to configure my agent's repo, which I push my testcases.

Thanks

Make sure master, 6.x and 5.x test cases consistent

Now, I notice master and 6.x branch test cases are all targeting SkyWalking 6.x codebase. Could you merge them to keep one for 6.x, and the other for 5.x? @ascrutae

Add ci and license check for safe.

cc @peng-yongsheng @lytscu @ascrutae

testcase.yml with testcase.desc

I was confused with testcase.yml with testcase.desc, i 've found that there is no testcase.desc file in any other scenario folder. but when i run "./deploy-test.sh" , the log "
grep: /Users/francis/workspc/agent-auto-integration-testcases/testcases/hessian-scenario-4.0.38/testcase.desc: No such file or directory" tells me that i need a testcase.desc.

if the server whitch run testcases is not very strong and use default settings the most testcases will fail

i think the default settings witch run 8 cases paralleled without set --parallel_running_case_number , container will not work well on the limited mermery resource