GithubHelp home page GithubHelp logo

amitsaxena / fire_at_will Goto Github PK

View Code? Open in Web Editor NEW
0.0 2.0 1.0 9 KB

This is a nifty tool to load test any given service/URL. You can spawn EC2 instances at will and hit any URL repeatedly from them and obtain the resulting output.

Shell 4.97% Ruby 87.64% Dockerfile 7.39%

fire_at_will's Introduction

fire_at_will

This is a quick and dirty tool to load test any given service/URL. You can spawn EC2 instances (in multiple regions) at will and hit any URL repeatedly from them and obtain the resulting output on your console.

Why did I create this? Mostly because I couldn't get beeswithmachineguns up and running quickly, so I thought why not create one. It's always great to have alternatives!

Though I created this to simulate real world traffic for my apps, but this can be used to execute any commands on remote EC2 instances by just changing the command in config file.

You can either run the ruby script directly (after installing dependencies), or use the dockerized version instead.

What's involved?

The docker way!

  • Clone the repository locally
  • Add all key pair .pem files (for different regions) to the config directory. In case you don't know what I am talking about, try and figure it out here
  • Create an AMI for each region (spawn an EC2 instance with Linux and install apache bench, SSM agent and any other tool you need on it. Then generate an image from it). You'll need it in config file
  • Create a role which enables SSM (Amazon EC2 Systems Manager) to access your EC2 instances. If you are unable to figure this out, troubleshoot here. You will need to specify this role in config file
  • Add details to config.yml
  • docker build -t loadtest .
  • docker run -t loadtest
  • docker ps
  • Use the container id from previous command to log in to docker shell: docker exec -it <contaner id> bash
  • ruby load_test.rb

The good old ruby way

  • Clone the repository locally
  • Add all key pair .pem files (for different regions) to the .ssh directory in you home directory (~/.ssh/)
  • Create an AMI for each region (spawn an EC2 instance with Linux and install apache bench, SSM agent and any other tool you need on it. Then generate an image from it). You'll need it in config file
  • Create a role which enables SSM (Amazon EC2 Systems Manager) to access your EC2 instances. If you are unable to figure this out, troubleshoot here. You will need to specify this role in config file
  • Add details to config.yml
  • gem install aws-sdk
  • ruby load_test.rb

Sample Output

ap-south-1 Instances:
--------------------------------------------------------------------------------
i-012d982950f687d04 - pending
i-05843e3bc8a2bfbe1 - pending
i-02ed55d9ec915f223 - pending
--------------------------------------------------------------------------------
us-east-1 Instances:
--------------------------------------------------------------------------------
i-013644e8b6bb377d8 - pending
i-0690d7be69ac72458 - pending
--------------------------------------------------------------------------------
Sleeping for 5 minutes to make sure instances are ready...
/Master command id for ap-south-1: 45118391-a684-4f2e-8b1d-16caf6071657
Master command id for us-east-1: 3b3bce1f-d1c9-4987-84ea-e889ae0a783f
Sleeping for 1 minute to make sure command invocation has reached the EC2 instances...
~~~~~~~~~~~~~~~~~~\___/~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
********************************************************************************
Output on instance id i-012d982950f687d04 from region ap-south-1
********************************************************************************
This is ApacheBench, Version 2.3 <$Revision: 1706008 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking example.com (be patient).....done


Server Software:        ECS
Server Hostname:        example.com
Server Port:            80

Document Path:          /
Document Length:        1270 bytes

Concurrency Level:      10
Time taken for tests:   2.116 seconds
Complete requests:      100
Failed requests:        0
Keep-Alive requests:    100
Total transferred:      160500 bytes
HTML transferred:       127000 bytes
Requests per second:    47.26 [#/sec] (mean)
Time per request:       211.600 [ms] (mean)
Time per request:       21.160 [ms] (mean, across all concurrent requests)
Transfer rate:          74.07 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0   19  55.9      0     192
Processing:   184  186   2.4    185     193
Waiting:      184  186   2.4    185     193
Total:        184  204  55.9    185     384

Percentage of the requests served within a certain time (ms)
  50%    185
  66%    186
  75%    187
  80%    187
  90%    367
  95%    370
  98%    373
  99%    384
 100%    384 (longest request)
################################################################################
********************************************************************************
Output on instance id i-05843e3bc8a2bfbe1 from region ap-south-1
********************************************************************************
This is ApacheBench, Version 2.3 <$Revision: 1706008 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking example.com (be patient).....done


Server Software:        ECS
Server Hostname:        example.com
Server Port:            80

Document Path:          /
Document Length:        1270 bytes

Concurrency Level:      10
Time taken for tests:   2.098 seconds
Complete requests:      100
Failed requests:        0
Keep-Alive requests:    100
Total transferred:      160500 bytes
HTML transferred:       127000 bytes
Requests per second:    47.66 [#/sec] (mean)
Time per request:       209.819 [ms] (mean)
Time per request:       20.982 [ms] (mean, across all concurrent requests)
Transfer rate:          74.70 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0   19  56.2      0     190
Processing:   184  187   1.8    186     191
Waiting:      184  187   1.8    186     191
Total:        184  206  56.2    186     381

Percentage of the requests served within a certain time (ms)
  50%    186
  66%    188
  75%    189
  80%    191
  90%    368
  95%    372
  98%    378
  99%    381
 100%    381 (longest request)
################################################################################
********************************************************************************
Output on instance id i-02ed55d9ec915f223 from region ap-south-1
********************************************************************************
This is ApacheBench, Version 2.3 <$Revision: 1706008 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking example.com (be patient).....done


Server Software:        ECS
Server Hostname:        example.com
Server Port:            80

Document Path:          /
Document Length:        1270 bytes

Concurrency Level:      10
Time taken for tests:   2.119 seconds
Complete requests:      100
Failed requests:        0
Keep-Alive requests:    100
Total transferred:      160500 bytes
HTML transferred:       127000 bytes
Requests per second:    47.18 [#/sec] (mean)
Time per request:       211.949 [ms] (mean)
Time per request:       21.195 [ms] (mean, across all concurrent requests)
Transfer rate:          73.95 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0   19  56.7      0     192
Processing:   184  189   2.5    190     194
Waiting:      184  189   2.5    190     194
Total:        184  208  56.8    190     385

Percentage of the requests served within a certain time (ms)
  50%    190
  66%    190
  75%    191
  80%    192
  90%    368
  95%    379
  98%    381
  99%    385
 100%    385 (longest request)
################################################################################
********************************************************************************
Output on instance id i-013644e8b6bb377d8 from region us-east-1
********************************************************************************
This is ApacheBench, Version 2.3 <$Revision: 1706008 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking example.com (be patient).....done


Server Software:        ECS
Server Hostname:        example.com
Server Port:            80

Document Path:          /
Document Length:        1270 bytes

Concurrency Level:      10
Time taken for tests:   0.030 seconds
Complete requests:      100
Failed requests:        0
Keep-Alive requests:    100
Total transferred:      160000 bytes
HTML transferred:       127000 bytes
Requests per second:    3289.37 [#/sec] (mean)
Time per request:       3.040 [ms] (mean)
Time per request:       0.304 [ms] (mean, across all concurrent requests)
Transfer rate:          5139.63 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.4      0       2
Processing:     2    3   0.7      2       5
Waiting:        2    3   0.7      2       5
Total:          2    3   1.0      3       6
WARNING: The median and mean for the processing time are not within a normal deviation
        These results are probably not that reliable.
WARNING: The median and mean for the waiting time are not within a normal deviation
        These results are probably not that reliable.

Percentage of the requests served within a certain time (ms)
  50%      3
  66%      3
  75%      3
  80%      3
  90%      4
  95%      6
  98%      6
  99%      6
 100%      6 (longest request)
################################################################################
********************************************************************************
Output on instance id i-0690d7be69ac72458 from region us-east-1
********************************************************************************
This is ApacheBench, Version 2.3 <$Revision: 1706008 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking example.com (be patient).....done


Server Software:        ECS
Server Hostname:        example.com
Server Port:            80

Document Path:          /
Document Length:        1270 bytes

Concurrency Level:      10
Time taken for tests:   0.033 seconds
Complete requests:      100
Failed requests:        0
Keep-Alive requests:    100
Total transferred:      160000 bytes
HTML transferred:       127000 bytes
Requests per second:    3058.29 [#/sec] (mean)
Time per request:       3.270 [ms] (mean)
Time per request:       0.327 [ms] (mean, across all concurrent requests)
Transfer rate:          4778.58 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.6      0       2
Processing:     2    3   0.9      3       5
Waiting:        2    3   0.7      2       5
Total:          2    3   1.2      3       6
WARNING: The median and mean for the waiting time are not within a normal deviation
        These results are probably not that reliable.

Percentage of the requests served within a certain time (ms)
  50%      3
  66%      3
  75%      4
  80%      4
  90%      5
  95%      6
  98%      6
  99%      6
 100%      6 (longest request)
################################################################################
Sleeping for 2 minutes before terminating EC2 instances. In case you do not want this press  c ...
-Terminating instance i-012d982950f687d04  ︻デ┳═ー
Terminating instance i-05843e3bc8a2bfbe1  ︻デ┳═ー
Terminating instance i-02ed55d9ec915f223  ︻デ┳═ー
Terminating instance i-013644e8b6bb377d8  ︻デ┳═ー
Terminating instance i-0690d7be69ac72458  ︻デ┳═ー

Config file

Be careful with extra spaces and tabs while editing the yml file.

---
:aws_access_key_id: Your AWS_ACCESS_KEY_ID
:aws_secret_access_key: Your AWS_SECRET_ACCESS_KEY
:instance_type: t2.micro
:ssm_role: "IAM Role used by SSM"
:command_timeout: 18000
:region_data:
- :region: ap-south-1
  :ami_id: ami-995c23f6
  :key: mumbai-loadtesting
  :node_count: 3
  :commands:
  - 'ab -r -s 300 -c 10 -n 100 "http://example.com/"'
- :region: us-east-1
  :ami_id: ami-34193d22
  :key: loadtesting
  :node_count: 2
  :commands:
  - 'ab -r -s 300 -c 10 -n 100 "http://example.com/" && ab -r -s 300 -c 10 -n 100 "http://example.com/new_url"'

You can add more regions to the yml if you want to, in the same format. Additionally you can run any command on the EC2 instance by changing it in the config file. You can execute multiple commands using the && separator as well.

The details for all the other config values have been provided above.

Disclaimer

Use this as you want in an ethical manner. I hope that you are not going to use this for a DDOS attack by creating huge amounts of traffic for a website which is not yours.

Additionally please verify that all your EC2 instances have been successfuly terminated after the script finishes running. I don't want to be cursed for your AWS bill due to some unhandled exception in the code ;)

Licence

Do What the Fuck You Want to License! Just that I do not accept any liability arising from it.

In fact other people have thought about it as well and drafted it here: WTFPL

fire_at_will's People

Contributors

amitsaxena avatar

Watchers

 avatar James Cloos avatar

Forkers

ritikasri23

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.