threefoldtecharchive / jumpscalex_archived

Development:

Jumpscale

Jumpscale is a cloud automation product and a branch from what used to be Pylabs. About 9 years ago Pylabs was the basis of a cloud automation product which was acquired by SUN Microsystems from Q-Layer. In the mean time we are 4 versions further and we have rebranded it to Jumpscale. Our newest release is version 10, called JSX.

• Jumpscale
  • About Jumpscale
  • Installing Jumpscale
  • Usage
  • Tutorials
  • Collaboration Conventions

About Jumpscale

Some tools available in jumpscale

• Config Manager The config manager is a secure way to manage configuration instances. Anything saved to the file system is NACL encrypted and only decrypted on the fly when accessed.

• Executors Jumpscale comes with its own executors that abstract working locally or remotely. Of these executors:

  • SSH Executor (for remote execution)
  • Local Executor (for local execution)
  • Docker Executor (for executing on dockers)

• Builders Builder tools is a set of tools to perform the common tasks in your builder (e.g read a file , write to a file, execute bash commands and many other handy methods that you will probably need in your builder)
  To create a builder see [documentation](docs/howto/Create\ a\ new\ Builder.md)

Getting Started

Get up to speed by following these simple steps.

Installing Jumpscale

See documentation

Usage

• Kosmos in your terminal, type kosmos

• In Python

  python3 -c 'from Jumpscale import j;print(j.application.getMemoryUsage())'

  the default mem usage < 23 MB and lazy loading of the modules.

Running Tests

To run unittests you can execute the following command

source /sandbox/env.sh; pytest /sandbox/code/github/threefoldtech/jumpscaleX/

You can also run Integration tests by running the command

source /sandbox/env.sh; pytest  --integration /sandbox/code/github/threefoldtech/jumpscaleX/

To annotate the one of your tests is an itegeration test rather than a unittests, you can add the following docorator to the test

@pytest.mark.integration
def test_main(self)

Tutorials

Check Documentation

Collaboration

please read more here about how to collaborate

jumpscalex_archived's Issues

intercom client

implement a proper client using config mgmt

• implement j.client
  • learn how to do it in template for client

j.clients.github

• config manager
• basic test

kraken

make sure client is properly implemented

• implement j.client using our new config mgmt
  • learn how to do it in template for client

portal client

make sure client is properly implemented

• implement j.client using our new config mgmt
  • learn how to do it in template for client

j.clients.zhub

• implement a test
• use new config manager

j.clients.coredns

• new config mgr

postgresql client

make sure client is properly implemented

• implement j.client using our new config mgmt
  • learn how to do it in template for client

provide automated integration tests of the tfchain JS client using a private devnet

This should test all features, common scenarios, full usage chains/paths and edge cases. Ideally it can be run and executed by running just a single command, in a clean and isolated environment.

For development purposes it might probably also be nice to be able to select which tests to run, as it might otherwise slow down development (and debugging of an issue) significantly.

clients/gdrive/GDrive.py

• does not use right paradigm, needs to use proper factory class
• use config manager
• basic test

j.clients.btc_alpha

• new config mgr
• basic test to connect
• readme

mail client

make sure client is properly implemented

• implement j.client using our new config mgmt
  • learn how to do it in template for client

rogerthat client

make sure client is properly implemented

• implement j.client using our new config mgmt
  • learn how to do it in template for client

j.clients & builder .graphite

• config manager
• server.install()
• basic test

trello client

make sure client is properly implemented

• implement j.client using our new config mgmt
  • learn how to do it in template for client

Ability for the btc_electrum client to create a wallet using a Master Public Key

as defined in https://github.com/threefoldtech/rivine/blob/master/specs/webshop.md

ovh client

make sure client is properly implemented

• implement j.client using our new config mgmt
  • learn how to do it in template for client

j.clients.packetnet.test()

need to use new config manager as well

zerostor builder/client [development_zstor]

• implement j.client
  • learn how to do it in template for client
• implement j.builder....
  • learn how to do it in template

remarks

• call j.builders.golang.install()
• build the server & client
• implement some tests
• call the client

virtualbox client

make sure client is properly implemented

• implement j.client using our new config mgmt
  • learn how to do it in template for client

j.clients.currencylayer

config manager

synchting client

make sure client is properly implemented

• implement j.client using our new config mgmt
  • learn how to do it in template for client

j.clients/builder.influxdb

• config manager
• implement installer & basic test

clients/gitea

• don't use python classes for data, use new config manager (uses BCDB behind)
• this will hugely simplify it

openvcloud client

make sure client is properly implemented

• implement j.client using our new config mgmt
  • learn how to do it in template for client

j.clients/builder.grafana

• config manager
• implement installer
• implement test

telegram bot

make sure client is properly implemented

• implement j.client using our new config mgmt
  • learn how to do it in template for client

j.clients.google_compute

• basic test
• config manager

s3 builder/client

• implement j.client
  • learn how to do it in template for client
• implement j.builder....
  • learn how to do it in template

remarks

• build our own S3 server
• package (easy is golang)
• call j.builders.golang.install() (because need it to build this)

TF Directory

make sure client is properly implemented

• implement j.client using our new config mgmt
  • learn how to do it in template for client

IYO client

make sure client is properly implemented

• implement j.client using our new config mgmt
  • learn how to do it in template for client
    @

kubernetes client

make sure client is properly implemented

• implement j.client using our new config mgmt
  • learn how to do it in template for client

packetnet client

make sure client is properly implemented

• implement j.client using our new config mgmt
  • learn how to do it in template for client

mongodbclient

make sure client is properly implemented

• implement j.client using our new config mgmt
  • learn how to do it in template for client

ipmi client

make sure client is properly implemented

• implement j.client using our new config mgmt
  • learn how to do it in template for client

self.__jslocation__ -> class

look for all instances of

self.jslocation =

needs to become like

BEFORE

from Jumpscale import j


class PacketNetFactory(j.application.JSFactoryBaseClass):

    def __init__(self):
        self.__jslocation__ = "j.clients.packetnet"
        self.__imports__ = "packet"
        self.connections = {}
        JSConfigFactory.__init__(self, PacketNet)

    def interactive_test(self):
        from IPython import embed
        embed(colors='Linux')

NEEDS TO BECOME

from Jumpscale import j
from .PacketNet import PacketNet

class PacketNetFactory(j.application.JSFactoryBaseClass):
    __jslocation__ = "j.clients.packetnet"
    _CHILDCLASS = PacketNet


    def __init(self):
        self.connections = {}

• notice: _init

etcd builder/client

• implement j.client
  • learn how to do it in template for client
• implement j.builder....
  • learn how to do it in template

redis builder/client

• check j.client.redisconfig
  • learn how to do it in template for client
• implement j.builder....
  • learn how to do it in template
  • build & sandbox

zdb builder/client

make sure client is properly implemented

• implement j.client using our new config mgmt

  • learn how to do it in template for client

• builder see templates in builder dir

clients/blockchain

• use new config manager everywhere
• do some basic tests

mongodb

• implement j.client

  • learn how to do it in template for client

• implement j.builder....

  • learn how to do it in template

• rename directory just to mongo

postgresql

• implement j.client
  • learn how to do it in template for client
• implement j.builder....
  • learn how to do it in template

zerotier builder/client

• implement j.client
  • learn how to do it in template for client
• implement j.builder....
  • learn how to do it in template

remarks

• all on ub 1804
• build zerotier
• implement methods on the server to configure (acts as a sal)
• also the own controller

racktivity client

make sure client is properly implemented

• implement j.client using our new config mgmt
  • learn how to do it in template for client

j.clients.sshkey.test

js_shell 'j.clients.sshkey.test()'

fix/test

j.clients.etcd

• config manager new
• basic test

j.clients.ovh.test()

als make sure we use the new config manager

tarantool

• implement j.client
  • learn how to do it in template for client
• implement j.builder....
  • learn how to do it in template

mysql client

make sure client is properly implemented

• implement j.client using our new config mgmt
  • learn how to do it in template for client

j.clients.zos_protocol.test()

mysql

• implement j.client
  • learn how to do it in template for client
• implement j.builder....
  • learn how to do it in template