dirkpetersen / asm

ASM (Amazon Science Machine) is an AWS EC2 Linux machine with preinstalled software and good defaults for Scientists

ASM (Amazon Science Machine)

ASM (Amazon Science Machine) launches an AWS EC2 Linux machine with pre-compiled scientific software and good defaults for scientists. You can choose from the latest Amazon Linux, Redhat Enterprise (Rocky) or Ubuntu LTS. Your SSH keys will be generated automatically and if your sysadmin has setup a DNS zone you will also get a DNS name. You will be prompted for a storage location (S3 bucket) which will be mounted at /mnt/[bucket-name] as a quasi-filesystem using rclone. There is also a test file system using JuiceFS

Install:

curl -s https://raw.githubusercontent.com/dirkpetersen/asm/main/install.sh | bash

Config (for example setup the S3 bucket to use):

asm config 

Launch:

Config details

dp@grammy:~$ asm config
 Installing rclone ... please wait ... Done!

*** Asking a few questions ***
*** For most you can just hit <Enter> to accept the default. ***

*** Enter your email address: ***
  [Default: [email protected]]

*** Please confirm/edit the standard hostname prefix. Use something short like your initials or first name. All machines will have a hostname with this prefix followed by a number : ***
  [Default: dp]

*** Please confirm/edit S3 bucket name to be created in all used profiles.: ***
  [Default: asm-dp]
*** Please confirm/edit the root path inside your S3 bucket: ***
  [Default: dp]

  Verify that bucket 'asm-dp' is configured ...
Done!

Errors

expired SSO creds

 ./asm launch
Error retrieving instance types: Error when retrieving token from sso: Token has expired and refresh failed
No instances match the criteria. is the cheapest spot instance with at least 4 vcpus / 8 GB mem
Other Error: Error when retrieving token from sso: Token has expired and refresh failed
Other Error: Error when retrieving token from sso: Token has expired and refresh failed
Other Error: Error when retrieving token from sso: Token has expired and refresh failed

asm's Issues

better detection if ssh key is missing

better detection if ssh key is missing and should be automatically re-generated

ssh key /home/dp/.config/asm/cloud/asm-ec2-701747442027-peterdir.pem not found.
You can use option --force-sshkey to create a new one in AWS

rclone install fails

 Installing rclone ... please wait ... Traceback (most recent call last):
  File "/home/ec2-user/.local/bin/asm.py", line 4517, in <module>
    if main():
       ^^^^^^
  File "/home/ec2-user/.local/bin/asm.py", line 52, in main
    subcmd_config(args, cfg, aws)
  File "/home/ec2-user/.local/bin/asm.py", line 153, in subcmd_config
    cfg.copy_binary_from_zip_url(rclone_url, 'rclone',
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ec2-user/.local/bin/asm.py", line 4387, in copy_binary_from_zip_url
    shutil.copy2(binpath, targetfolder, follow_symlinks=True)
  File "/usr/lib64/python3.11/shutil.py", line 436, in copy2
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib64/python3.11/shutil.py", line 258, in copyfile
    with open(dst, 'wb') as fdst:
         ^^^^^^^^^^^^^^^
OSError: [Errno 26] Text file busy: '/home/ec2-user/.local/bin/rclone'