bitnom / colabctl Goto Github PK

Google Colaboratory background/task executioner & controller.

License: GNU General Public License v3.0

Python 100.00%

python python3 google-cloud google-colaboratory google-colab colaboratory colab machine-learning

colabctl's Introduction

colabctl v0.2.1

Task executioner & controller for Google Colaboratory notebooks. Google Colaboratory is a game-changing innovation. It allows anyone to access powerful hardware for machine learning, for free. Unfortunately, it's not possible to run colab notebooks programmatically or otherwise in the background unless you leave your browser running. Colabctl is a sort of shim that solves this problem by using headless Selenium.

BROKEN NOTICE

After realizing a few issues being submitted, I reran the code and saw that there are a few new issues due to Google changing their code. I'm now working to correct them. It shouldn't take too long, depending on what exactly they've done.

TODOs

Resolve issues #1 #2 #3 #4
Async execution of tasks.
Proper module structure for user command install via pip.
Better args parsing.
Revise & refactor the Seleium code.
Proper logging.

Pull requests welcomed.

Usage

First, add your Colaboratory URLs to notebooks.csv.

In colab, go to tools -> keyboard shortcuts and set "Clear all outputs" to CTRL + SHIFT + Q

In colab, go to tools -> keyboard shortcuts and set "Reset all runtimes" to CTRL + SHIFT + k

At the end of your notebook, add: print("forkin"+"me")

Now you're ready:

python colabctl.py <end-string> <sleep-seconds>

Example:

python colabctl.py forkinme 1800

Important!!!

Notice that the example delay is 1,800 seconds (30 minutes). Please DO NOT poll Google Colaboratory frequently. We're very lucky to have these notebooks and even luckier that this ctl is even possible. Please don't push them to block us from doing this.

Thank you

colabctl's People

Contributors

Stargazers

Watchers

colabctl's Issues

installation and execution instructions

Your script seems to be what I have been looking for, but after several (ok, many) failed attempts I am wondering if you can post some additional instructions (for newbies) on installing and running this?

Is this project dead? Is there an alternative?

Thanks! but your usage instruction is not clear

Hello,

I could not understand your usage instruction.

First, add your Colaboratory URLs to notebooks.csv.

-> I created notebooks.csv through google spreadsheet, and put my notebook's url which i need to schedule.

In colab, go to tools -> keyboard shortcuts and set "Clear all outputs" to CTRL + SHIFT + Q

Done

In colab, go to tools -> keyboard shortcuts and set "Reset all runtimes" to CTRL + SHIFT + k

There is nothing like reset all runtimes. But there is restrart runtime and run all cells. I have added this shortcut there. Dont know if i am right.

At the end of your notebook, add: print("forkin"+"me")

you mean in the notebook which i need schedule running?

**Now you're ready:

python colabctl.py

Example:

python colabctl.py forkinme 1800**

Completely not understood the above... Kindly be clear so that your work will be useful to everyone.

Waiting for your response.

Thank you for your support

Couldn't set my keyboard shortcut to CTRL + SHIFT + K for some reason, changed it to CTRL + SHIFT + J in my python file.

Can this run on github action?

Not working, got stuck during init

Cookie is not being saved - script stuck

Hello,

I tried to run the script, but I see that it is getting stuck here: https://github.com/TensorTom/colabctl/blob/master/colabctl.py#L148

When I run the script, the google auth page comes up. I put my credentials (I also have two factor authentication setup), and then the script halts. I assume the XPath is not finding wherever the cookie is set. Is there a way to save the cookie manually in gCookies.pkl file?