avialxee / rgbmaker-web

rgbmaker for #RADatHomeIndia is a python-based astronomy web app to communicate with different astronomical services to generate images and fetch data from Skyview, Vizier, NVAS, NED etc

Hi there 👋

https://avialxee.github.io

https://resume.github.io/?avialxee

rgbmaker-web's Issues

log scaling for optical images

currently, we are using sqrt scaling

Cap on Image Size (Radius)

Suggesting a cap on the image size at 2 degrees. Even 3 degrees takes a server load and does not return anything. Plus the contours go all over the place when zoomed out so much. I tried with radius sizes 2, 3, 5, 10, 15, 50, 100. Max was 2.

Would be nice to have an info box for this too, saying the maximum input value is 2.0

Make separate space for NVAS.

Make a separate space for the NVAS images regardless of available or not. Also add a color, probably red to indicate no NVAS images found to make it more user-friendly? Or a messagebox probably?

Add elliptical regions from catalog

show elliptical regions for the NVSS and TGSS catalog

separate images for Optical and ROR

all the four images being saved as a single image, that make the visibility of features in the Facebook posts a bit difficult, it's ok to get back to optical RGB and IOU RGB combined and 2nd image ROR images

create docker package

A docker package will be used to deploy the app on the google cloud platform or a similar cloud service.

table for vizier catalog

need to show a table with numbers and flux values and beamwidth information for TGSS data fetched from vizier

Request to interchange archives and images

Not everyone uses archives, so it would make logical sense for images dropdown to come before the archives dropdown. It is nothing breaking, just a QoL improvement.

front end control

• for annotation

merge nginx with gunicorn in docker

current docker image uses gunicorn only, which is an application server. We can use nginx for web server

add link for NED

communicate with NED to show NED table

error for object name 3c33.1

No images found was returned from skyview
NVAS returned results and

from server logs:
2021-06-04T17:56:51.658540+00:00 heroku[router]: at=error code=H12 desc="Request timeout" method=POST path="/api" host=sky.radathomeindia.org request_id=ea32aacf-c604-42d1-93ee-817f04a9eebb fwd="xxxxxxxxxxx.ip" dyno=web.1 connect=0ms service=30005ms status=503 bytes=0 protocol=http

request timed out, need to add that in error handling

Failing deployment

400 Bad request

Widgets don't load in with page.

The Name, position, etc. widgets do not load in with the page.

1. The show widgets have to be pressed for the widgets to load in.
2. When pressed, the show widgets labels turn into initializing widgets and take about 20 seconds to load in.
3. Same behavior has been seen across Chrome and Safari.

This issue does not take place once every 15 or so tries. So it happens 14 out of 15 times.

HTTP and HTTPS cross access

Mixed Content: The page at 'https://radathomeindia.org/rgbmaker-new' was loaded over HTTPS, but requested an insecure XMLHttpRequest endpoint 'http://sky.radathomeindia.org/api'. This request has been blocked; the content must be served over HTTPS.
send @ jquery.min.js:2

connect to the server

as soon someone accesses the RGB maker form via API, there should be a request to the server to connect and stay alive
giving message:

• connecting
• connected

Overhaul Error displays

Error displays are not very prominent. Probably would be better to add a messagebox instead.

astropy cache management needed: culprit for worker shutdown

astropy cache problem is the culprit for worker failing to boot

2022-08-01 03:49:27.872 [flask_avialxee] web.1 State changed from starting to up
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "/app/.heroku/python/lib/python3.7/site-packages/gunicorn/arbiter.py", line 589, in spawn_worker
2022-08-01 03:49:30.279 [flask_avialxee] web.1     from rgbmaker.fetch import query as qu, save_fig
2022-08-01 03:49:30.279 [flask_avialxee] web.1     SkyView = SkyViewClass()
2022-08-01 03:49:30.279 [flask_avialxee] web.1     mod = importlib.import_module(module)
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "/app/.heroku/python/lib/python3.7/site-packages/gunicorn/app/wsgiapp.py", line 58, in load
2022-08-01 03:49:30.279 [flask_avialxee] web.1     return self.load_wsgiapp()
2022-08-01 03:49:30.279 [flask_avialxee] web.1 [2022-08-01 03:49:30 +0000] [10] [ERROR] Exception in worker process
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
2022-08-01 03:49:30.279 [flask_avialxee] web.1     worker.init_process()
2022-08-01 03:49:30.279 [flask_avialxee] web.1     from .core import SkyView, SkyViewClass
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "/app/.heroku/python/lib/python3.7/os.py", line 223, in makedirs
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "/app/.heroku/python/lib/python3.7/site-packages/astroquery/skyview/core.py", line 24, in __init__

2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "/app/.heroku/python/lib/python3.7/site-packages/gunicorn/workers/base.py", line 146, in load_wsgi
2022-08-01 03:49:30.279 [flask_avialxee] web.1     return _bootstrap._gcd_import(name[level:], package, level)
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
2022-08-01 03:49:30.279 [flask_avialxee] web.1     super(SkyViewClass, self).__init__()
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "/app/.heroku/python/lib/python3.7/importlib/__init__.py", line 127, in import_module
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "/app/.heroku/python/lib/python3.7/site-packages/gunicorn/app/wsgiapp.py", line 48, in load_wsgiapp
2022-08-01 03:49:30.279 [flask_avialxee] web.1     from astroquery.skyview import SkyView as skv
2022-08-01 03:49:30.279 [flask_avialxee] web.1     return util.import_app(self.app_uri)
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "<frozen importlib._bootstrap>", line 983, in _find_and_load
2022-08-01 03:49:30.279 [flask_avialxee] web.1     self.load_wsgi()
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "/app/.heroku/python/lib/python3.7/site-packages/astroquery/skyview/core.py", line 334, in <module>
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "/app/.heroku/python/lib/python3.7/site-packages/rgbmaker/__init__.py", line 5, in <module>
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "/app/.heroku/python/lib/python3.7/site-packages/gunicorn/util.py", line 359, in import_app
2022-08-01 03:49:30.279 [flask_avialxee] web.1     mkdir(name, mode)
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "/app/.heroku/python/lib/python3.7/site-packages/astroquery/query.py", line 167, in __init__
2022-08-01 03:49:30.279 [flask_avialxee] web.1     self.callable = self.load()
2022-08-01 03:49:30.279 [flask_avialxee] web.1     self.wsgi = self.app.wsgi()
2022-08-01 03:49:30.279 [flask_avialxee] web.1     os.makedirs(self.cache_location)
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "/app/app.py", line 4, in <module>
2022-08-01 03:49:30.279 [flask_avialxee] web.1 [2022-08-01 03:49:30 +0000] [10] [INFO] Worker exiting (pid: 10)
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "/app/.heroku/python/lib/python3.7/site-packages/gunicorn/workers/base.py", line 134, in init_process
2022-08-01 03:49:30.279 [flask_avialxee] web.1 FileExistsError: [Errno 17] File exists: '/app/.astropy/cache/astroquery/SkyView'
2022-08-01 03:49:30.279 [flask_avialxee] web.1 Traceback (most recent call last):
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "<frozen importlib._bootstrap_external>", line 728, in exec_module
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "/app/.heroku/python/lib/python3.7/site-packages/gunicorn/app/base.py", line 67, in wsgi
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "/app/.heroku/python/lib/python3.7/site-packages/astroquery/skyview/__init__.py", line 16, in <module>
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "/app/.heroku/python/lib/python3.7/site-packages/gunicorn/arbiter.py", line 589, in spawn_worker
2022-08-01 03:49:30.279 [flask_avialxee] web.1     from rgbmaker.fetch import query as qu, save_fig
2022-08-01 03:49:30.279 [flask_avialxee] web.1     SkyView = SkyViewClass()
2022-08-01 03:49:30.279 [flask_avialxee] web.1     mod = importlib.import_module(module)
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "/app/.heroku/python/lib/python3.7/site-packages/gunicorn/app/wsgiapp.py", line 58, in load
2022-08-01 03:49:30.279 [flask_avialxee] web.1     return self.load_wsgiapp()
2022-08-01 03:49:30.279 [flask_avialxee] web.1 [2022-08-01 03:49:30 +0000] [10] [ERROR] Exception in worker process
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
2022-08-01 03:49:30.279 [flask_avialxee] web.1     worker.init_process()
2022-08-01 03:49:30.279 [flask_avialxee] web.1     from .core import SkyView, SkyViewClass
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "/app/.heroku/python/lib/python3.7/os.py", line 223, in makedirs
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "/app/.heroku/python/lib/python3.7/site-packages/astroquery/skyview/core.py", line 24, in __init__
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "/app/.heroku/python/lib/python3.7/site-packages/gunicorn/workers/base.py", line 146, in load_wsgi
2022-08-01 03:49:30.279 [flask_avialxee] web.1     return _bootstrap._gcd_import(name[level:], package, level)
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
2022-08-01 03:49:30.279 [flask_avialxee] web.1     super(SkyViewClass, self).__init__()
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "/app/.heroku/python/lib/python3.7/importlib/__init__.py", line 127, in import_module
2022-08-01 03:49:30.279 [flask_avialxee] web.1   File "/app/.heroku/python/lib/python3.7/site-packages/gunicorn/app/wsgiapp.py", line 48, in load_wsgiapp
2022-08-01 03:49:30.279 [flask_avialxee] web.1     from astroquery.skyview import SkyView as skv
2022-08-01 03:49:30.279 [flask_avialxee] web.1     return util.import_app(self.app_uri)
2022-08-01 03:49:33.403 [flask_avialxee] web.1 [2022-08-01 03:49:33 +0000] [9] [INFO] Worker exiting (pid: 9)
2022-08-01 03:49:33.404 [flask_avialxee] router web.1 503 GET sky.radathomeindia.org /static/media/logo.png 2405:204:140c:b0c2:3164:a75f:926a:2998 at=error code=H13 desc="Connection closed without response" method=GET path="/static/media/logo.png" host=sky.radathomeindia.org request_id=dcda1eae-52df-4b1b-900b-0561f3945cb8 fwd="2405:204:140c:b0c2:3164:a75f:926a:2998,172.69.239.154" dyno=web.1 connect=0ms service=3834ms status=503 bytes=0 protocol=http
2022-08-01 03:49:33.682 [flask_avialxee] web.1 [2022-08-01 03:49:33 +0000] [4] [INFO] Reason: Worker failed to boot.

Multithreading any good? Potential risk of overloaded server

current flask fetching script known as smv.py uses multithreading exposing risk of multiple threads running in background!

Info button does not work.

The info button on the fields [?] does not do anything when pressed.

Maximum value of the radio surveys

Need a new feature to show maximum values of surveys

• TGSS,
• NVSS,
• FIRST

Show more information in output

• coordinates in RA DEC
• survey min value

add figure caption on top

ROR-RGB-C: TGSS(GMRT)-DSS2-NVSS(VLA)-NVSS
ROR-RGB-C: TGSS(GMRT)-DSS2-NVSS(VLA)-TGSS
IOU-RGB-C: WISE(22)-DSS2(red)-GALEX(NUV)-TGSS
Optical-RGB-C: DSS2(IR)-DSS2(Red)-DSS2(blue)-TGSS
please use this as top figure caption

from sir

Name field limitation needed

There should be an upper limit on how many characters are to be entered in the name field. Having a large name makes it so that the name field is not shown on the image. I have not checked the upper limit yet, just a random string to see if it can be broken.

I will update in comments once I find out the upper limit.

Show how to use the tool

using a pop-up or a bullet list, in the end, should have instructions on how to use the tool

contour error forces contour even when below 3 sigma

The contour should not be generated when it is below 3 sigmas, currently, if there is a source with below 3 sigma emission contour is made from 3 sigmas to below 3 sigma showing weird lines all over the frame.

Interactive images

This can be achieved possibly by JS in an API fetched image environment:

• Cursor hover tells the coordinate of the hover area
• Locks coordinate when a click event happens