desihub / desilo

DESI Lead Observer Sandbox

desilo

This repository is now largely used by the Observing Operations team to develop tools to manage operations. It has been used in the past to develop other tools used by Lead Observers.

• DESI-Night-Logs: no longer used. It is kept here to maintain OS/DQS structure of the past. The NightLog code can now be found here: https://github.com/desihub/desinightlog
• reporting: Contains code and data used for weekly and monthly reporting of time use during nightly operations
• obs_stats: Contains code and data to establish observing metrics
• ops_tool: Contains the observing schedule and tools to help communicate with observers
  • OpsTool and OpsTool/auto_ops_tool.py: used to send emails to observers and keep track of observer preparation, including VPN access
  • OpsViewer: app running at NERSC to display the daily observing schedule. App run through Spin Services. Can be accessed here: https://obsschedule.desi.lbl.gov

desilo's Issues

Autofilled ephemerides for the Moon are wrong.

The ephemerides that appear in the night log don't match those computed by Skycalc and are completely wrong for the Moon. E.g. for the night of 31 March 2021

Date (eve/morn) JDmid LMSTmidn ---------- Sun: --------- LST twilight: ------------- Moon: --------------
(2021 at start) (-2450000) set twi.end twi.beg rise eve morn rise set %illum RA Dec
Wed Mar 31/Thu Apr 01 9305.8 12 13 03 18 50 20 09 4 52 6 10 8 21 17 05 22 24 ..... 82 15 57.8 -19 55

whereas the log has
sunset: 18:45
18(o) twilight ends: 20:07
18(o) twilight ends: 04:51
sunrise: 06:14
moonrise: 04:17
moonset: 16:07
Illumination: 0.795

Allow for multiple entries in End fo Night Summary

Other comments warning/acknowledgment fix

When submit a comment or problem, the warning and/or acknowledgement is buggy

Simplify Select/Enter for DQS Exposures

As is currently implemented for OS, make it so that selecting from the list populates the box.

Make sure all names work with Select tool

Currently seems that names longer than 2 words throw an error

Make name inputs one line

There will likely be many errors from people entering both Last and First name in one box. Might as well just change it.

Let Experts enter Comments

Using Other form, let experts submit comments, problems, etc.

Update on the Nightly Progress tab

Leave every option of fields, remove the pull down menu differentiation between "Start Up / Cal / Obs / Comment".

Only leave timestamp as mandatory.
Reflect changes by having only one section in nighlty progress as opposed to Start Up v. Rest of the Night.

Add a "Load" button next to the "Now" button in order to modify a given entry.

Combine NIght Progress by Exposure

Currently, split up by observer (OS, DQS, Other) and listed by time. We can list things by time OR exposure number and have all comments for a certain exposure be combined.

DQS entries

DQS entries display only local time, not UTC.

Include input for comments in checklists

automatic regeneration of current night log

Changes in exposure table

Suggestions from A.D. :

Add columns:
LOCAL TIME when exposure sequence started (this should be the first column)
TILEID - third column?
AIRMASS
SEEING
TRANSPARENCY

Remove first two columns.

Add list of exposures

Rather than having observers input exposure numbers, have a pre-filled list to choose from. These will have to be taken from the NightWatch directory

Include drop down list of most recent logs initialized

Add exposure number to problem inputs

Have an exposure number attached to a problem, if the problem occurs during a certain exposure. Have this link to the exposure table as well.

Single character cursor jumps

On the KPNO OS intake, Nightly Progress tab: For the exposure number fields and tile number field (but not the comment/remark field), when I have typed in a number, if I move the cursor away from the end of the string, then the first character I type will appear in the desired location. But then the cursor jumps back to the end of the string, so the second character appears there.

I am using Safari v13.1.2 (so maybe doesn't appear with more recent browsers?).

Have ability to add pictures

Make sure can add in pictures/images to NightLog.

Nightly progress section for OS_Report: change some of the types

rename calibration to Spectrograph calibration? Arcs or twilight?

add NOW button

Sometimes instead of entering the time, you just want it to be "now". Can add a button for that.

add list of eLog exposures to end of report

Have the ongoing view of the NightLog show a view of all exposures from the eLog

Get Nightlog working on NERSC

Wrong User ID-ed when committing from desiobserver

When committing changes from desiobserver@desi-16, the commits are listed on Github as coming from "[email protected]" even though I put in my (SGG) username and password when committing the changes.
This happened while working on DESI_Night_Logs from desi-16.

Display contents of a given timestamp

Get option to overwrite and can use the displayed contents to copy and paste.

this requires checking if an input was already made

Include ephemerides automatically

Instead of having the observer fill in the ephemerides info, have that info input automatically. This can be done with DOSlib.sky_calc now.

Include better error messages when tyring to join or initialize a Night Log

Fix end of month turnover for telemetry plots

Telemetry plot data pulled from DB for night - night+1. This doesn't work at the end of the month. Needs to be fixed. Fine for the rest of January :)

Add plots to Night Log report

Some options:
seeing, pointing - RA&DEC, transparency, airmass, wind, humidity, temps

Just pull data from DB at end of night and plot them against time. There are places to find these plots throughout the night but nice to have them with the summary.

Better error descriptions

Especially for time input

Tile type = None

Currently, there's no option for a "None" or "Other" tile type in the OS Report under Observation

Convert email nightlog exposure lists to tables, not graphics

The desi-nightlog Night Summary emails (which I think are generated by inputs traced to desilo/DESI_Night_Logs) include the exposure list as attached pngs, which means that they aren't searchable, cut-and-pastable, and they include cut-off program names. Please update to having those exposure lists as formatted table text within the email itself.

If this isn't the right place for tracking nightlog interface issues, please point me in the right direction. Thanks.

Weather tab

"Weather tab" --> "Observing Conditions"

Only leave description as manual input, pull the telemetry for the rest (consider adding seeing and transparency).
Time as mandatory value.
A.D. suggestion: add links to weather info, or to wiki page describing where to get weather info

Make time input more clear

change format from HHMM to HH:MM and put notes on time format on every page

Make it clear that can't input data to initialize log from DQS

There are text input boxes on teh DQS data initialization page, but they are intended just to show the informaiton. This should be changed because it is confusing.

Identify required inputs

In addition to this, have a message appear when you haven't input enough information.

Character limit for comment

Character limit for entries is too small in cases where Klaus sends over a recap of his activities.
Character limit should be increased.