jiveyguy / meteorite_data_mine

For NMSU CS 488

For NMSU CS 488 Fall 2023 with Instructor: Dr. Tuan Le

Setup Instructions

Linux

1. Clone the repository to a machine which has a local display (Does not work on a remote server headlessesly)

git clone https://github.com/JiveyGuy/Meteorite_Data_Mine.git

2. cd into the directory

cd Meteorite_Data_Mine

3. Setup a python virtual env

python3 -m venv .venv

4. Activate the environment

source .venv/bin/activate

5. Install dependencies

pip install -r requirements_linux.txt

6. Open the notebook in Visual Studio Code or in a Jupyter notebook.

   • How to open in a Jupyter Notebook

     1. From terminal:

     jupyter-lab

     3. Navigate to "http://localhost:8888/" in a web browser.

     4. After it logs you in select project.ipynb on the left file menu.

Other Documents

There are other doucemnt to help you get started with this repostiory:

• Guide on contributing

meteorite_data_mine's Issues

Security Alert

Got a notification that some packages here are insecure, but google censored the alert (maybe their own backdoor?) https://nvd.nist.gov/vuln/detail/CVE-2023-5129#VulnChangeHistorySection

Proposal Assignment

Let's begin writing our proposal!

I will make a branch for documentation and push a draft LaTeX file.

Installing dependencies breaks on Linux

I realize its only been tested on windows. I'm just submitting this for documentation reasons.

When installing the dependencies using pip on linux the project breaks. Here is the output.

2023-09-13 13:02:12.584 [info]   Downloading pytz-2023.3-py2.py3-none-any.whl (502 kB)

2023-09-13 13:02:12.656 [info]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 502.3/502.3 kB 7.4 MB/s eta 0:00:00
2023-09-13 13:02:12.657 [info] 

2023-09-13 13:02:12.824 [info] Collecting pyvista==0.41.1 (from -r /home/ugrad10/zarafat/src/Metorite_Data_Mine/requirements_widnows11.txt (line 48))

2023-09-13 13:02:12.824 [info]   Obtaining dependency information for pyvista==0.41.1 from https://files.pythonhosted.org/packages/70/3f/88bae63eee660f28d5f648d3026fb8a9b125c067cdd956c57bebfa67de91/pyvista-0.41.1-py3-none-any.whl.metadata

2023-09-13 13:02:12.844 [info]   Downloading pyvista-0.41.1-py3-none-any.whl.metadata (13 kB)

2023-09-13 13:02:12.951 [info] ERROR: Ignored the following versions that require a different python version: 1.21.2 Requires-Python >=3.7,<3.11; 1.21.3 Requires-Python >=3.7,<3.11; 1.21.4 Requires-Python >=3.7,<3.11; 1.21.5 Requires-Python >=3.7,<3.11; 1.21.6 Requires-Python >=3.7,<3.11

2023-09-13 13:02:12.952 [info] ERROR: Could not find a version that satisfies the requirement pywin32==306 (from versions: none)

2023-09-13 13:02:12.952 [info] ERROR: No matching distribution found for pywin32==306

2023-09-13 13:02:13.151 [info] Traceback (most recent call last):
  File "/home/ugrad10/zarafat/.vscode-server/extensions/ms-python.python-2023.16.0/pythonFiles/create_venv.py", line 77, in run_process

2023-09-13 13:02:13.151 [info]     subprocess.run(args, cwd=os.getcwd(), check=True)
  File "/usr/lib64/python3.11/subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['/home/ugrad10/zarafat/src/Metorite_Data_Mine/.venv/bin/python', '-m', 'pip', 'install', '-r', '/home/ugrad10/zarafat/src/Metorite_Data_Mine/requirements_widnows11.txt']' returned non-zero exit status 1.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ugrad10/zarafat/.vscode-server/extensions/ms-python.python-2023.16.0/pythonFiles/create_venv.py", line 232, in <module>

2023-09-13 13:02:13.151 [info]     main(sys.argv[1:])
  File "/home/ugrad10/zarafat/.vscode-server/extensions/ms-python.python-2023.16.0/pythonFiles/create_venv.py", line 228, in main
    install_requirements(venv_path, args.requirements)
  File "/home/ugrad10/zarafat/.vscode-server/extensions/ms-python.python-2023.16.0/pythonFiles/create_venv.py", line 97, in install_requirements

2023-09-13 13:02:13.152 [info]     run_process(
  File "/home/ugrad10/zarafat/.vscode-server/extensions/ms-python.python-2023.16.0/pythonFiles/create_venv.py", line 79, in run_process
    raise VenvError(error_message)
VenvError: CREATE_VENV.PIP_FAILED_INSTALL_REQUIREMENTS

2023-09-13 13:02:13.165 [error] Error while running venv creation script:  CREATE_VENV.PIP_FAILED_INSTALL_REQUIREMENTS
2023-09-13 13:02:13.165 [error] CREATE_VENV.PIP_FAILED_INSTALL_REQUIREMENTS

Visualizing data

currently working on a visualization using 3d geovista, any proposed alternatives or thoughts from contributors?

Misspelling of Meteorite

I realize now I have been spelling meteorite wrong! I don't use the word often so never realized the extra 'e'.

Will work on cleaning up places where the wrong version appears, already renamed the repo.

Running notebook breaks when attempting to run remotely.

It looks like you have to have an display on the machine running the code. I could not run this cell when running on a remote machine. This might not have a solution other than running locally.

[/home/ugrad10/zarafat/src/Metorite_Data_Mine/.venv/lib64/python3.11/site-packages/pyvista/plotting/plotter.py:149](https://vscode-remote+ssh-002dremote-002bbrooks-002ecs-002enmsu-002eedu.vscode-resource.vscode-cdn.net/home/ugrad10/zarafat/src/Metorite_Data_Mine/.venv/lib64/python3.11/site-packages/pyvista/plotting/plotter.py:149): UserWarning: 
This system does not appear to be running an xserver.
PyVista will likely segfault when rendering.

Try starting a virtual frame buffer with xvfb, or using
  ``pyvista.start_xvfb()``

  warnings.warn(
[/home/ugrad10/zarafat/src/Metorite_Data_Mine/.venv/lib64/python3.11/site-packages/pyvista/jupyter/notebook.py:33](https://vscode-remote+ssh-002dremote-002bbrooks-002ecs-002enmsu-002eedu.vscode-resource.vscode-cdn.net/home/ugrad10/zarafat/src/Metorite_Data_Mine/.venv/lib64/python3.11/site-packages/pyvista/jupyter/notebook.py:33): UserWarning: Failed to use notebook backend: 

No module named 'trame'

Falling back to a static output.
  warnings.warn(
ERROR:root:bad X server connection. DISPLAY=
2023-09-13 13:12:50.625 (  10.181s) [         AC27740]vtkXOpenGLRenderWindow.:464    ERR| vtkXOpenGLRenderWindow (0x563c1d92b0a0): bad X server connection. DISPLAY=
Cannot execute code, session has been disposed. Please try restarting the Kernel.

Requirements

Current requirement are out of date I will fix at sooooome point.

First "install" cell is redundant.

The first cell with the install command is redundant if we are using requirements.txt file. I added setup instructions to the README file in #5