GithubHelp home page GithubHelp logo

rizac / stream2segment Goto Github PK

View Code? Open in Web Editor NEW
21.0 21.0 7.0 9 MB

A Python project to download, process and visualize medium-to-massive amount of seismic waveforms and metadata

License: GNU General Public License v3.0

Python 94.00% JavaScript 1.13% HTML 1.59% Jupyter Notebook 3.28%
angularjs data-visualization database download-manager fdsn-ws javascript pandas processing-ide python seismic-waves seismology sqlalchemy

stream2segment's People

Contributors

dbingfz avatar javiquinte avatar jessiemyr avatar rizac avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

stream2segment's Issues

download fail

Hello,

Stream2segment is well installed on my computer now, however I ran the following command :
s2s download -c download_test.yalm

and I get this error message:
OSError: [Errno 22] Invalid argument: 'C:\Users\mb269399\Documents\Stream2Segment\stream2segment\itest_1\download_test.yaml.2022-01-28T08:45:23.log'

the dburl in the config file is :
'sqlite:///C:\Users\mb269399\Documents\Stream2Segment\stream2segment\itest_1\db.sqlite'
or
'sqlite:///.\db.sqlite'
it gives the same error message.

Do you know how I can solve it ?

Thanks for your help.

Commit 95b2a52 on branch dev fails tests

================================================================================== short test summary info ===================================================================================
FAILED tests/download/test_u_download_01_events.py::Test::test_pbar1[sqlite] - KeyError: 'length'
FAILED tests/download/test_u_download_01_events.py::Test::test_pbar2[sqlite-args0] - KeyError: 'length'
FAILED tests/download/test_u_download_01_events.py::Test::test_pbar2[sqlite-args1] - KeyError: 'length'
FAILED tests/download/test_u_download_01_events.py::Test::test_pbar2[sqlite-args2] - KeyError: 'length'
FAILED tests/download/test_u_download_01_events.py::Test::test_pbar2[sqlite-args3] - KeyError: 'length'

ImportError: cannot import name 'isnull' from 'pandas.core.common' for modules in stream2segment

Hello !

First, thank you for the detailed explanation to instaling stream2segment package. I installed it on windows system and with some adjustments I managed to install it on my computer.

However, after the instalation was complete, I ran the test command you propose in the test part :
pytest -xvvv -W ignore ./tests/ and it rises the following error messages :

erreur_pandas_s2s

It doesn't find the function "isnull" of pandas, but when I go to the explanation of this function (https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.isnull.html) they give examples only with "isna" function, maybe isnull is not used anymore ? or I have to downgraded pandas ? I tried with the version 1.3.5 but it is not working either.

I also take a look at the script common.py in pandas/core/ and function isna is present and used but not isnull.

I use python version 3.9.9
numpy 1.21.5 because there are problems between the last version and obspy (obspy/obspy#2948)
obspy 1.2.2
pandas 1.4.0

Thanks for your help.

Possibility to give multiple events catalogue in download config file (eventws parameter) ?

Hello,

Finally I installed stream2segment on Windows and all working well.

We wonder if it's possible to define differents catalogue events in eventws parameter, as for dataws, It is an option of stream2segment download function ?
When I try to give several catalogues such as in the example below it doesn't work and give the error : Error: Invalid type for "eventws": string required.

Example:
eventws:

I try this too:
eventws: [ "http://www.isc.ac.uk/fdsnws/event/1/query" , "https://api.franceseisme.fr/fdsnws/event/1/query" ]

Thank you, and sorry to bother you again.

Margaux

Foreseen improvements and fixes for 2023-2024

[. ] Drop isf format for isc (see #41 ) Also decide the format parameter in events: is it added or not? in download.yaml we state one thing, in the code another one
[. ] add quakexml as well as stationxml to events / think about better naming
[. ] Refactor database: station identified by net-sta code. Implement migration scripts
[. ] auto adapt max_concurrent_downloads according to responses (*)
[.] simpler download config

(*) Refs:

From:

  • iris
  • http:[slash][slash]service.scedc.caltech.edu/fdsnws/dataselect/1/

2023-08-08 max_concurrent_downloads: null (auto)

Number of segments per data center url (row) and response type (column):
                                                 Segment  Internal         
                                 No       Url    Not      Server           
                           OK    Content  Error  Found    Error     TOTAL  
-------------------------  ----  -------  -----  -------  --------  -------
service.scedc.caltech.edu  2177   116244   1032    29853   5135721  5285027
service.iris.edu              3      144      0        0         0      147
TOTAL                      2180   116388   1032    29853   5135721  5285174

COLUMNS DETAILS:
 - OK: Data saved (download completed, no additional warning)
 - No Content: No data saved (download completed, the server returned 0 bytes of data)
 - Url Error: No data saved (download failed, generic url error: timeout, no internet connection, ...)
 - Segment Not Found: No data saved (download completed, segment data not found, e.g., in a multi-segment request)
 - Internal Server Error: No data saved (download failed: Server error, server response code 500)

2023-08-09 max_concurrent_downloads: 2

Number of segments per data center url (row) and response type (column):
                                                    Segment  Internal         
                                   No       Url     Not      Server           
                           OK      Content  Error   Found    Error     TOTAL  
-------------------------  ------  -------  ------  -------  --------  -------
service.iris.edu                0        3       0        0         0        3
service.scedc.caltech.edu  105840  3333588  388546  1332341      7262  5167577
TOTAL                      105840  3333591  388546  1332341      7262  5167580

COLUMNS DETAILS:
 - OK: Data saved (download completed, no additional warning)
 - No Content: No data saved (download completed, the server returned 0 bytes of data)
 - Url Error: No data saved (download failed, generic url error: timeout, no internet connection, ...)
 - Segment Not Found: No data saved (download completed, segment data not found, e.g., in a multi-segment request)
 - Internal Server Error: No data saved (download failed: Server error, server response code 500)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.