biolab / monroe-anal Goto Github PK

While loading data (dataframe attached in a zip file) through iPython Connector in Orange I got the following error:

Traceback (most recent call last):
  File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/Orange/data/variable.py", line 996, in parse
    value = float(datestr)
ValueError: could not convert string to float: '2018-02-27 00:02:47.952189+00:00'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/ricercando/orange_widgets/owipythonconnector.py", line 127, in on_file_changed
    self.output()
  File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/ricercando/orange_widgets/owipythonconnector.py", line 134, in output
    if isinstance(output_obj, type)), None)
  File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/ricercando/orange_widgets/owipythonconnector.py", line 134, in <genexpr>
    if isinstance(output_obj, type)), None)
  File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/ricercando/orange_widgets/util.py", line 50, in table_from_frame
    X.append(s.astype('str').replace('NaT', np.nan).map(tvar.parse).values)
  File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/pandas/core/series.py", line 2158, in map
    new_values = map_f(values, arg)
  File "pandas/_libs/src/inference.pyx", line 1574, in pandas._libs.lib.map_infer (pandas/_libs/lib.c:66652)
  File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/Orange/data/variable.py", line 1000, in parse
    raise ERROR
ValueError: Invalid datetime format '2018-02-27 00:02:47.952189+00:00'. Only ISO 8601 supported.

df.zip

With the following workflow: https://github.com/ivek1312/ricercando/blob/master/workflows/significance.ows

If "one second" granularity is selected for node 593 for time span 2017-10-14 00:00 to 2017-10-14 22:00 (Monroe Data) and "Event Type" selected as parameter for the test variable "RTT_low" (Significant Groups) the following error is thrown:

Error encountered in widget Significant Groups:

Traceback (most recent call last):
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/pandas/core/groupby.py", line 2178, in agg_series
return self._aggregate_series_fast(obj, func)
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/pandas/core/groupby.py", line 2198, in _aggregate_series_fast
result, counts = grouper.get_result()
File "pandas/_libs/src/reduce.pyx", line 407, in pandas._libs.lib.SeriesGrouper.get_result (pandas/_libs/lib.c:39105)
File "pandas/_libs/src/reduce.pyx", line 391, in pandas._libs.lib.SeriesGrouper.get_result (pandas/_libs/lib.c:38888)
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/pandas/core/groupby.py", line 842, in
f = lambda x: func(x, *args, **kwargs)
File "/Users/veljko/Documents/software/release/ricercando/ricercando/significance.py", line 155, in pval
for _ in range(N1_ITER)))
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/joblib/parallel.py", line 779, in call
while self.dispatch_one_batch(iterator):
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/joblib/parallel.py", line 620, in dispatch_one_batch
tasks = BatchedCalls(itertools.islice(iterator, batch_size))
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/joblib/parallel.py", line 127, in init
self.items = list(iterator_slice)
File "/Users/veljko/Documents/software/release/ricercando/ricercando/significance.py", line 155, in
for _ in range(N1_ITER)))
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/pandas/core/generic.py", line 2900, in sample
locs = rs.choice(axis_length, size=n, replace=replace, p=weights)
File "mtrand.pyx", line 1166, in mtrand.RandomState.choice
ValueError: Cannot take a larger sample than population when 'replace=False'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/pandas/core/groupby.py", line 2883, in aggregate
return self._python_agg_general(func_or_funcs, *args, **kwargs)
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/pandas/core/groupby.py", line 848, in _python_agg_general
result, counts = self.grouper.agg_series(obj, f)
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/pandas/core/groupby.py", line 2180, in agg_series
return self._aggregate_series_pure_python(obj, func)
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/pandas/core/groupby.py", line 2211, in _aggregate_series_pure_python
res = func(group)
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/pandas/core/groupby.py", line 842, in
f = lambda x: func(x, *args, **kwargs)
File "/Users/veljko/Documents/software/release/ricercando/ricercando/significance.py", line 155, in pval
for _ in range(N1_ITER)))
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/joblib/parallel.py", line 779, in call
while self.dispatch_one_batch(iterator):
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/joblib/parallel.py", line 620, in dispatch_one_batch
tasks = BatchedCalls(itertools.islice(iterator, batch_size))
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/joblib/parallel.py", line 127, in init
self.items = list(iterator_slice)
File "/Users/veljko/Documents/software/release/ricercando/ricercando/significance.py", line 155, in
for _ in range(N1_ITER)))
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/pandas/core/generic.py", line 2900, in sample
locs = rs.choice(axis_length, size=n, replace=replace, p=weights)
File "mtrand.pyx", line 1166, in mtrand.RandomState.choice
ValueError: Cannot take a larger sample than population when 'replace=False'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/Users/veljko/Documents/software/release/ricercando/ricercando/orange_widgets/owsignificantgroups.py", line 298, in on_computed
df = future.result()
File "/usr/local/Cellar/python3/3.6.3/Frameworks/Python.framework/Versions/3.6/lib/python3.6/concurrent/futures/_base.py", line 425, in result
return self.__get_result()
File "/usr/local/Cellar/python3/3.6.3/Frameworks/Python.framework/Versions/3.6/lib/python3.6/concurrent/futures/_base.py", line 384, in __get_result
raise self._exception
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/Orange/widgets/utils/concurrent.py", line 173, in run
result = func(*args, **kwargs)
File "/Users/veljko/Documents/software/release/ricercando/ricercando/significance.py", line 173, in perm_test
res = _groupby_agg(x, y, pval, min_count=min_count)
File "/Users/veljko/Documents/software/release/ricercando/ricercando/significance.py", line 79, in _groupby_agg
df = y.groupby(x.values).agg(['count'] + agg) # type: pd.DataFrame
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/pandas/core/groupby.py", line 2873, in aggregate
(_level or 0) + 1)
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/pandas/core/groupby.py", line 2946, in _aggregate_multiple_funcs
results[name] = obj.aggregate(func)
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/pandas/core/groupby.py", line 2885, in aggregate
result = self._aggregate_named(func_or_funcs, *args, **kwargs)
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/pandas/core/groupby.py", line 3015, in _aggregate_named
output = func(group, *args, **kwargs)
File "/Users/veljko/Documents/software/release/ricercando/ricercando/significance.py", line 155, in pval
for _ in range(N1_ITER)))
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/joblib/parallel.py", line 779, in call
while self.dispatch_one_batch(iterator):
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/joblib/parallel.py", line 620, in dispatch_one_batch
tasks = BatchedCalls(itertools.islice(iterator, batch_size))
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/joblib/parallel.py", line 127, in init
self.items = list(iterator_slice)
File "/Users/veljko/Documents/software/release/ricercando/ricercando/significance.py", line 155, in
for _ in range(N1_ITER)))
File "/Users/veljko/.virtualenvs/ricercando3/lib/python3.6/site-packages/pandas/core/generic.py", line 2900, in sample
locs = rs.choice(axis_length, size=n, replace=replace, p=weights)
File "mtrand.pyx", line 1166, in mtrand.RandomState.choice
ValueError: Cannot take a larger sample than population when 'replace=False'

Note, the error is not thrown in case 1 minute granularity is selected.