Comments (6)
Loading a dataframe from a pandas.dataframe is Ok, the Mars Cluster seems not to crash or fail.
from mars.
How did you initialize the Mars session? The error came from the Mars web session. Could you try to initialize the Mars session by mars.new_session(backend='ray')
or mars.new_ray_session(backend='ray')
? Ray execution backend does not use the Mars web session at all.
from mars.
If you want use Mars on Ray in cluster mode. The following simple steps should work:
- Start a Ray cluster, please refer to https://docs.ray.io/en/latest/cluster/key-concepts.html. (Pre-install Mars in the cluster can avoid using Ray runtime env).
ray.init
to connect to the cluster, please refer to https://docs.ray.io/en/latest/ray-core/api/doc/ray.init.html.mars.new_ray_session(backend='ray')
to run Mars on Ray.
from mars.
@fyrestone Does the user mention that he is using ray backend?
from mars.
@fyrestone Does the user mention that he is using ray backend?
No. But the ray backend is easier to use and don't have this problem at all, why not give it a try?
from mars.
Is this issue addressed @Suphx ? I noticed that you have closed it.
from mars.
Related Issues (20)
- [BUG] scipy 1.10 raises ValueError: `popmean.shape[axis]` must equal 1.
- [BUG] Support for higher versions of python HOT 3
- [BUG] md.read_ray_dataset is not compatible with latest Ray
- [BUG] mars.tensor.int is not compatible with numpy since v1.24
- [BUG] Creating an ndarray from ragged nested sequences is deprecated since numpy 1.24
- [BUG] anaconda3/lib/python3.8/uuid.py", line 180, raise ValueError('bytes is not a 16-char string') HOT 12
- [BUG] throw `AttributeError` when using mars tensor with `gpu=True` on colab HOT 2
- [BUG] throw a `No NVIDIA GPU detected` warning or a similar error when deploying Mars on Ray
- [CI] Pandas 2.0.0 will break down Mars CI
- Want some examples of custom apply function
- [GRAPH][ENHANCEMENT] Optimize `SubtakGraph` generation
- [BUG] `test_ray_client` run failed
- [BUG]How to set the ip address in the cluster mode HOT 3
- [BUG] lightgbm TypeError: a bytes-like object is required, not 'list'
- [BUG][Ray] LightGBMError: Machine list file doesn't contain the local machine
- A more universal function to replace subgraph in OptimizationRule
- [BUG] Series doesn't support attribute access
- [BUG] Series with multi index accessing data by index error
- [PERF] Performance issue in pandas 1.3.4's read_csv Function with Large Column CSV Files
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mars.