Comments (1)
Struggling a lot with Ray serialization, I feel that the proposed error message is still not clear enough, because it doesn't refer to the user code that sources the offending object.
Is it possible with some extra inspection to come up with an error message like the following?
This is the log of the execution plan, indicating the user functions by name:
Execution plan of Dataset: InputDataBuffer[Input] -> TaskPoolMapOperator[MapBatches(read_dataset)] -> TaskPoolMapOperator[Map(merge_components)->Map(remesh_surface)]
The error message refers to one of the user defined functions:
+ + +
Checking Serializability of <ray.data._internal.... TaskPoolMapOperator.Map(remesh_surface) object at 0x16fffa040>
================================================================================
# list of objects that pass serialization check ...
!!! FAIL serialization: cannot pickle 'socket' object
from ray.
Related Issues (20)
- Ray Serve with Fastapi is a lot (10x) slower than plain fastapi HOT 2
- [Serve] Streamlit example
- Ray RL | Local Env Runner spinning up when it shouldn't
- [Ray Serve] | Replicas keep failing health check under high QPS while scaling up HOT 5
- Release test single_node_oom.aws failed HOT 1
- [Ray Dashboard] Support killing interactively submitted ray jobs from dashboard HOT 4
- Release test air_example_vicuna_13b_lightning_deepspeed_finetuning failed HOT 7
- Release test air_example_gptj_deepspeed_fine_tuning failed HOT 1
- [data] Limit does not produce correctly sized dataset which causes `ds.schema()` to be incorrect HOT 1
- Unable to find installation candidates for ray (2.32.0)
- [Clusters] dashboard is empty with AWS Cluster HOT 1
- [Cluster] Ray cluster with necessary process only
- [ConnectionError: ray client connection timeout]
- Release test dataset_shuffle_sort_1tb.aws failed HOT 2
- [Data] Enabling verbose_stats_logs shadows user function error
- [tune] Can't reload a past experiment (pickling error in pyarrow?)
- [core] `retry_exceptions` for Actor ctors. HOT 1
- [tune] ClientObjectRef is not found for client
- [Data] Sorting on grouped data not working with pandas format HOT 3
- [serve] using `seve run demo:app`, it runs successfully. However, when using `serve run demo.yaml`, it throws an error: "No CUDA GPUs are available." HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ray.