Comments (3)
rxin
commented on September 24, 2024
It sort of depends on what users use dtypes for. If they are using it to programmatically get the column names and data types, then it'd make sense to be as much the same as Pandas as possible. If they are just using that to inspect the dataset's schema, then the existing one should be fine.
from koalas.
AbdealiLoKo
commented on September 24, 2024
When you say inspect do you mean if they manually inspect it?
Wouldn't manually inspection be OK if it's pandas behaviour too?
from koalas.
thunterdb
commented on September 24, 2024
Unless there are objections, I think that the behaviour for dtypes should be to return the same as pandas. Spark users will have schema if they want to have the underlying spark types.
from koalas.
Related Issues (20)
- Series.to_json(orient='records') does not return records-based JSON HOT 3
- Write custom metadata to output files with dataframe.to_parquet? HOT 1
- read_excel's parameter - mangle_dupe_cols is used to handle duplicate columns but fails if the duplicate columns are case sensitive. HOT 2
- Predicate Pushdown not Working HOT 3
- AttributeError: module 'databricks.koalas' has no attribute 'DateOffset' HOT 1
- Whether the `apply` function is implemented using the pandas_udf function? HOT 1
- missing function `koalas.series.apply` HOT 1
- Joining koalas frame with spark HOT 2
- fillna does not work with decimals HOT 1
- pyspark is not required when install koalas
- data type conversion error HOT 1
- pyspark dataframe coverting to koalas dataframe have different elements HOT 5
- Spammed with FutureWarnings that are unfilterable
- Koalas.idxmin() is not picking the minimum value from a dataframe, but pandas.idxmin() gives HOT 1
- Attribute Error: module 'numpy' has no attribute 'bool' HOT 3
- Is koalas still being worked on? or is the project on pause at the moment? HOT 2
- gotImport Error HOT 1
- Erro XVPL formula!
- import error HOT 1
- No module named 'databricks' after installing koalas HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from koalas.