Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Julia Feather.read failed to read feather file on CentOS. #20

Closed
BoPeng opened this issue May 20, 2020 · 4 comments
Closed

Julia Feather.read failed to read feather file on CentOS. #20

BoPeng opened this issue May 20, 2020 · 4 comments

Comments

@BoPeng
Copy link
Contributor

BoPeng commented May 20, 2020

image

For dataframe sos-julia essentially saves the dataframe in feather format and use Julia's Feather.read function to read it. Unfortunately, this does not seem to work under CentOS 7 as shown above.

All other tests pass on CentOS so Feather.read is the only problem.

@mathieuboudreau Could you in your travis docker environment test if julia's Feather.read can read files written by feather.write_dataframe?

@BoPeng
Copy link
Contributor Author

BoPeng commented May 20, 2020

image

SoS (Python) can read feather file written by Julia.

@BoPeng
Copy link
Contributor Author

BoPeng commented May 20, 2020

Some dataframes actually work

Screen Shot 2020-05-20 at 12 39 31 AM

@BoPeng
Copy link
Contributor Author

BoPeng commented May 20, 2020

According to pandas.to_feather, feather does not support non-default index and numeric column names, so at least in this case we should force string column names?

@BoPeng
Copy link
Contributor Author

BoPeng commented May 20, 2020

The problem here is that python feather writes in the feather v2 (arrow) format and Feather.jl cannot yet read it.

JuliaData/Feather.jl#139

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant