Devin Petersohn
Jan 23, 2020

Great question! Dask dataframe does not support the dataframe data model, similar to Spark Dataframes. There are several dataframe functionalities that Dask fundementally cannot support because of Dask dataframe’s architecture and the data model deviations they made in its design. This gets at the core of this post: Not everything that is marketed as a dataframe is a dataframe. In the preprint we have a bit more about Dask and the deviations it has made.

From an implementation standpoint, I have made a post about this on the Modin GitHub: https://github.com/modin-project/modin/issues/515.

Sign up to discover human stories that deepen your understanding of the world.

Free

Distraction-free reading. No ads.

Organize your knowledge with lists and highlights.

Tell your story. Find your audience.

Membership

Read member-only stories

Support writers you read most

Earn money for your writing

Listen to audio narrations

Read offline with the Medium app

Responses (1)

Write a response