You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As scikit-learn often fail with missing or infinite values, I'd like a default way to count missing / infinite values. Currently we need to use describe and some .isna().sum() separately. It would be nice if the describe method could provide missing / infinite values counts. This could even be extended to count some user defined 'sentinel values'.
Feature Description
Add new rows to the output of the .describe method, with the count of missing values, count of infinite values.
Some parameters can be added to the describe function:
a list of 'sentinel' values so that the describe method also provide counts for those.
an option to provide frequency (proportion of total) instead of counts
an option to enable / disable those counts entirely
Alternative Solutions
The current solution is to do the counts outside of the describe function.
Additional Context
No response
The text was updated successfully, but these errors were encountered:
This definitely serves a need. Consider, if you haven't already, the ability to toggle it on and off. There are cases where the amount of data coming from describe can be overwhelming. Also, sometimes it's needed and sometimes it's not.
Feature Type
Adding new functionality to pandas
Changing existing functionality in pandas
Removing existing functionality in pandas
Problem Description
As scikit-learn often fail with missing or infinite values, I'd like a default way to count missing / infinite values. Currently we need to use describe and some .isna().sum() separately. It would be nice if the describe method could provide missing / infinite values counts. This could even be extended to count some user defined 'sentinel values'.
Feature Description
Add new rows to the output of the .describe method, with the count of missing values, count of infinite values.
Some parameters can be added to the describe function:
Alternative Solutions
The current solution is to do the counts outside of the describe function.
Additional Context
No response
The text was updated successfully, but these errors were encountered: