8. Don’t Forget about NANs - Deepstash
Machine Learning With Google

Learn more about computerscience with this collection

Understanding machine learning models

Improving data analysis and decision-making

How Google uses logic in machine learning

Machine Learning With Google

Discover 95 similar ideas in

It takes just

14 mins to read

8. Don’t Forget about NANs

It’s important to remember that your datasets can always contain NANs. Unless you’ve examined your data quality and know that there are no NANs, you should pay attention to that. When we sort values, these NANs are placed behind all the other valid values, by default. If we want to change this default behavior, we set the na_position parameter.

  • We first inject one NAN into the DataFrame object.
  • When we do nothing with the na_position , the NAN value is placed at the end of the sorting group.
  • When we set “first” to na_position , the NAN value appears at the top.

8

17 reads

MORE IDEAS ON THIS

5. Sort by Descending Orders

As we’ve seen so far, every sorting is done using the ascending order, which is the default behavior. However, we often want to have the data sorted by a descending order. We can take advantage of the ascending parameter.

What should we do if we sort by multiple columns and ha...

8

26 reads

1. Sort by a Single Column

In this article, we’ll be using the flights dataset, which records the monthly passenger...

8

34 reads

6. Sort by Custom Functions

Apparently, the sorted data isn’t something that we expect — the months are not in the desired order. To make this happen, we can take advantage of the sort_method taking a key parameter, to which we can pass a custom function for sorting, just like Python’s built-in

8

17 reads

7. Sort Lexicographically Unordered Columns After Casting to Categorical

The above sorting using the key parameter can be confusing to some people. Is there a cleaner way? Pandas is arguably the most versatile library for data processing, and you can expect that there is something neat to solve this relatively common problem — converting these lexicograph...

9

13 reads

4. Sort by Multiple Columns

We don’t always need one column for sorting. In many cases, we need to sort the data frame by multiple columns. It’s also simple with sort_values because by doesn’t only take a single column but also a list of columns without any special syntax.

8

12 reads

3. Reset Index After Sorting

In the previous sorting, you may notice that the index goes with each sorted row, which puzzles me sometimes, when I want the sorted DataFrame has an ordered index. In this case, you can either reset the index after sorting, or simply take advantage of the ignore_index parameter, as ...

8

19 reads

2. Sort Values Inplace

In the previous sorting, one thing you may have notices is that the sort_values method will create a new DataFrame object, as shown below.

To avoid creating a new DataFrame, you can request the sorting to be done inplace by setting the inplace paramet...

8

18 reads

Related collections

More like this

Values, Not Lifehacks

Values, Not Lifehacks

Tech is only a tool. How you use it can make it good or not so good.

We don't need a lifehack to control our phone. We need values to ensure that technology serves us, and not the other way around.

Find out what you value in life. Then ask how technology supports those values. Set rul...

Primitive Reflexes

Primitive Reflexes

As infants we have in our DNA the moro reflex and the palmar grasp reflex. These are reflexes that develop while we were in the womb and lasts until we are at 3-6 months of age.

These reflexes are responses to our environment whether it may be ...

Common Biases

  • Actor-Observer Bias: the way the explanation of other people’s behaviour tends to focus on the influence of their personality while being less focused on the situation while being just the opposite while explaining one’s own behaviour.
  • Zeigarnik Effect

stash-superman-illustration

Explore the World’s

Best Ideas

200,000+ ideas on pretty much any topic. Created by the smartest people around & well-organized so you can explore at will.

An Idea for Everything

Explore the biggest library of insights. And we've infused it with powerful filtering tools so you can easily find what you need.

Knowledge Library

Powerful Saving & Organizational Tools

Save ideas for later reading, for personalized stashes, or for remembering it later.

# Personal Growth

Take Your Ideas

Anywhere

Organize your ideas & listen on the go. And with Pro, there are no limits.

Listen on the go

Just press play and we take care of the words.

Never worry about spotty connections

No Internet access? No problem. Within the mobile app, all your ideas are available, even when offline.

Get Organized with Stashes

Ideas for your next work project? Quotes that inspire you? Put them in the right place so you never lose them.

Join

2 Million Stashers

4.8

5,740 Reviews

App Store

4.7

72,690 Reviews

Google Play

Shankul Varada

Best app ever! You heard it right. This app has helped me get back on my quest to get things done while equipping myself with knowledge everyday.

samz905

Don’t look further if you love learning new things. A refreshing concept that provides quick ideas for busy thought leaders.

Sean Green

Great interesting short snippets of informative articles. Highly recommended to anyone who loves information and lacks patience.

Ashley Anthony

This app is LOADED with RELEVANT, HELPFUL, AND EDUCATIONAL material. It is creatively intellectual, yet minimal enough to not overstimulate and create a learning block. I am exceptionally impressed with this app!

Giovanna Scalzone

Brilliant. It feels fresh and encouraging. So many interesting pieces of information that are just enough to absorb and apply. So happy I found this.

Ghazala Begum

Even five minutes a day will improve your thinking. I've come across new ideas and learnt to improve existing ways to become more motivated, confident and happier.

Laetitia Berton

I have only been using it for a few days now, but I have found answers to questions I had never consciously formulated, or to problems I face everyday at work or at home. I wish I had found this earlier, highly recommended!

Jamyson Haug

Great for quick bits of information and interesting ideas around whatever topics you are interested in. Visually, it looks great as well.

Read & Learn

20x Faster

without
deepstash

with
deepstash

with

deepstash

Access to 200,000+ ideas

Access to the mobile app

Unlimited idea saving & library

Unlimited history

Unlimited listening to ideas

Downloading & offline access

Personalized recommendations

Supercharge your mind with one idea per day

Enter your email and spend 1 minute every day to learn something new.

Email

I agree to receive email updates