5 Best Ways to Return the Minimum of an Array Along an Axis or Minimum Ignoring Any NaNs in Python

by

💡 Problem Formulation: When working with numerical data in Python, it’s common to encounter situations where you need to find the minimum value in an array. This task can become slightly more complex when dealing with multidimensional arrays and the need to handle Not a Number (NaN) values that may skew the results. Consider an input array like [3, 1, NaN, 5] and you wish to find the minimum value, ideally returning 1, while ignoring any NaNs.

Method 1: Using NumPy’s amin() Function

NumPy provides a function amin() that allows you to find the minimum value along a specified axis of an array. It’s an efficient and straightforward approach when you’re dealing with pure numerical arrays without NaN values. The function does not ignore NaNs by default; hence it should be used in contexts free of NaN values.

Here’s an example:

import numpy as np

arr = np.array([[8, 1], [3, np.nan]])
min_val = np.amin(arr, axis=0)

print(min_val)

Output:

[3. nan]

This code snippet creates a 2D NumPy array and uses np.amin() to find the minimum values along axis 0 (column-wise). It does not handle the NaN; thus the result contains NaN where the minimum is undefined due to its presence.

Method 2: Using NumPy’s nanmin() Function

The nanmin() function from the NumPy library is specifically designed to find the minimum value in an array while ignoring any NaN values. This function can operate both on flat arrays and along a specified axis in multidimensional arrays. This is ideal for datasets that commonly contain NaN values.

Here’s an example:

import numpy as np

arr = np.array([[8, 1], [3, np.nan]])
min_without_nan = np.nanmin(arr, axis=0)

print(min_without_nan)

Output:

[3. 1.]

By using np.nanmin(), we obtain the minimum values column-wise, ignoring the NaN value. This provides a clear minimum value for each column.

Method 3: Using List Comprehension and min() Function

Without NumPy, you can use a combination of list comprehension and Python’s built-in min() function to ignore NaN values. However, this method lacks the multidimensional support that NumPy offers and may not be as efficient for large datasets.

Here’s an example:

my_array = [8, 1, float('nan'), 3]
min_val = min(x for x in my_array if not math.isnan(x))

print(min_val)

Output:

1

This approach filters out NaN values from the array using list comprehension and then finds the minimum of the remaining values with min(). Note that this only works well for flat arrays.

Method 4: Using Pandas min()

Pandas offers a convenient min() method that naturally skips NaN values, which can be very helpful when dealing with Series and DataFrame objects. It also works well with high-level data manipulation tasks.

Here’s an example:

import pandas as pd

s = pd.Series([8, 1, np.nan, 3])
min_val = s.min()

print(min_val)

Output:

1.0

The code example creates a Pandas Series and then immediately uses the min() method to retrieve the minimum value, conveniently ignoring NaN values in the process.

Bonus One-Liner Method 5: Using Python’s min() with filter()

This method employs the filter() function and math.isnan() to remove NaNs before applying the built-in min() function, offering a one-liner solution for flat arrays.

Here’s an example:

import math

my_array = [8, 1, math.nan, 3]
min_val = min(filter(lambda x: not math.isnan(x), my_array))

print(min_val)

Output:

1

This compact one-liner utilizes filter() to exclude any NaNs and then finds the minimum of the filtered array with min(). It’s a neat solution for simple, one-dimensional arrays.

Summary/Discussion

  • Method 1: NumPy’s amin(): Efficient for numerical arrays without NaNs. Not suitable for arrays containing NaNs as it doesn’t inherently ignore them.
  • Method 2: NumPy’s nanmin(): Perfect for arrays with NaNs. Works with multidimensional arrays and is highly efficient.
  • Method 3: List Comprehension with min(): A workaround when NumPy is not available. Best for one-dimensional arrays yet potentially slower for large datasets.
  • Method 4: Pandas min(): Great for high-level data operations on Series or DataFrames, naturally skips NaN values.
  • Bonus Method 5: Using min() with filter(): A quick one-liner for flat arrays that neatly circumvents NaNs.