Apply function to every row in a Pandas DataFrame

Applying a Function to Every Row in a Pandas DataFrame

When working with tabular data in Python, the pandas library is the go-to choice. Often, you'll find yourself needing to apply a function to each row of a DataFrame to transform or analyze your data on a row-by-row basis. Fortunately, pandas makes this easy with its apply() method.

What Does Applying a Function to Each Row Mean?

Applying a function to every row means executing a custom operation that processes the values in each row independently and returns a result. This could be anything from calculating a new value based on multiple columns to modifying data conditionally.

Using the apply() Method with axis=1

The key to applying a function row-wise in pandas is setting the axis parameter of apply() to 1. This tells pandas to pass each row as a Series object to the function you provide.

df.apply(your_function, axis=1)

Example: Calculating Total Price with Tax

Suppose you have a DataFrame representing products with their prices and tax rates, and you want to calculate the total price including tax for each product:

import pandas as pd

data = {
    'Product': ['Laptop', 'Tablet', 'Phone'],
    'Price': [1000, 600, 300],
    'Tax_Rate': [0.1, 0.08, 0.05]
}

df = pd.DataFrame(data)

def total_price(row):
    return row['Price'] * (1 + row['Tax_Rate'])

df['Total_Price'] = df.apply(total_price, axis=1)
print(df)

How It Works

In this example, the total_price function receives each row as a Series and calculates the total price by multiplying the price with the tax-inclusive factor. The resulting values are assigned to a new column Total_Price in the DataFrame.

Using Lambda Functions for Quick Operations

For simpler row-wise computations, lambda functions can be handy. Here’s how you might use one to create a column that flags expensive products (price above 700):

df['Is_Expensive'] = df.apply(lambda row: row['Price'] > 700, axis=1)

Why Apply Functions Row-wise?

Row-wise application is useful when your calculation or logic depends on multiple columns within the same row. It gives you the flexibility to craft customized processing logic that vectorized operations alone may not easily accomplish.

Performance Tips

Although apply() is straightforward, it’s not always the fastest approach on large datasets. When performance is a concern, consider vectorized operations or using built-in pandas methods first. Use apply() for complex row-wise logic that cannot be vectorized.

Summary

Applying a function to every row in a pandas DataFrame is a powerful technique to transform data flexibly. By leveraging apply() with axis=1, you can perform complex calculations, conditionally modify data, or generate new columns based on row-level information — all with clean, readable code.

---