Pandas

ValueError: Cannot Reindex From a Duplicate Axis — How to Fix It

Answer

This error means your dataframe has duplicate values in its index, and pandas can't perform an operation that requires unique index values. Fix it by resetting the index with .reset_index(drop=True) or removing duplicates with .drop_duplicates() before the operation.

Why This Happens

Certain pandas operations — like assigning a Series to a column, reindexing, or aligning dataframes — require the index to be unique. If your index has duplicate values (often from merges, concats, or filtering without resetting), pandas can't figure out which row should get which value.

Solution

The rule: if you hit this error, run df.index.is_unique — if it returns False, reset or dedupe the index.

import pandas as pd

df = pd.DataFrame({'a': [1, 2, 3]}, index=[0, 1, 1])  # duplicate index value

# ❌ Problematic: assigning with duplicate index
df['b'] = pd.Series([10, 20, 30])
# ValueError: cannot reindex from a duplicate axis

# ✅ Fixed: reset the index first
df = df.reset_index(drop=True)
df['b'] = [10, 20, 30]

# ✅ Debug: check for duplicates
print(df.index.is_unique)  # False means duplicates exist
print(df.index[df.index.duplicated()])  # shows which values are duplicated

# ✅ Alternative: if duplicates are data issue, drop them
df = df[~df.index.duplicated(keep='first')]