[SPARK-55242][PYSPARK] Handle np.ndarray elements in list-valued columns when converting from pandas#55196

Open

azmatsiddique wants to merge 7 commits intoapache:masterfrom

azmatsiddique:SPARK-55242-pyspark-pandas-np-array-from-list

Commits on Apr 4, 2026

[SPARK-55242][PYSPARK] Handle np.ndarray elements in object-dtype columns when converting from pandas

Azmat Siddique
authored and
Azmat Siddique
committed
[SPARK-55242][PYTHON] Refine handling of np.ndarray elements and suppress Connect parity test warnings

Azmat Siddique
authored and
Azmat Siddique
committed
[SPARK-55242][PYTHON] Remove unused numpy import in string_ops.py to fix linting

Azmat Siddique
authored and
Azmat Siddique
committed
[SPARK-55242][PYTHON] Convert np.ndarray elements to lists in DataTypeOps.prepare for better Connect serialization

Azmat Siddique
authored and
Azmat Siddique
committed
[SPARK-55242][PYTHON] Reformat complex ops test for ruff compliance

Azmat Siddique
authored and
Azmat Siddique
committed
[SPARK-55242][PYTHON] Add graceful skip for Connect parity test involving numpy array elements

Azmat Siddique
authored and
Azmat Siddique
committed
[SPARK-55242][PYTHON] Fix unsupported sort_values(key=...) in complex ops test

Azmat Siddique
authored and
Azmat Siddique
committed