[SPARK-47755][CONNECT] Pivot should fail when the number of distinct values is too large

[zhengruifeng]

What changes were proposed in this pull request?

Pivot should fail when the number of distinct values is too large

Why are the changes needed?

Following check is missing in Spark Connect

    if (values.length > maxValues) {
      throw QueryCompilationErrors.aggregationFunctionAppliedOnNonNumericColumnError(
        pivotColumn.toString, maxValues)
    }

Does this PR introduce any user-facing change?

pivot will fail when the number of distinct values exceed DATAFRAME_PIVOT_MAX_VALUES

and so will be consistent with classic spark.

How was this patch tested?

added test

Was this patch authored or co-authored using generative AI tooling?

no

[HyukjinKwon]

Merged to master.