[SPARK-51699][BUILD] Upgrade to Apache parent pom 34

[vrozov]

What changes were proposed in this pull request?

Upgrade Apache parent pom from version 33 to the latest version 34 along with upgrading few maven plugins versions to match those from the latest parent pom.

• maven-compiler-plugin from 3.13.0 to 3.14.0
• maven-clean-plugin from 3.4.0 to 3.4.1
• maven-install-plugin from 3.1.2 to 3.1.4
• maven-deploy-plugin from 3.1.2 to 3.1.4

Why are the changes needed?

Apache parent pom version 34 includes several plugin upgrades as well as bug fixes. For the full list please see release notes

Does this PR introduce any user-facing change?

No

How was this patch tested?

Local mvn build with the new parent pom succeeds:

[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  15:08 min
[INFO] Finished at: 2025-04-02T09:07:47-07:00
[INFO] ------------------------------------------------------------------------

Was this patch authored or co-authored using generative AI tooling?

No

[yaooqinn]

Merged to master, thank you @vrozov

[beliefer]

late LGTM.

[vrozov]

@yaooqinn should it be also merged into branch-4.0?

[yaooqinn]

This could add potential blocks to current 4.0.0 release，so 4.1.0 is fine from my side