Status of testing of Apache Airflow CTL (airflowctl) 0.1.3rc1

[bugraoz93]

Body

Body

I have a kind request for all the contributors to the latest airflowctl distribution release.
Could you please help us test the RC versions of the airflowctl?

The guidelines on how to test providers can be found in

Verify AirflowCTL (airflowctl) by contributors

Please let us know in the comments whether the issue is addressed.

These are airflowctl that require testing, as there were some substantial changes introduced:

AirflowCTL (airflowctl) 0.1.3rc1

• Add airflowctl auth token command to print JWT access tokens (#62843): @dheerajturaga
• Send limit parameter in execute_list server requests (#63048): @Leondon9
• Add --action-on-existing-key to pools import and connections import (#62702): @Leondon9
• Run test-coverage when airflowctl command has any change (#63216): @bugraoz93
• Add retry mechanism to airflowctl and remove flaky integration mark (#63016): @bugraoz93
• Expose timetable_partitioned in UI API (#62777): @uranusjr
• airflowctl auth login: prompt for credentials interactively when none are provided (#62549): @dheerajturaga
• Fix airflowctl pools export ignoring --output table/yaml/plain (#62665): @Leondon9
• Increase version airflowctl (#62255): @bugraoz93
• Fix airflowctl connections import failure when JSON omits extra field (#62662): @Leondon9
• airflow-ctl: Add coverage tests for console formatting output (#62627): @Leondon9
• CI: Upgrade important CI environment (#62610): @potiuk
• Fix all build-system/requires including transitive dependencies (#62570): @potiuk
• Clean up stale Python 3.9 workaround in airflow-ctl CLI config parser (#62206): @haseebmalik18
• feat(airflowctl): support on headless environments (#62217): @ahidalgob
• Add DagRunType for asset materializations (#62276): @guan404ming
• Implement backfill for partitioned Dags (#61464): @dstandish

All users involved in the PRs:
@dheerajturaga @Leondon9 @bugraoz93 @uranusjr @potiuk @haseebmalik18 @ahidalgob @guan404ming @dstandish

Committer

• I acknowledge that I am a maintainer/committer of the Apache Airflow project.

[haseebmalik18]

Tested 0.1.3rc1 — #62206 works as expected. LGTM.

[dheerajturaga]

-1 (non-binding)
tested with 3.1.8rc2 and tried to run "airflowctl dags list" 

I get the following error (stacktrace)

pydantic_core._pydantic_core.ValidationError: 50 validation errors for DAGCollectionResponse
dags.0.timetable_partitioned
  Field required [type=missing, input_value={'dag_id': 'asset1_produc...7xnjr2trU3Ef8Nqf1CFBIE'}, input_type=dict]
    For further information visit https://errors.pydantic.dev/2.12/v/missing

timetable_partitioned was added in Airflow 3.2.0 . this release 0.1.3rc1 is not backward compatible .
Fix is here #63327
cc: @bugraoz93

[bugraoz93]

-1 (non-binding)
tested with 3.1.8rc2 and tried to run "airflowctl dags list" 

I get the following error (stacktrace)

pydantic_core._pydantic_core.ValidationError: 50 validation errors for DAGCollectionResponse
dags.0.timetable_partitioned
  Field required [type=missing, input_value={'dag_id': 'asset1_produc...7xnjr2trU3Ef8Nqf1CFBIE'}, input_type=dict]
    For further information visit https://errors.pydantic.dev/2.12/v/missing

timetable_partitioned was added in Airflow 3.2.0 . this release 0.1.3rc1 is not backward compatible .
Fix is here #63327
cc: @bugraoz93

Hey @dheerajturaga,
Thanks for flagging! Since we are still at 0.x.x, I don't think breaking changes is a huge problem now as we stated there could be breaking changes. What we should do is to aim there. I think your changes only for a certain field while problem is broad. Also we still haven't released 3.2.0. We should test with older version like 3.1.7, released ones
I already created a solution PR as well as dev discussion list about the solution.
Feel free to join
#61822
https://lists.apache.org/thread/kw61jmjxbk81t5rz5b25bmxvvmpv83kz

[ahidalgob]

#62217 works as expected

I also have the same problem with dags list (#63301 (comment)) in 3.1.0 and 3.1.7.

[bugraoz93]

#62217 works as expected

I also have the same problem with dags list (#63301 (comment)) in 3.1.0 and 3.1.7.

:( we may need rc2

[bugraoz93]

Will check in a couple of hours the status

[bugraoz93]

-1 (non-binding)
tested with 3.1.8rc2 and tried to run "airflowctl dags list" 

I get the following error (stacktrace)

pydantic_core._pydantic_core.ValidationError: 50 validation errors for DAGCollectionResponse
dags.0.timetable_partitioned
  Field required [type=missing, input_value={'dag_id': 'asset1_produc...7xnjr2trU3Ef8Nqf1CFBIE'}, input_type=dict]
    For further information visit https://errors.pydantic.dev/2.12/v/missing

timetable_partitioned was added in Airflow 3.2.0 . this release 0.1.3rc1 is not backward compatible .
Fix is here #63327
cc: @bugraoz93

I think I overlooked only fails for 3.2.0 which should be fine but for released version at least the latest should work 3.1.7. Will check out

[bugraoz93]

Voting cancelled, stay tuned for rc2