- Sep 15, 2022
-
-
Ephraim Anierobi authored
-
Jarek Potiuk authored
The change has been cherry-picked so we need to update the docs. (cherry picked from commit 41e48aaf)
-
Jed Cunningham authored
While it would ideal to transition to a positional arg like was attempted in #25978, this unfortunately does result in a breaking change so we cannot do it now. By instead marking the existing arg as required, we maintain backcompat while also providing a helpful error message to the user if they forget it. This reverts commit ed6ea72f. (cherry picked from commit f6c579c1)
-
Jed Cunningham authored
We need to clear any autoregistered DAGs that may have been already registered if we encounter any import errors while parsing a given DAG file. This maintains the behavior before we autoregistered DAGs. (cherry picked from commit 01e3fb7e)
-
Jed Cunningham authored
I'm not sure when we started using attrs directly, but we do and we need >=22.1.0 as we use the min_length validator. (cherry picked from commit fdecf120)
-
Ash Berlin-Taylor authored
Previously we had the validation on the Dataset model, but we since moved the "dag" facing class to a separate one. This adds validation to the public class, and extends the validation to not allow space-only strings (cherry picked from commit bd181dac)
-
Jed Cunningham authored
Co-authored-by: Konstantin Weddige <konstantin.weddige@lutrasecurity.com> (cherry picked from commit 56e7555c)
-
- Sep 14, 2022
-
-
Tzu-ping Chung authored
(cherry picked from commit 9444d978)
-
Jed Cunningham authored
(cherry picked from commit b966b8d8)
-
Ephraim Anierobi authored
We need to check with the base_version instead of the parsed version obj (cherry picked from commit af39faaf)
-
Tzu-ping Chung authored
(cherry picked from commit b816a6b2)
-
Jarek Potiuk authored
* Make "quick build" actually test build time There was a "string" instead of array passed in case of --max-time command flag which caused an error - regardless of the time it took to run the build, but it was also ignored because the job was run within "continue-on-error" cache push job. This PR fixes it to use proper "exit" command and separates it out to a job where quick build failure will be noticed (not in PRs but in the merge-run) (cherry picked from commit 63da96b4)
-
Daniel Standish authored
Co-authored-by: Ash Berlin-Taylor <ash_github@firemirror.com> Co-authored-by: Jed Cunningham <66968678+jedcunningham@users.noreply.github.com> (cherry picked from commit b99d1cd5)
-
Tzu-ping Chung authored
(cherry picked from commit ffee6bce)
-
Jarek Potiuk authored
This PR applies PEP-563 to all core airflow Python files - i.e. those that we want to cherry-pick to v2-* branches in order to make cherry-picking for the upcoming 2.4* releases easier. There was a separate PR (#26289) with non-core changes that are not going to be cherry-picked.. This PR is a result of combining some of the 47 PRs reviewed and approved separately (otherwise it would have been unreviewable) The history of those PRs can be changed in: https://github.com/apache/airflow/pulls?q=is%3Apr+label%3Afuture-annotations+is%3Aopen Relevant discussion: https://lists.apache.org/thread/81fr042s5d3v17v83bpo24tnrr2pp0fp Lazy consensus call: https://lists.apache.org/thread/l74nvjh8tgbtojllhwkcn7f8mfnlz4jq (cherry picked from commit d67ac593)
-
- Sep 13, 2022
-
-
Ephraim Anierobi authored
-
- Sep 12, 2022
-
-
Ash Berlin-Taylor authored
The cause of the failure was a PR race -- the PR that changed migrations was opened and passing tests before the ERD sha was added. (cherry picked from commit 12b54450)
-
Jed Cunningham authored
(cherry picked from commit 3c9c0f94)
-
Jed Cunningham authored
When we go to schedule dagruns from the dataset dagrun queue, we assume the events will happen before the queue records, which isn't the case unless we explicitly flush them first. This ensures that dagruns are properly related to their upstream dataset events. (cherry picked from commit 954349a9)
-
David Katz authored
(cherry picked from commit aada79e1)
-
- Sep 11, 2022
-
-
Jarek Potiuk authored
The previous way of building the path depended on the OS path but it was really used to build the URL so we should use urllib instead of os.path.join. (cherry picked from commit 18386026)
-
- Sep 09, 2022
-
-
Daniel Standish authored
If you have a dataset outlet on a task, and no DAG was recorded as consuming that dataset it failed with a null value constraint violation in the db (cherry picked from commit fe82e960)
-
Tzu-ping Chung authored
This incorrectly accesses the version *attribute* in airflow.version instead of the airflow.version module itself, breaking compatibility. I actually rewrote the entire __getattr__ hook; much of the logic seems to be quite redundant. (cherry picked from commit b7a603cf)
-
Edith Puclla authored
(cherry picked from commit 50668445)
-
Jarek Potiuk authored
Currently constraints generation is not really showing good progress while the packages are being removed/installed. This adds progress that shows that something happens. (cherry picked from commit d6f473b3)
-
Jed Cunningham authored
This makes them proper sections and reorders a couple of them as well. (cherry picked from commit 49fb3ffb)
-
- Sep 08, 2022
-
-
Jarek Potiuk authored
In v2-4-test it turned out that PROD cache build was a bit too limited - the cache has not been prepared if branch was not main (copy&paste victim). This PR fixes this - cache is always build in merge run regardless of the branch we are in. (cherry picked from commit 41785457)
-
Jarek Potiuk authored
Since we are not always updating the version suffix in code (rc1/rc2/b1/b2), the tag specified via --tag-build prefix should override the one in code rathe than the other way round. So what's left now - we will just print warning if the suffix does not match. (cherry picked from commit 9cf6f6a6)
-
Jarek Potiuk authored
* Limit eager upgrade of protobuf library to < 4.21.0 Until all the Google client libraries get upgraded to >= 2.0.0, we need to limit the protobuf version. (cherry picked from commit c6053f52)
-
Jarek Potiuk authored
The latest docker-compose dropped an alias for `docker-compose` and we need to detect it and use "docker compose" instead. (cherry picked from commit 7f47006e)
-
Jarek Potiuk authored
When SHELL variable is not set, kubernetes tests will fall back to using 'bash' (cherry picked from commit b7db3113)
-
Ash Berlin-Taylor authored
-
Ash Berlin-Taylor authored
-
Ash Berlin-Taylor authored
As I like to have the branch point for a release as "late" as possible, I'm committing the version change to main, and then branching off. The release notes/changelog are _far_ from complete, but lets take what newsfragments we have
-
Mark Norman Francis authored
-
pierrejeambrun authored
-
Ash Berlin-Taylor authored
-
Jarek Potiuk authored
The CI of ourse is using dev0 prefix to test packages and to build PROD image, but when Airflow (in beta) has conflicting version, it failed. This PR allows to override the version and only prints warning in this case rather than fail.
-