Repository navigation
Cover native Go Dags in the go_sdk e2e test - #74411
Merged
jason810496 merged 4 commits intoOct 9, 2026
Merged
Conversation
jason810496
force-pushed
the
feature/go-sdk/native-dag-e2e
branch
from
October 7, 2026 16:04
8d265ac to
00b3fa2
Compare
1 task done
jason810496
force-pushed
the
feature/go-sdk/native-dag-e2e
branch
4 times, most recently
from
October 8, 2026 02:41
6f52a66 to
727e256
Compare
jason810496
marked this pull request as ready for review
October 8, 2026 04:04
jason810496
requested review from
amoghrajesh,
ashb,
bugraoz93,
gopidesupavan,
jscheffl,
potiuk and
uranusjr
as code owners
October 8, 2026 04:04
phanikumv
reviewed
Oct 8, 2026
jason810496
force-pushed
the
feature/go-sdk/native-dag-e2e
branch
from
October 8, 2026 09:57
33f3bcb to
c0bc9a2
Compare
guan404ming
approved these changes
Oct 9, 2026
Shows Dags built with airflow.Dag, with task groups, If, Switch and TriggerDagRun, in a binary the Dag processor parses. The e2e test packs and runs it.
Pack the native example into the Dags folder so the Dag processor runs it to parse, and give that service the worker's USER and HOME. Keep the handler-only bundle out of parsing with an .airflowignore.
Parse, run and inspect the example native Dags through the stock stack. The TriggerDagRun case is a strict xfail until the Go runtime has a trigger runner.
jason810496
force-pushed
the
feature/go-sdk/native-dag-e2e
branch
from
October 9, 2026 08:35
c0bc9a2 to
bb10191
Compare
1 task done
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Why
The
go_sdke2e mode only covers Python stub Dags with Go task handlers, so nothing checks that a Dag authored in Go is parsed, stored and run end to end.What
go-sdk/example/native/: a native Go Dag example.go_native_pipelineuses TaskFlowInputswith task results andLiterals, nested task groups with a labelled group edge,If,Switch, and the Variable, Connection and XCom clients.go_native_triggerusesTriggerDagRun, andgo_native_reportis declared inreport.go.The
go_sdkmode packs the native bundle into the Dags folder, so the Dag processor parses it withExecutableCoordinator, and keeps the task handler bundle out of parsing with.airflowignore.test_go_sdk_native_dag.pychecks the parsed Dags and their edges, the run's task states (the untakenIfandSwitchsides are skipped), the XComs, the Variable and Connection reads, and the per-Dag source in the Code view.go_native_triggerruns itsTriggerDagRuntask in the Go runtime (Go SDK: run TriggerDagRun tasks in the Go runtime #74417), and the test checks the triggeredgo_native_reportrun and its conf.Was generative AI tooling used to co-author this PR?