trigger a large number of dagruns

[qinyang666]

I have 3 DAG's and I try to trigger each DAG 3000 times.I get a bunch of exceptions. Here is my custom operator and the error I encountered. My version of Airlfow is 2.0.1

[turbaszek]

This seems like resource limitation. What is your setup? What you are trying to achieve is to run 9k DAGs at the same moment which asks for big deployment...

[qinyang666]

scheduler 8C * 3
worker 8C * 5
worker_concurrency ：16
parallelism 1000
max_active_runs_per_dag 1000
dag_concurrency 1000

[turbaszek]

So you have maximum of 16 * 5 = 80 tasks running at the same time. I would consider increasing worker concurrency or increasing the timeouts.