Airflow Xcom Exclusive Page

def transform_data(table_name, **context): # table_name pulled via task_id='extract_api_data' result_table = aggregate_in_bigquery(table_name) return result_table

r.rpush(key, json.dumps(payload)) item = r.rpop(key) # None if empty; item is removed atomically airflow xcom exclusive

: Set include_prior_dates=False to prevent pulling old data from previous runs. airflow xcom exclusive

When using the PythonOperator or TaskFlow API, any value returned by the function is automatically pushed to XCom with the key return_value . 2. Pulling Data airflow xcom exclusive