Skip to content

Missing docs for logging #10593

Closed
Closed

Description

@mik-laj

Hello,

The configuration of the Airflow logger is not easy, as in most applications. We have many loggers, some loggers generate multiple streams. This is very confusing for end-users, and the lack of documentation doesn't make it any easier.

We have following loggers

  • root logger
  • airflow.processor
  • airflow.task
  • flask_appbuilder
  • airflow.processor_manager

airflow.task creates a new log file for each pair of task instances and try numbers. These entries are accessible via the Web UI.
airflow.processor creates a new log file for each DAG File.
flask_appbuilder is only used to filter logs records because the FAB is too verbose, so in most cases, we don't have to configure it specially.

Webserver writes logs to root logger.
Worker writes logs to airflow.processor and root logger
Scheduler writes logs to airflow.processor, airflow.processor_manager and root logger

I would be happy if we had a description of the default configuration and the methods on how to influence these configurations were described. Currently, the documentation only describes configurations for airflow.task.

Best regards,
Kamil Breguła

Activity

  1. kaxil commented on Dec 30, 2021

    @kaxil
    Member
  2. self-assigned this
    on Jun 9, 2024
  3. AshutoshSrivastavaDev commented on May 2, 2025

    @AshutoshSrivastavaDev

    can I take this up

  4. Hasanen99 commented on Jun 19, 2025

    @Hasanen99

    It's unbelievable how this horrible issue requires a complete custom class and building new things to print the logs to stdout. Seriously!

  5. removed their assignment
    on Jun 19, 2025
  6. sanchalitorpe13 commented on Jan 29, 2026

    @sanchalitorpe13

    Hi @kaxil, I’d like to work on documenting the default logging configuration for Airflow components (root, airflow.task, airflow.processor, etc.), as well as instructions for modifying them. I will make sure to add examples and follow the current docs style.

  7. potiuk commented on Mar 2, 2026

    @potiuk
    Member

    @sanchalitorpe-source We are unassigning you from this issue as part of our updated assignment policy.

    This is not meant to discourage your contribution — quite the opposite! You are still very welcome to work on this issue and submit a PR for it. Simply comment that you are working on it and open a PR when ready.

    We found that formal assignments were not working well, as they often prevented others from contributing when the assignee was not actively working on the issue.

  8. dhariskhan1275 commented on Jul 24, 2026

    @dhariskhan1275

    can I take this up

  9. shahar1 commented on Jul 24, 2026

    @shahar1
    Contributor

    can I take this up

    Sure, feel free to raise a PR (we don't officialy assign to GitHub issues by current policy)

  10. dhariskhan1275 commented on Jul 24, 2026

    @dhariskhan1275

    ok

  11. codewithdaniel1 commented on Jul 31, 2026

    @codewithdaniel1
    Contributor

    Hi, I’m going to work on a small documentation update for this.

    I reviewed the previous closed PRs and plan to keep this version narrowly scoped by adding a concise “Default Airflow loggers” section to the existing logging architecture documentation, rather than creating a new standalone page.

    I’ll avoid unrelated file changes and will link to the existing task logging and advanced logging configuration docs for details.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions