• spotify/luigi

    Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

    Release notes

    Added:

    luigi
    • Add check_complete_on_run to optionally mark tasks as failed if complete() is false when run finishes (#2710)
    • Add section "Running Luigi on Windows" to docs (#2720)
    • Add Giphy to list of companies using Luigi to docs (#2713)
    luigi.contrib
    • Add DropboxTarget for luigi (#2696)

    Fixed:

    luigi
    • UI: Fix time graph - y axis to account for timezones. (#2711)

    Changed:

    luigi
    • Bump dependencies used by SendGrid integration. (#2715)
    • Update copyright year in LICENSE (#2723)
    luigi.contrib
    • Make RedisTarget compatible with redis-py >= 3 (#2722)