luigi.contrib
Package containing optional and-on functionality.
Modules
AWS Batch wrapper for Luigi |
|
Specialized tasks for handling Avro data in BigQuery from GCS. |
|
Docker container wrapper for Luigi. |
|
Support for Elasticsearch (1.0.0 or newer). |
|
Template tasks for running external programs as luigi tasks. |
|
This library is a wrapper of ftplib or pysftp. |
|
Common code for GCP (google cloud services) integration |
|
luigi bindings for Google Cloud Storage |
|
Run Hadoop Mapreduce jobs using Hadoop Streaming. |
|
Provides functionality to run a Hadoop job using a Jar |
|
Provides access to HDFS using the |
|
Kubernetes Job wrapper for Luigi. |
|
Since after Luigi 2.5.0, this is a private module to Luigi. |
|
OpenerTarget support, allows easier testing and configuration by abstracting out the LocalTarget, S3Target, and MockTarget types. |
|
MicroSoft OpenPAI Job wrapper for Luigi. |
|
Apache Pig support. Example configuration section in luigi.cfg::. |
|
Implements a subclass of |
|
The pyspark program. |
|
A common module for postgres like databases, such as postgres or redshift |
|
Implementation of Simple Storage Service support. |
|
SGE batch system Tasks. |
|
The SunGrid Engine runner |
|
A module containing classes used to simulate certain behaviors |
|
Support for SQLAlchemy. |
|
Light-weight remote execution library and utilities. |
|
Provides a |