luigi.contrib.mysqldb module¶
-
class
luigi.contrib.mysqldb.
MySqlTarget
(host, database, user, password, table, update_id, **cnx_kwargs)[source]¶ Bases:
luigi.target.Target
Target for a resource in MySql.
Initializes a MySqlTarget instance.
Parameters: - host (str) – MySql server address. Possibly a host:port string.
- database (str) – database name.
- user (str) – database user
- password (str) – password for specified user.
- update_id (str) – an identifier for this data set.
- cnx_kwargs – optional params for mysql connector constructor. See https://dev.mysql.com/doc/connector-python/en/connector-python-connectargs.html.
-
marker_table
= 'table_updates'¶
-
class
luigi.contrib.mysqldb.
CopyToTable
(*args, **kwargs)[source]¶ Bases:
luigi.contrib.rdbms.CopyToTable
Template task for inserting a data set into MySQL
Usage: Subclass and override the required host, database, user, password, table and columns attributes.
To customize how to access data from an input task, override the rows method with a generator that yields each row as a tuple with fields ordered according to columns.
-
output
()[source]¶ Returns a MySqlTarget representing the inserted dataset.
Normally you don’t override this.
-
run
()[source]¶ Inserts data generated by rows() into target table.
If the target table doesn’t exist, self.create_table will be called to attempt to create the table.
Normally you don’t want to override this.
-
bulk_size
¶
-