luigi.contrib.hdfs.clients module

The implementations of the hdfs clients. The hadoop cli client and the snakebite client.

luigi.contrib.hdfs.clients.get_autoconfig_client(client_cache=<thread._local object>)

Creates the client as specified in the luigi.cfg configuration.

luigi.contrib.hdfs.clients.exists(*args, **kwargs)

luigi.contrib.hdfs.clients.rename(*args, **kwargs)

luigi.contrib.hdfs.clients.remove(*args, **kwargs)

luigi.contrib.hdfs.clients.mkdir(*args, **kwargs)

luigi.contrib.hdfs.clients.listdir(*args, **kwargs)