NewYour coding agent can read the release notes before it upgrades.Set up the MCP server →
PyPI
PyPI, #2139 most downloaded on PyPI
HdfsCLI: API and command line interface for HDFS.
Latest stable
2.7.3
Last release 3 years ago
no release in 18 months
Release timing varies
gaps range from 9 days to 1.6 years
Rarely documented
notes for 13 of the last 60 stable releases
Nothing withdrawn
no release was ever pulled
13 years old
81 releases · first in 2014
Drag across the ruler to compare, or tap a release to open it.
Replace imp.load_source() by @musicinmybrain in https://github.com/mtth/hdfs/pull/204
Full Changelog: https://github.com/mtth/hdfs/compare/v2.7.2...v2.7.3
Fix typos by @kianmeng in https://github.com/mtth/hdfs/pull/200
Full Changelog: https://github.com/mtth/hdfs/compare/v2.7.1...v2.7.2
Your coding agent can read these notes before it upgrades. Set up the MCP server →
Run https://github.com/asottile/pyupgrade to fix DeprecationWarnings by @jmcrawford45 in https://github.com/mtth/hdfs/pull/186
Nothing published for this version
Add client snapshot methods
Add client snapshot methods
Add Avro reader schema option
Add Avro reader schema option
Add walk allow_dir_changes option
Add walk allow_dir_changes option
Testing Travis deploy workflow.
Testing Travis deploy workflow.
Add iter attribute to AsyncWriter for pandas compatibility
Add iter attribute to AsyncWriter for pandas compatibility
Nothing published for this version
Tweak HdfsError message handling
Tweak HdfsError message handling
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Add python 3 support (the Kerberos extension's requirements must however be manually installed).
makedirs, set_times, checksum,
set_replication, etc.progress argument to Client.read, Client.upload, and
Client.download. Also add a chunk_size argument to the latter to allow
better tracking.strict option to Client.status and Client.content to perform path
existence checks.Client.write now can be used as a context manager (returning a file-like
object).Client.read and Client.write can now return file-like objects (supporting
read and write calls respectively).KerberosClient. In particular add the
max_concurrency parameter which can be tuned to prevent authentication
errors when too many simultaneous requests are being made. Along with the new
delay parameter, this lets us remove the timeouts in Client.download and
Client.upload, which both simplify and speed up these functions.Config class which handles all CLI configuration (e.g. aliases and
logging).autoload.modules and autoload.paths configuration options.ALIAS.alias (the old format,
ALIAS_alias is still supported).--verbose option to CLI, enabling logging at various levels.fastavro. This speeds up AvroWriter and
AvroReader by a significant amount (~5 times faster on a reasonable
connection).write command to Avro CLI.Breaking changes:
~/.hdfscli.cfg).default.alias option in configuration file (from command
specific section to global).session argument to Client and remove newly redundant parameters
(e.g. verify, cert).Client.from_alias method (delegated to the new Config class). The
Client.from_options method is now public (renamed from
Client._from_options).hdfscli to avoid clashing with Hadoop
HDFS script.Client.delete now returns a boolean indicating success (rather than failing
if the path was already empty).Client.read must now be used inside a with block. This ensures that
connections are properly closed. The context manager now returns a file like
object (useful for composing with other functions, e.g. to decode Avro).
Setting chunk_size to a positive value will make it return a generator
similar to the previous behavior.Client.set_permissions to Client.set_permission to make
permission argument uniform across Client methods (always singular,
consistent with WebHDFS API).Client.parts will now throw an error if called on a normal file.cert, timeout, etc.), except
url and root.-- prefix from CLI commands. Also simplify CLI to only interactive,
download and upload commands (write and read behavior can be achieved by
passing '-' as local path). The Client API changes should make it more
convenient to perform these from a python shell.--log, --force, --version).n_threads option in Client.download and
Client.upload. 0 now means one thread per part-file rather than a single
thread.Client.walk to be consistent with os.walk. Also change meaning of
depth option (0 being unlimited).status option to Client.list, Client.walk, and Client.parts. By
default these functions now only return the names of the relevant files and
folders.Client.append method (replaced by append keyword argument to
Client.write).hdfs module
anymore. This removes the need for some custom error handling (when
dependency requirements weren't met).HDFS_ENTRY_POINT isn't supported anymore).Nothing published for this version
Nothing published for this version
Nothing published for this version
Deprecate Client.append (in favor of append argument to Client.write).
Client.append (in favor of append argument to Client.write).Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Rename Avro extension entry point to hdfs-avro.
hdfs-avro.Nothing published for this version
Added support for remote filepaths with = characters.
= characters.Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
One column per quarter.