pyshp

Merge pull request #427 from JamesParrott/Slightly_faster

v3.1.3 speed up encoding of utf8 and ascii text

Merge pull request #425, Raise error when strings end in code points …

…that encode to pad bytes

Raise error when strings end in code points that encode to pad bytes

Add notes about Unicode handling to Readme

Merge pull request #424 from JamesParrott/Test_utf16_encoded_field_names

v3.1.1 Warn if text encoding ends in pad bytes. Minimise pad bytes used in decodings.

Unicode support made more robust and encoding bugs fixed

• Truncation of field names and text fields now respects unicode code point boundaries (fixes issues -
  416 and 148).
• Warnings raised if truncation, or replacing b" " with b"_" would corrupt encoded field names, -
  both if they would either be undecodable, or would silently decode to incorrect data (warns users
  if issue 421 applies).
• Correctly truncated field names are now stored in field instances, as would actually be seen in the file.
• New strict mode. Writer(strict=True) raises errors or refuse to create fields and text records with data that -
  would be truncated or cannot be correctly decoded back again by PyShp, exactly as given by the user.
• In strict mode, ascii spaces in encoded names are no longer replaced by ascii underscores at all
  (work around to avoid corrupting unicode field names - provides opt-in fix for issue 421).
• BREAKING. When reading .dbf files, Trailing ascii spaces in text fields before a null terminator char (in the -
  decoded string) is now removed (i.e. instead of .strip().rstrip('\x00') we now do: .rstrip("\x00").rstrip(" ")).
• BREAKING. Enclosing Whitespace other than trailing ascii spaces (0x20) after null chars in text fields is now -
  preserved, when reading .dbf files (fixes issue 418 - James feels this was a bug. Let him know if you think otherwise).
• BREAKING Trailing null chars other than null terminators & null padding bytes, followed by whitespace other than
  ascii spaces, are now preserved.
• Writing dbf records is now atomic.

ShpWriter.shape API Tweak (small breaking change).

• Make ShpWriter.shape return shape length in bytes (the
  same as for offset) not in 16 bit words.

Testing

• Include NullShapes in shp round trip test.
• En/decoding of Dbf files and Fields round trips correctly.

Merge pull request #413 from JamesParrott/Test_shp_files_roundtrip

v3.0.13. Don't error when reading empty shp files (bug fix).

Merge pull request #409 from JamesParrott/Polylines_and_Polygons

v3.0.12. 3D Point coords

What's Changed

• Make Reader and Writer stricter about their args. Use pathlib.Paths … by @JamesParrott in https://github.com/GeospatialPython/pyshp/pull/401
• Add ShpReader, ShxReader, ShpWriter and ShxWriter. Reduce clutter from tests, by using temp dirs for writing shapefiles. by @JamesParrott in https://github.com/GeospatialPython/pyshp/pull/402

Full Changelog: https://github.com/GeospatialPython/pyshp/compare/3.0.8...3.0.9

What's Changed

• Add DbfWriter and refactor Writer to use it by @JamesParrott in https://github.com/GeospatialPython/pyshp/pull/391

Full Changelog: https://github.com/GeospatialPython/pyshp/compare/3.0.7...3.0.8

What's Changed

• Separate DbfReader by @JamesParrott in https://github.com/GeospatialPython/pyshp/pull/390

Full Changelog: https://github.com/GeospatialPython/pyshp/compare/3.0.6...3.0.7

What's Changed

• Test polygonz files, with no z and no m by @JamesParrott in https://github.com/GeospatialPython/pyshp/pull/387
• Make downloading from Github slightly less annoying. Refactor common URL and NamedTemporaryFile code. by @JamesParrott in https://github.com/GeospatialPython/pyshp/pull/389

Full Changelog: https://github.com/GeospatialPython/pyshp/compare/3.0.5...3.0.6

What's Changed

• Use dependency groups for dev and test (PEP 735) by @mwtoews in https://github.com/GeospatialPython/pyshp/pull/386

Full Changelog: https://github.com/GeospatialPython/pyshp/compare/3.0.4...3.0.5

Fix pyshp-stubs

What's Changed

• Bump GitHub Actions versions to those based on Node.JS 24 (checkout v6, setup-python v6 & upload-artefact v7) by @JamesParrott in https://github.com/GeospatialPython/pyshp/pull/383
• Bump actions/download-artifact to v8 by @JamesParrott in https://github.com/GeospatialPython/pyshp/pull/384
• Vendor pre-commit/action by @JamesParrott in https://github.com/GeospatialPython/pyshp/pull/385

Full Changelog: https://github.com/GeospatialPython/pyshp/compare/3.0.3...3.0.4

Bug fixes:

• Fix recently introduced issue where Reader/Writer closes file-like objects provided by user (#244)

New Features:

• Added support for pathlib and path-like shapefile filepaths (@mwtoews).
• Allow reading individual file extensions via filepaths.

Improvements:

• Simplified setup and deployment (@mwtoews)
• Faster shape access when missing shx file
• Switch to named logger (see #240)

Bug fixes:

• More robust handling of corrupt shapefiles (fixes #235)
• Fix errors when writing to individual file-handles (fixes #237)
• Revert previous decision to enforce geojson output ring orientation (detailed explanation at https://github.com/SciTools/cartopy/issues/2012)
• Fix test issues in environments without network access (@sebastic, @musicinmybrain).

New Features:

• Read shapefiles directly from zipfiles.
• Read shapefiles directly from urls.
• Allow fast extraction of only a subset of dbf fields through a fields arg.
• Allow fast filtering which shapes to read from the file through a bbox arg.

Improvements:

• More examples and restructuring of README.
• More informative Shape to geojson warnings (see #219).
• Shape object information when calling repr().
• Faster ring orientation checks, enforce geojson output ring orientation.

Bug fixes:

• Remove null-padding at end of some record character fields.
• Fix dbf writing error when the number of record list or dict entries didn't match the number of fields.
• Handle rare garbage collection issue after deepcopy (https://github.com/mattijn/topojson/issues/120)
• Fix bug where records and shapes would be assigned incorrect record number (@karanrn)
• Fix typos in docs (@timgates)

Bug fixes:

• Fix recent bug in geojson hole-in-polygon checking (see #205)
• Misc fixes to allow geo interface dump to json (eg dates as strings)
• Handle additional dbf date null values, and return faulty dates as unicode (see #187)
• Add writer target typecheck
• Fix bugs to allow reading shp/shx/dbf separately
• Allow delayed shapefile loading by passing no args
• Fix error with writing empty z/m shapefile (@mcuprjak)
• Fix signed_area() so ignores z/m coords
• Enforce writing the 11th field name character as null-terminator (only first 10 are used)
• Minor README fixes
• Added more tests

Bug fixes:

• Fix issue where warnings.simplefilter('always') changes global warning behavior [see #203]

Improvements:

• Handle shapes with no coords and represent as geojson with no coords (GeoJSON null-equivalent)
• Expand testing to Python 3.6, 3.7, 3.8 and PyPy; drop 3.3 and 3.4
• Added pytest testing

Bug fixes:

• Fix incorrect geo interface handling of multipolygons with complex exterior-hole relations
• Enforce shapefile requirement of at least one field, to avoid writing invalid shapefiles
• Fix Reader geo interface including DeletionFlag field in feature properties
• Fix polygons not being auto closed, which was accidentally dropped
• Fix error for null geometries in feature geojson
• Misc docstring cleanup

New Features:

• Added back read/write support for unicode field names.
• Improved Record representation
• More support for geojson on Reader, ShapeRecord, ShapeRecords, and shapes()

Bug fixes:

• Fixed error when reading optional m-values
• Fixed Record attribute autocomplete in Python 3
• Misc readme cleanup

Fix pip install setup.py README decoding error.

Major new version. See README or changelog.txt.

• Fixed errors caused by strict value type checking, as introduced in v1.2.11. Now more lenient by attempting force conversion of values to match the field type.
• Allow reading file-like objects without seek method (such as ZipFile or urllib.urlopen).

• Fixed bugs when reading and writing empty shapefiles.
• Fixed bug when writing null geometry.
• Fixed misc data type errors.
• Fixed error when reading files with wrong record length.
• Use max field precision when saving decimal numbers.
• Improved shapetype detection.
• Expanded docs on data types ++.

Bump version to fix pip install issue.

• Revert back to fix #66
• Update changelog and version information

Bugfix for Python3 with Reader.iterShapeRecords()

Adds Reader.iterShapeRecords() for reading large shapefiles