Changed

• update toolchain and worflows to build releases with Go 1.26.5; minimum Go version for library users is still 1.25.0. Implemented by Jesús García Crespo

Changed

• update PRONOM to v124
• update go version to 1.25.0

Fixed

• bug with mimeinfo signature generation. Reported by Hugh Williams #287
• wasm_exec.js updated. Reported by Trevor Munoz #287

Change Log

Changed

• update go version to 1.24.0

Added

• Roy speed-up by avoiding function calls in loops. Fixes #148. Implemented by Ross Spencer

Changed

• update PRONOM to v122
• update LOC to 2025-12-09
• update TIKA to v3.2.3

Added

• Filter introduced to improve Wikidata queries and -harvestWikidataSigLen flag sets minimum length of Wikidata signatures. Implemented by Ross Spencer and Andy Jackson
• -noprov flag introduced for Wikidata signatures. Implemented by Ross Spencer
• version command for roy. Implemented by Ross Spencer

Changed

• Wikidata definitions updated to 4.0.0. By Ross Spencer
• Logged error messages have more context. Implemented by Ross Spencer
• update PRONOM to v120
• update LOC to 2025-02-26
• update TIKA to v3.1.0

Fixed

• Explicitly declared variable offsets are parsed e.g. fmt/1840. Implemented by Rijnder Wever

Added

• WASM build. See wasm/README.md for more details. Feature sponsored by Archives New Zealand. Inspired by Andy Jackson
• -sym flag enables following symbolic links to files during scanning. Requested by Max Moser

Changed

• XDG_DATA_DIRS checked when determining siegfried home location. Requested by Michał Górny
• Windows 7 build on releases page (built with go 1.20). Requested by Aleksandr Sergeev
• update PRONOM to v118
• update LOC to 2024-06-14

Fixed

• zips piped into STDIN are decompressed with -z flag. Reported by Max Moser
• panics from OS calls in init functions. Reported by Jürgen Enge

Added

• glob-matching for container signatures; see digital-preservation/pronom#10
• sf -update requires less updating of siegfried; see #231

Changed

• default location for siegfried HOME now follows XDG Base Directory Specification; see #216. Implemented by Bernhard Hampel-Waffenthal
• siegfried prints version before erroring with failed signature load; requested by Ross Spencer
• update PRONOM to v116
• update LOC to 2023-12-14
• update tika-mimetypes to v3.0.0-BETA
• update freedesktop.org to v2.4

Fixed

• panic on malformed zip file during container matching; reported by James Mooney

Changed

• update PRONOM to v116
• update LOC to 2023-12-14
• update tika-mimetypes to v3.0.0-BETA
• update freedesktop.org to v2.4

Fixed

• glob expansion now only on Windows & when no explicit path match. Implemented by Bernhard Hampel-Waffenthal
• compression algorithm for debian packages changed back to xz. Implemented by Paul Millar
• -multi droid setting returned empty results when priority lists contained self-references. See #218
• CGO disabled for debian package and linux binaries. See #219

Added

• format classification included as "class" field in PRONOM results. Requested by Robin François. Implemented by Ross Spencer
• -noclass flag added to roy build command. Use this flag to build signatures that omit the new "class" field from results.
• glob paths can be used in place of file or directory paths for identification (e.g. sf *.jpg). Implemented by Ross Spencer
• -multi droid setting for roy build command. Applies priorities after rather than during identificaiton for more DROID-like results. Reported by David Clipsham
• /update command for server mode. Requested by Luis Faria

Changed

• new algorithm for dynamic multi-sequence matching for improved wildcard performance
• update PRONOM to v111
• update LOC to 2023-01-27
• update tika-mimetypes to v2.7.0
• minimum go version to build siegfried is now 1.18

Fixed

• archivematica extensions built into wikidata signatures. Reported by Ross Spencer
• trailing slash for folder paths in URI field in droid output. Reported by Philipp Wittwer
• crash when using sf -replay with droid output

Changed

• update PRONOM to v109

Added

• roy inspect now takes a -droid flag to allow easier inspection of old or custom DROID files
• github action to update siegfried docker deployment [https://github.com/keeps/siegfried-docker]. Implemented by Keep Solutions

Changed

• update PRONOM to v108
• update tika-mimetype signatures to v2.4.1
• update LOC signatures to 2022-09-01

Fixed

• incorrect encoding of YAML strings containing line endings; #202.
• parse signatures with offsets and offsets in patterns e.g. fmt/1741; #203

Added

• new pkg/static and static builds. This allows direct use of sf API and self-contained binaries without needing separate signature files.

Changed

• update PRONOM to v106

Fixed

• inconsistent output for roy inspect priorities. Reported by Dave Clipsham

Added

• JS/WASM build support contributed by Andy Jackson
• wikidata signature added to -update. Contributed by Ross Spencer
• -nopronom flag added to roy inspect subcommand. Contributed by Ross Spencer

Changed

• update PRONOM to v104
• update LOC signatures to 2022-05-09
• update Wikidata to 2022-05-20
• update tika-mimetypes signatures to v2.4.0
• update freedesktop.org signatures to v2.2

Fixed

• invalid JSON output for fmt/1472 due to tab in MIME field. Reported by Robert Schultz
• panic on corrupt Zip containers. Reported by A. Diamond

Added

• Wikidata definition file specification has been updated and now includes endpoint (users will need to harvest Wikidata again)
• Custom Wikibase endpoint can now be specified for harvesting when paired with a custom SPARQL query and property mappings
• Wikidata identifier includes permalinks in results
• Wikidata revision history visible using roy inspect
• roy inspect returns format ID with name

Changed

• update PRONOM to v100
• update LOC signatures to 2022-02-01
• update tika-mimetypes signatures to v2.2.1
• update freedesktop.org signatures to v2.1

Fixed

• parse issues for container files where zero indexing used for Position. Spotted by Ross Spencer
• sf -droid output can't be read by sf (e.g. for comparing results). Reported by ostnatalie
• panic when running in server mode due to race condition. Reported by Miguel Guimarães
• panic when reading malformed MSCFB files. Reported by Greg Lepore
• unescaped control characters in JSON output. Reported by Sebastian Lange
• zip file names with null terminated strings prevent ID of Serif formats. Reported by Tyler Thorsted

Changed

• update PRONOM to v97
• zs flag now activates -z flag

Fixed

• details text in PRONOM identifier
• roy panic when building signatures with empty sequences. Reported by Greg Lepore

Added

• a new Wikidata identifier, harvesting information from the Wikidata Query Service. Implemented by Ross Spencer.
• select which archive types (zip, tar, gzip, warc, or arc) are unpacked using the -zs flag (sf -zs tar,zip). Implemented by Ross Spencer.

Changed

• update LOC signatures to 2020-09-21
• update tika-mimetypes signatures to v1.24
• update freedesktop.org signatures to v2.0

Fixed

• incorrect basis for some signatures with multiple patterns. Reported and fixed by Ross Spencer.

Added

• utc flag returns file modified dates in UTC e.g. sf -utc FILE | DIR. Requested by Dragan Espenschied
• new cost and repetition flags to control segmentation when building signatures

Changed

• update PRONOM to v96
• update LOC signatures to 2019-12-18
• update tika-mimetypes signatures to v1.23
• update freedesktop.org signatures to v1.15

Fixed

• XML namespaces detected by prefix on root tag, as well as default namespace (for mime-info spec)
• panic when scanning certain MS-CFB files. Reported separately by Mike Shallcross and Euan Cochrane
• file with many FF xx sequences grinds to a halt. Reported by Andy Foster

Added

• the -f flag now scans directories, as well as files. Requested by Harry Moss

Changed

• update LOC signatures to 2019-06-16
• update tika-mimetypes signatures to v1.22

Fixed

• filenames with "?" were parsed as URLs; reported by workflowsguy

Changed

• update PRONOM to v95
• update LOC signatures to 2019-05-20
• update tika-mimetypes signatures to v1.21

Fixed

• .docx files with .doc extensions panic due to bug in division of hints in container matcher. Thanks to Jean-Séverin Lair for reporting and sharing samples and to VAIarchief for additional report with example.
• mime-info signatures panic on some files due to duplicate entries in the freedesktop and tika signature files; spotted during an attempt at pair coding with Ross Spencer... thanks Ross and sorry for hogging the laptop! #125

Changed

• update LOC signatures to 2019-01-06
• update tika-mimetypes signatures to v1.20

Fixed

• container matching can now match against directory names. Thanks Ross Spencer for reporting and for the sample SIARD signature file. Thanks Dave Clipsham, Martin Hoppenheit and Phillip Tommerholt for contributions on the ticket.
• fixes to travis.yml for auto-deploy of debian release; #124

Added

• print configuration defaults with sf -version

Changed

• update PRONOM to v94

Fixed

• LOC identifier fixed after regression in v1.7.9
• remove skeleton-suite files triggering malware warnings by adding to .gitignore; reported by Dave Rice
• release built with Go version 11, which includes a fix for a CIFS error that caused files to be skipped during file walk; reported by Maarten Savels

Added

• save defaults in a configuration file: use the -setconf flag to record any other flags used into a config file. These defaults will be loaded each time you run sf. E.g. sf -multi 16 -setconf then sf DIR (loads the new multi default)
• use -conf filename to save or load from a named config file. E.g. sf -multi 16 -serve :5138 -conf srv.conf -setconf and then sf -conf srv.conf
• added -yaml flag so, if you set json/csv in default config :(, you can override with YAML instead. Choose the YAML!

Changed

• the roy compare -join options that join on filepath now work better when comparing results with mixed windows and unix paths
• exported decompress package to give more functionality for users of the golang API; requested by Byron Ruth
• update LOC signatures to 2018-06-14
• update freedesktop.org signatures to v1.10
• update tika-mimetype signatures to v1.18

Fixed

• misidentifications of some files e.g. ODF presentation due to sf quitting early on strong matches. Have adjusted this algorithm to make sf wait longer if there is evidence (e.g. from filename) that the file might be something else. Reported by Jean-Séverin Lair
• read and other file errors caused sf to hang; reports by Greg Lepore and Andy Foster; fix contributed by Ross Spencer
• bug reading streams where EOF returned for reads exactly adjacent the end of file
• bug in mscfb library (race condition for concurrent access to a global variable)
• some matches result in extremely verbose basis fields; reported by Nick Krabbenhoeft. Partly fixed: basis field now reports a single basis for a match but work remains to speed up matching for these cases.

Changed

• update LOC signatures to 2017-09-28
• update PRONOM signatures to v93

Added

• version information for MIME-info signatures (freedesktop.org and tika-mimetypes) now recorded in mime-info.json file and presented in results
• new sets file for PRONOM extensions. This creates sets like @.doc and @.txt (i.e. all PUIDs with those extensions). Allows you to do commands like roy build -limit @.doc,@.docx, roy inspect @.txt and sf -log @.pdf,o DIR

Changed

• update freedesktop.org signatures to v1.9

Fixed

• out of memory error when using sf -z on compressed files that contain very large files; reported by Terry Jolliffe
• report errors that occur during file decompression. Previously, only fatal errors encountered when a compressed file is first opened were reported. Now errors that are encountered while attempting to walk the contents of a compressed file are also reported.
• report errors for 'roy inspect' when roy can't find anything to inspect; reported by Ross Spencer

Added

• continue on error flag (-coe) can now be used to continue scans despite fatal file errors that would normally cause scanning to halt. This may be useful e.g. for big directory scans over unreliable networks. Usage: sf -coe DIR

Changed

• update PRONOM signatures to v92

Fixed

• file scanning is now restricted to regular files (i.e. not symlinks, sockets, devices etc.). Reported by Henk Vanstappen.
• windows longpath fix now works for paths that appear short

Added

• signature updates for PRONOM, LOC and tika-mimetypes

Changed

• roy inspect accepts space as well as comma-separated lists of formats e.g. roy inspect fmt/1 fmt/2

Added

• roy inspect FMT command now inspects sets e.g. roy inspect @pdfa
• roy inspect priorities command generates graphs of priority relations

Fixed

• container matcher running when empty (i.e. for freedesktop/tika signature files and when -nocontainer flag used with PRONOM)
• -doubleup flag preventing signature extensions loading: since v1.3.0 signature extensions included with the -extend flag haven't been loading properly due to interaction with the doubles filter (which prevents byte signatures loading for formats that also have container signatures defined)

Changed

• use fwac rather than wac package for performance
• roy inspect FMT command speed up by building without reports and without the doubles filter
• -reports flag removed for roy harvest and roy build commands
• -reports flag changed for roy inspect command, now a boolean that, if set, will cause the signature(s) to be built from the PRONOM report(s), rather than the DROID XML file. This is slower but can be a more accurate representation.

Added

• roy inspect FMT command now gives details of all signatures, including container signatures

Fixed

• misidentification: x-fmt/45 files misidentified as fmt/40 due to repetition of elements in container file
• roy build -noreports includes blank extensions that generate false matches; reported by Ross Spencer

Fixed

• poor performance unknowns due to interaction of -bof/-eof flags with known BOF/EOF calculation; reported by Ross Spencer
• unnecessary warnings for mimeinfo identifier
• add fddXML.zip to .gitattributes to preserve newlines
• various Go Report Card issues

Added

• Travis and Appveyor CI automated deployment to Github releases and Bintray
• PRONOM v85 signatures
• LICENSE.txt, CHANGELOG.md
• Go Report Card

Fixed

• golang.org/x/image/riff bug (reported here)
• misspellings reported by Go Report Card
• ineffectual assignments reported by Go Report Card

Added

• implement Library of Congress FDD signatures (beta)
• implement RIFF matcher
• -multi flag replaces -nopriority; based on report by Ross Spencer

Changed

• change to -z output: use hash as filepath separator (and unix slash for webarchives); requested by Ross Spencer

Fixed

• parsing fmt/837 signature; reported by Sarah Romkey