github.com/moov-io/ach

IMPROVEMENTS

• api: fixup EntryDetail required fields
• api: label required fields on EntryDetail
• feat: Addenda99.SetOriginalEntryReturnDate
• feat: Parse Addenda99.AddendaInformation
• feat: improve addenda99 for dishonored returns
• feat: add CheckingReturnNOCCredit to list of valid ATX txn codes (#21)
• fix BatchHeader.EffectiveEntryDateField (#20)
• fix: Don't truncate Addenda99.AddendaInformation
• fix: trim "R" in dishonored and contested setter
• test: verify "!" is allowed in isAlphanumeric

BUILD

• build(deps): bump actions/download-artifact from 1 to 4
• build(deps): bump actions/upload-artifact from 1 to 4
• build(deps): bump github.com/moov-io/base from 0.48.2 to 0.48.3 (#1341)
• build(deps): bump github.com/aws/aws-lambda-go from 1.41.0 to 1.43.0 (#1346)
• build(deps): bump github/codeql-action from 2 to 3 (#1342)
• build(deps): bump github.com/prometheus/client_golang
• build(deps): bump github.com/aws/aws-lambda-go from 1.43.0 to 1.44.0
• build(deps): bump golang.org/x/net from 0.19.0 to 0.20.0
• build(deps): bump github.com/moov-io/base from 0.48.3 to 0.48.5
• build(deps): bump actions/cache from 3 to 4
• build(deps): bump github.com/aws/aws-lambda-go from 1.44.0 to 1.45.0
• chore(deps): update dependency jekyll-feed to v0.17.0 (#1337)

IMPROVEMENTS

• all: fix errors found by nilaway
• api: update amount to be long to allow handling of amounts larger than 21M (#1335)
• webui: better overflow layout

BUILD

• build(deps): bump actions/setup-go from 4 to 5
• build(deps): bump golang.org/x/net from 0.18.0 to 0.19.0

IMPROVEMENTS

• docs: improve TraceNumber
• fix: check .UnequalAddendaCounts in CTX validation

BUILD

• build(deps): bump golang.org/x/net from 0.17.0 to 0.18.0
• fix(deps): update module github.com/moov-io/base to v0.48.2

IMPROVEMENTS

• fix: Parse FileIdModifier from file header; don't assume 'A'
• fix: revert "reduce allocations when parsing FileHeader"
• test/issues: verify FileIDModifier is read

BUILD

• build(deps): bump github.com/moov-io/base from 0.47.0 to 0.47.1

This release contains multiple performance improvements ontop of what v1.33.0 has included. The comparison to v1.32.2 is below:

<details> <summary>v1.32.2 compared to v1.33.1</summary>

BenchmarkParsing/Read_../testdata/20110805A.ach-16         	    1840	    632450 ns/op	   97797 B/op	    1953 allocs/op
BenchmarkParsing/Read_../testdata/20110805A.ach-16         	    1909	    606422 ns/op	   57270 B/op	     922 allocs/op

BenchmarkParsing/IAT-16                                    	    4615	    232996 ns/op	   45724 B/op	     410 allocs/op
BenchmarkParsing/IAT-16                                    	    4666	    230543 ns/op	   31823 B/op	     306 allocs/op

BenchmarkFile/String-16                                    	    5512	    206355 ns/op	   35503 B/op	    1282 allocs/op
BenchmarkFile/String-16                                    	    6181	    188959 ns/op	   30261 B/op	     639 allocs/op

</details>

IMPROVEMENTS

• feat: optimize parsing of ADVBatchControl and FileControl
• feat: reduce allocations when parsing records
• fix: allocate returned array in ReadFiles and ReadDir once
• fix: use shared buffer when rendering EntryDetail
• test: verify IAT batches are skipped in Iterator

BUILD

• chore(deps): update ossf/scorecard-action action to v2.3.1

Moov ACH v1.33.0 has undergone some major performance tuning and improvements. Please let us know if you encounter any issues when using the improved code, thanks!

ADDITIONS

• feat: add a File iterator
• feat: add benchmark for ReadFile and Iterator
• fix: produce entries from iterator that are outside of batches

IMPROVEMENTS

• feat: check for valid JSON before parsing
• fix: avoid nil panic with malformed readers
• fix: process entry rune-by-rune without casting between string -> rune -> string
• fix: skip directories in ReadDir
• perf: reduce allocations in formatting strings
• perf: reduce allocations when checking routing numbers
• perf: use sync.Pool of bytes.Buffer objects grown to max field size
• test: benchmark merging files in groups

BUILD

• cmd/webui: force wasm_exec.js to go1.21.0 version
• fix(deps): update module golang.org/x/net to v0.17.0
• fix(deps): update module golang.org/x/oauth2 to v0.13.0

IMPROVEMENTS

• fix: Corrected Data is 29 characters, not 22
• fix: don't print blank line for missing IAT addendas
• test/issues: match IAT output byte-for-byte

BUILD

• build(deps): bump golang from 1.20-alpine to 1.21-alpine

IMPROVEMENTS

• feat: detect Windows-1252 encoding and decode to utf-8
• fix: parse field lengths according by runes instead of bytes

BUILD

• build(deps): bump github.com/moov-io/iso4217 from 0.2.1 to 0.3.0
• fix(deps): update module github.com/moov-io/base to v0.45.1

IMPROVEMENTS

• feat: add Addenda98Refused
• fix: SetTraceNumber should populate contested and dishonored returns
• fix: allow full range of ASCII and EBCDIC characters accepted by Nacha rules

BUILD

• build: run Go tests on Windows
• build(deps): bump github.com/moov-io/base from 0.44.0 to 0.45.0
• build(deps): bump golang.org/x/text from 0.10.0 to 0.11.0
• chore(deps): update ossf/scorecard-action action to v2.2.0

IMPROVEMENTS

• fix: allow .Create() to skip validation when configured

BUILD

• build(deps): bump actions/checkout from 2 to 3
• chore: update github.com/prometheus/client_golang to v1.16.0
• chore: update golang.org/x/text to v0.10.0

IMPROVEMENTS

• fix: return empty strings when records are nil
• build: split "make docker" into its own job
• build: remove docker build and openapi generate from Linux CI
• build: replace fuzzer library with Go standard library
• build: switch to the new moov-io/iso4217 library
• build: fix description of addenda99

BUILD

• fix(deps): update github.com/stretchr/testify to v1.8.4
• build(deps): bump github.com/moov-io/base from 0.42.0 to 0.44.0
• build(deps): bump actions/setup-go from 2 to 4
• fix(deps): update github.com/moov-io/iso4217 to v0.2.1

IMPROVEMENTS

• build: fix openshift image, upgrade to ubi9
• cmd/server: fix log format flag logic

BUILD

• build(deps): bump bulma-clean-theme from 0.13.2 to 0.13.3 in /docs
• build(deps): bump github.com/stretchr/testify from 1.8.2 to 1.8.3

IMPROVEMENTS

• fix: BatchHeaders are different with mismatching CompanyEntryDescription values

BUILD

• build(deps): bump github.com/moov-io/base from 0.41.0 to 0.42.0
• build(deps): bump github.com/aws/aws-lambda-go from 1.40.0 to 1.41.0
• chore(deps): update dependency jekyll-feed to v0.17.0

IMPROVEMENTS

• fix: Allow returned prenotes to have a zero'd Amount field
• fix: make CTX setters/getters return correct results
• fix: validate CTX addenda records and indicator correctly
• test: use a static file header for Contested/Dishonored returns

BUILD

• build(deps): bump golang.org/x/oauth2 from 0.5.0 to 0.7.0

IMPROVEMENTS

• cmd/achcli: return whatever partial file was parsed
• feat: add AllowInvalidAmounts validation option
• feat: add Merge which can override ValidateOpts of files
• server: support AllowInvalidAmounts validation option

BUILD

• build(deps): bump commonmarker from 0.23.8 to 0.23.9 in /docs
• build(deps): bump github.com/aws/aws-lambda-go from 1.39.1 to 1.40.0
• build(deps): bump github.com/moov-io/base from 0.40.1 to 0.40.2
• build(deps): bump nokogiri from 1.13.10 to 1.14.3 in /docs
• build(deps): update github.com/prometheus/client_golang to v1.15.0

Version v1.30.0 of moov-io/ach introduces a new ErrFileConsecutiveBatchHeaders error which replaces ErrFileBatchHeaderInsideBatch to better reflect when file parsing failed. The library can now accept ACH files without Batch Control records.

IMPROVEMENTS

• fix: accumulate batches without BatchControl records

IMPROVEMENTS

• fix: allow IAT as transaction type code of addenda10 records
• fix: keep zero-prefix trace numbers during offset creation

BUILD

• build(deps): bump github.com/moov-io/base from 0.39.0 to 0.40.1
• build(deps): bump golang.org/x/text from v0.8.0 to v0.9.0
• chore(deps): update dependency jekyll-feed to v0.17.0

IMPROVEMENTS

• fix: include Offset in API docs and read from JSON

BUILD

• build(deps): bump activesupport from 6.1.7.2 to 7.0.4.3 in /docs
• build(deps): bump bulma-clean-theme from 0.13.1 to 0.13.2 in /docs
• build(deps): bump github.com/aws/aws-lambda-go from 1.38.0 to 1.39.1
• build(deps): bump github.com/stretchr/testify from 1.8.1 to 1.8.2
• build(deps): bump ossf/scorecard-action from 2.1.2 to 2.1.3

Shout-out to @ckbaum for contributing a major improvement to File Flattening.

IMPROVEMENTS

• feat: Don't combine two batches if they share any trace numbers.
• feat: Make an effort to preserve original batch ordering.
• feat: expose named errors (and ask for bug reports) from FlattenFile

BUILD

• build: tighten up GITHUB_TOKEN permissions
• build: Apply security best practices from StepSecurity
• build(deps): bump ossf/scorecard-action from 2.0.6 to 2.1.2
• chore(deps): update dependency tzinfo to "~> 2.0"
• fix(deps): update module github.com/juju/ansiterm to v1

IMPROVEMENTS

• chore: remove wasteful debug printf
• fix: validate amounts in non-prenote entries
• test: convert log.Fatal over to t.Fatal
• test: verify ValidAmountForCodes works as expected

BUILD

• build: update golang.org/x/sys/unix
• build(deps): bump activesupport from 6.0.3.7 to 6.0.6.1 in /docs
• chore(deps): update golang docker tag to v1.20
• fix(deps): update module github.com/moov-io/base to v0.39.0
• fix(deps): update module golang.org/x/text to v0.7.0

ADDITIONS

• Add ValidateOpts to BatchControl.
• Add use of PreserveSpaces validate opt in BatchControl, BatchHeader, and EntryDetail.

IMPROVEMENTS

• fix: trim DFIAccountNumber by default

BUILD

• chore: generate iso3166 and iso4217 code, no changes
• fix(deps): update module github.com/aws/aws-lambda-go to v1.37.0
• test: use testify assert package for Valid unit tests change packages to *_test

ADDITIONS

• Add -pretty.amounts CLI flag to show human readable amounts
• Add -skip-validation add option to skip all validations
• Add -validate CLI flag to read files with ValidateOpts
• feat: add option to skip all validations

IMPROVEMENTS

• fix: properly count string lengths when padding fields
• test: verify EntryDetail record lengths are valid for all return codes

BUILD

• build: enable Go test shuffle
• fix(deps): update module golang.org/x/oauth2 to v0.4.0
• fix(deps): update module golang.org/x/text to v0.6.0

IMPROVEMENTS

• fix: allow missing TerminalIdentificationCode in Addenda02