github.com/moov-io/watchman

IMPROVEMENTS

• cmd/server: add match score to OpenAPI search entities
• cmd/server: document CSL separation in struct

BUILD

• chore(deps): update dependency @material-ui/core to v4.12.2

BUG FIXES

• cmd/server: nil check on setting updated records
• download: fixup reading of initial dir rather than downloading
• dpl: find file rather than assume its index

IMPROVEMENTS

• cmd/server: misc improvements from linters

BUILD

• build(deps): bump addressable from 2.7.0 to 2.8.0 in /docs
• chore(deps): update dependency @material-ui/core to v4.12.1
• cmd/server: add benchmark for ?minMatch=0.50
• cmd/server: add benchmarks for various SDN search queries
• fix(deps): update react monorepo to v17
• fix: Dockerfile to reduce vulnerabilities
• fix: upgrade react-scripts from 4.0.1 to 4.0.3
• test: add static set of files for benchmarks

This release improves search results by filtering as part of scoring instead of after the fact. Users should see more results returned for queries now.

ADDITIONS

• cmd/server: add ?minMatch=0.95 query param for searching

IMPROVEMENTS

• cmd/server: remove unneeded X-User-ID HTTP headers
• cmd/server: filter as part of searching, not after the fact

BUILD

• build: split CI into multiple jobs for parallel runs

BUG FIXES

• cmd/server: nil check on webhook response body prior to Close

BUILD

• build(deps): bump nokogiri from 1.11.1 to 1.11.5 in /docs

BUG FIXES

• csl: don't panic if list comes back invalid

BUILD

• build(deps): bump rexml from 3.2.4 to 3.2.5 in /docs
• chore(deps): update dependency @material-ui/core to v4.11.4

IMPROVEMENTS

• cmd/server: concurrently search instead of serial iterations

BUILD

• build: upgrade github.com/gogo/protobuf to v1.3.2

IMPROVEMENTS

• chore(deps): update golang docker tag to v1.16

ADDITIONS

• search: introduce EXACT_MATCH_FAVORITISM config to optionally boost match rates

IMPROVEMENTS

• docs: lots of fixups and clarifications

BUG FIXES

• csl: fix parsing with newer CSV format

BUILD

• fix: upgrade react-scripts from 4.0.0 to 4.0.1

ADDITIONS

• api,client: add SdnType and SsiType models
• docs: include a page for prometheus metrics
• server: Add last_data_refresh_failure{source="SDNs"} Prometheus metric

BUG FIXES

• build: fixup OpenShift image, rely on glibc

BUILD

• chore(deps): update mui monorepo to v4.11.2
• fix(deps): pin dependency react-scripts to 4.0.0

BUG FIXES

• search: filter countries rather than rank
  • Previously we would only include the top N (?limit query param) results by country which could exclude valid search results from the final returend list. Now we filter the list and rank according to all data records matching the specified country.
• search: OR NameAndAddress results
  • Previous we would use AND semantics for returning "name and address" results even though they populated two different JSON arrays. Now we return the highest N SDNs and Addresses when both query params are specified.

BUG FIXES

• webui: fix Country "All" value so it's not passed through to query params

IMPROVEMENTS

• batchsearch: include final success message
• webui: fix warnings after react upgrade
• webui: include a links section in the header

BUILD

• fix(deps): update react monorepo to v16.14.0
• webui: run "npm audit fix"

BUG FIXES

• pkg/ofac: skip sdn_comments.csv lines if they contain the incorrect number of fields

IMPROVEMENTS

• docs/search: include supported combinations of query params

BUILD

• admin,client: update codegen, reference base Error model

BREAKING CHANGES

Watchman has upgraded the implementation of the Jaro-Winkler string comparison algorithm to fix bugs and match the original paper's reference implementation. After upgrading Watchman you will notice higher match percentages for most comparisons. See pull request #282 for the change.

BUG FIXES

• search: skip calling webhooks if we don't render a body
• search: test body creation in async methods

BUILD

• chore(deps): update golang docker tag to v1.15
• docs: re-order "getting started" to suggest docker image

BUG FIXES

• csl: fix reader to handle files with unique IDs
• search: reference appropriate SDN for webhook body
• webhooks: handle nil Response without a panic

BUILD

• webui: run 'npm audit fix'

BUILD

• build: add OpenShift docker image
• build: upgrade golang.org/x/text to v0.3.3
• chore(deps): update dependency @material-ui/core to v4.11.0

ADDITIONS

• build: add moov/watchman:static image for better test instances
• cmd/server: add version handler to admin HTTP server
• cmd/server: record download counts per entity type in last_data_refresh_count Prometheus metric

IMPROVEMENTS

• admin,client: fix package names, upgrade openapi-generator to 4.2.3
• all: misc test cleanup from staticcheck
• api,client: use shared Error model
• api,client: use shorter API summaries
• build: run sonatype-nexus-community/nancy in CI
• build: setup windows CI and releases
• download: set custom User-Agent header
• pkg/csl: use endpoint to download which doesn't require an api key

BUG FIXES

• ofac: allow unescaped inner quotes in SDN comments records

BUILD

• build: upgrade to Go 1.14.x
• build: upgrade staticcheck to 2020.1.3
• build: don't 'make docker' twice
• build: update Copyright headers for 2020
• build: upgrade mysql client to 1.5
• build: don't wipe both generated dirs on 'make clean'
• chore(deps): update dependency @material-ui/core to v4.9.9
• chore(deps): update golang docker tag to v1.14
• chore(deps): update module moov-io/base to v0.11.0
• chore(deps): update module prometheus/client_golang to v1.4.0
• chore(deps): update mui monorepo to v4.9.1

IMPROVEMENTS

• ofac: allow unescaped inner quotes in SDN comments records
• ofac: add filename and more logging context for debugging refresh errors

IMPROVEMENTS

• pkg/csl: use endpoint to download which doesn't require an api key