github.com/ovh/venom

What's Changed

• chore(test): bump libs by @yesnault in #910
• fix(executors/mongo): Use SetProjection in projection option by @jeanschmitt in #902
• feat(reports): add new HTML report version by @shanestillwell in #861
• fix: integration-test by @yesnault in #911
• fix: user executor failures missing from JUnit/XML/JSON/HTML reports by @yesnault in #912
• fix: Redact declared secrets from reports and debug logs by @ivan-velasco in #925
• chore(deps): bump dependencies, Go 1.27 and alpine 3.24 by @yesnault in #931
• fix: line number in failed tests by @yesnault in #933
• fix(user-executors): preserve var casing in executor output by @yesnault in #934
• feat(http):support header with multiple values by @Poppyto in #935

New Contributors

• @jeanschmitt made their first contribution in #902
• @Poppyto made their first contribution in #935

Full Changelog: v1.4.0-beta.1...v1.4.0-beta.2

What's Changed

• fix: handle empty string in variable by @richardlt in #898
• chore: bump deps by @yesnault in #908
• chore: bump google.golang.org/grpc by @yesnault in #909

Full Changelog: v1.3.0...v1.4.0-beta.1

What's Changed (Highlights)

New executors & protocol support

• Couchbase executor: added a new Couchbase executor. #852 #853
• RabbitMQ: added RPC support #798 and fixed channel initialization for message publishing #809
• Redis executor: added ACL authentication support. #784
• HTTP executor: added cookies support on redirects. #866
• OVH API: added OAuth2 authentication support. #873
• gRPC: reflection support for both v1 and v1alpha. #882

Assertions & test features

• New assertion ShouldNotJSONEqual. #863
• Support for custom assertions. #891
• Added built-in variable totalSteps for test cases and test suites. #812
• Improved skip condition evaluation by including previous step variables. #833
• Fixed handling of already escaped quotes in test cases. #872

Logs & reports

• Log test step output variables on failure. #837
• Improved log levels in core execution. #893
• HTML report improvements: proper rendering of complex assertions #857 and cross-platform path handling #856

Performance & stability

• Improved user executors performance. #831
• Fixed user executor variable checks and library path resolution issues. #871 #867
• Fixed retry delay handling to start waiting from the first retry. #878
• Fixed __Len__ and __Type__ extract behavior. #894

Build, packaging & distribution

• Windows binaries are now generated with the .exe extension. #792
• Copy venom binary to a standard installation location. #813
• Docker image updated to Alpine 3.21. #851

Refactoring & dependency updates

• Removed dependency on ovh/cds/sdk/interpolate. #849
• Internal assertion refactoring (ShouldNotExist). #805
• Dependency updates, including golang.org/x/oauth2. #879

New Contributors

• @sbraz made their first contribution in #789
• @bastienwirtz made their first contribution in #784
• @zalgonoise made their first contribution in #792
• @docknight made their first contribution in #798
• @09bassOp made their first contribution in #814
• @ovh-cds made their first contribution in #844
• @c-roussel made their first contribution in #836
• @iisteev made their first contribution in #833
• @alexGNX made their first contribution in #831
• @peczenyj made their first contribution in #848
• @shanestillwell made their first contribution in #850
• @ncharaf made their first contribution in #859
• @Crocmagnon made their first contribution in #866
• @quangson137 made their first contribution in #882
• @Darya-Tolmeneva made their first contribution in #886

Full Changelog: v1.2.0...v1.3.0

What's Changed

• Feature: couchbase executor by @peczenyj in #852
• doc(readme): list couchbase executor by @yesnault in #853
• fix(testcase): log correctly user executors info - fixes #699 by @kilianpaquier in #855
• fix(reports): use filepath.Join instead or linux sep or path.Join for file that will be written on OS - fixes #794 by @kilianpaquier in #856
• fix(reports): print applied assertions as YAML in HTML report to handle complex assertions (and, or, etc.) - fixes #754 by @kilianpaquier in #857
• doc: LICENSES update by @ovh-cds in #854
• Fix typos by @ncharaf in #859
• feat(http): support cookies in redirects by @Crocmagnon in #866
• fix: start waiting for configured test step delay at first retry by @dariakts in #878
• feat(ovhapi): add support for OAuth2 authentication by @dariakts in #873
• Fix/user executor varcheck by @ivan-velasco in #871
• fix(user-executors): ensure unique lib paths in user executor files retrieval by @ivan-velasco in #867
• fix(testcase): handle issue of already escaped quotes by @shanestillwell in #872
• chore(deps): bump golang.org/x/oauth2 from 0.26.0 to 0.27.0 by @dependabot[bot] in #879
• New assertion ShouldNotJSONEqual by @09bassOp in #863

New Contributors

• @ncharaf made their first contribution in #859
• @Crocmagnon made their first contribution in #866

Full Changelog: v1.3.0-beta.2...v1.3.0-beta.3

What's Changed

• Readme/help: fix typo by @sbraz in #789
• feat(executor/redis): Redis auth (ACL) support by @bastienwirtz in #784
• fix: [Make] Create windows binaries with .exe extension by @zalgonoise in #792
• chore: bump and stale by @yesnault in #803
• refact: ShouldNotExist is equal to ShouldNotBeNil by @yesnault in #805
• doc: skip conditions by @yesnault in #806
• feat(executor/rabbitmq): Add support for RPC by @docknight in #798
• chore: rm stale action by @yesnault in #810
• fix(rabbitmq-rpc): Fix channel initialization for message publishing. by @docknight in #809
• fix: check if the file path provided is an absolute path by @09bassOp in #814
• test: fix interpolate by @yesnault in #845
• doc: LICENSES update by @ovh-cds in #844
• chore(README): update installation version by @c-roussel in #836
• chore: bump go.mod by @yesnault in #846
• feat: test case and test suite totalSteps built-in variables added by @09bassOp in #812
• fix: Copy venom binary to standard practice location by @09bassOp in #813
• fix(teststep): include step previous vars when checking skip by @iisteev in #833
• fix(venom): user executors performance issues by @alexGNX in #831
• refactor: remove ovh/cds/sdk/interpolate dep by @yesnault in #849
• Add make target to format source code by @peczenyj in #848
• feat(logs): log teststep output vars in case of failure by @alexGNX in #837
• chore(README): fix filename in readfile example by @shanestillwell in #850

New Contributors

• @sbraz made their first contribution in #789
• @bastienwirtz made their first contribution in #784
• @zalgonoise made their first contribution in #792
• @docknight made their first contribution in #798
• @09bassOp made their first contribution in #814
• @ovh-cds made their first contribution in #844
• @c-roussel made their first contribution in #836
• @iisteev made their first contribution in #833
• @alexGNX made their first contribution in #831
• @peczenyj made their first contribution in #848
• @shanestillwell made their first contribution in #850

Full Changelog: v1.2.0...v1.3.0-beta.1

Major update

Executors

• New mongo executor : https://github.com/ovh/venom/tree/master/executors/mongo
• Executors dbfixtures, exec, http, kafka, web updated.
• Manage secret variables: https://github.com/ovh/venom?tab=readme-ov-file#secrets-variables

Case sensitive

venom 1.2.x

VENOM_PRESERVE_CASE="AUTO" is equals to VENOM_PRESERVE_CASE="ON"

cf. #570

Variable usage

It's no more possible to reuse result.systemout from a previous testcase without exporting vars.

Example

before:

name: A testsuite

testcases:
- name: testA
  steps:
  - type: exec
    script: echo 'foo'
    assertions:
    - result.systemout ShouldEqual foo

- name: testB
  steps:
  - type: exec
    script: echo '__{{.testA.result.systemout}}__'
    assertions:
    - result.systemout ShouldEqual __foo__

after:

name: A testsuite

testcases:
- name: testA
  steps:
  - type: exec
    script: echo 'foo'
    assertions:
    - result.systemout ShouldEqual foo
    vars:
      systemout:
        from: result.systemout

- name: testB
  steps:
  - type: exec
    script: echo '__{{.testA.systemout}}__'
    assertions:
    - result.systemout ShouldEqual __foo__

What's Changed

• doc: add an example for a post using a raw body by @moutyque in #677
• doc: LICENSES by @yesnault in #716
• doc: remove trailing slash on README example by @floriancazals in #693
• doc: Update examples for queries length assert #763 by @miklosbagi in #765
• doc: update README.md with 1.1.0 release version of Venom by @nicolaslacroux in #679
• feat: add a 'description' property by @cdevienne in #770
• feat: add an assertion to check if every element of an array are equal to a value associated to a field by @floriancazals in #756
• feat: add natural language datetime assertion by @rhzs in #711
• feat: add ShouldJSONContain and ShouldJSONContainWithKey and negations (#746) by @floriancazals in #747
• feat: add ShouldJSONEqual assertion by @philippgille in #676
• feat: adding secrets field and refactoring the logging process. by @fokion in #667
• feat: adding test in the root package in order to test the run command by @fokion in #733
• feat: improve junit output by @ivan-velasco in #772
• feat: improve verbose flag behavior by @yesnault in #675
• feat: removed result from testcase variables and removed errors warning and info from non verbose runs by @kilianpaquier in #617
• feat: removed result from testcase variables and removed errors warning and info from non verbose runs by @kilianpaquier in #670
• feat: ShouldMatchRegex by @fokion in #674
• feat: show latest assertions errors in case of retry + added number of retries when success by @kilianpaquier in #616
• feat: VENOM_PRESERVE_CASE default ON by @yesnault in #570
• feat: xmlreport test id by @ivan-velasco in #688
• feat(executor/dbfixtures): add support for sqlite3 to dbfixtures executor by @etandel in #613
• feat(executor/exec): 'command' property by @yesnault in #782
• feat(executor/exec): add a 'stdin' attribute by @cdevienne in #767
• feat(executor/http): allow specifying query parameters by @guoweis-work in #629
• feat(executor/http): feature/xml systemout by @ivan-velasco in #720
• feat(executor/kafka) Added an option to allow self-signed certs by @Armadindon in #648
• feat(executor/kafka): add kafka headers for producer by @rhzs in #710
• feat(executor/mongo): add "loadFixtures" action by @Thiht in #653
• feat(executor/mongo): add mongo executor by @Thiht in #601
• fix: avoid nil pointer dereference in ShouldContain assertions by @iamleot in #615
• fix: env variables with equal sign by @bramca in #721
• fix: godump formatter by @yesnault in #709
• fix: html output color status by @yesnault in #758
• fix: integration tests by @yesnault in #749
• fix: minor improvements by @fsamin in #744
• fix: output dump file by @yesnault in #729
• fix: panic on failure by @yesnault in #731
• fix: parse yaml files in the readfile by @fokion in #689
• fix: prevent err EOF if .venomrc is all commented or empty by @yesnault in #678
• fix: replace backslashes with forward slashes for Windows by @ivan-velasco in #753
• fix: revert #617 by @yesnault in #636
• fix: secrets in dump.json and venom.log files by @yesnault in #715
• fix: string interpolation by @fokion in #656
• fix: TestSuiteXML is missing the Time property by @ivan-velasco in #627
• fix(executor/exec): panic on cmd.Start error by @fehrnah in #623
• fix(executor/http): preserve BodyFile absolute path by @fsamin in #635
• fix(testsuite): when "stop_on_failure" is enabled the skip test cases did not get counted and reported by @ivan-velasco in #771
• refactor(executor): rewrite whole imap executor to add new commands by @tomadele in #611
• refactor(executor/web): Refactoring by @kevinramage in #551
• chore(deps): bump go.mod by @yesnault in #730
• chore(deps): bump golang.org/x/crypto from 0.16.0 to 0.17.0 by @dependabot in #761
• chore(deps): bump google.golang.org/grpc from 1.53.0 to 1.56.3 by @dependabot in #739
• chore(deps): bump google.golang.org/grpc from 1.53.0 to 1.56.3 in /tests/grpc by @dependabot in #738
• chore(deps): bump google.golang.org/protobuf from 1.29.0 to 1.29.1 by @dependabot in #647
• chore(deps): bump google.golang.org/protobuf from 1.29.0 to 1.29.1 in /tests/grpc by @dependabot in #646
• chore(deps): bump libs by @yesnault in #644
• chore(deps): bump some libs by @yesnault in #781

New Contributors

• @etandel made their first contribution in #613
• @tomadele made their first contribution in #611
• @fehrnah made their first contribution in #623
• @iamleot made their first contribution in #615
• @ivan-velasco made their first contribution in #627
• @kilianpaquier made their first contribution in #617
• @dependabot made their first contribution in #647
• @Armadindon made their first contribution in #648
• @fokion made their first contribution in #656
• @moutyque made their first contribution in #677
• @nicolaslacroux made their first contribution in #679
• @floriancazals made their first contribution in #693
• @rhzs made their first contribution in #710
• @bramca made their first contribution in #721
• @miklosbagi made their first contribution in #765
• @cdevienne made their first contribution in #767

Full Changelog: v1.1.0...v1.2.0

What's Changed

• feat: new assertion keywords: ShouldJSONContain and ShouldJSONContainWithKey and negations (#746) by @floriancazals in #747
• feat: add natural language datetime assertion by @rhzs in #711
• feat(executor/http): feature/xml systemout by @ivan-velasco in #720
• doc: LICENSES by @yesnault in #716
• fix: secrets in dump.json and venom.log files by @yesnault in #715
• fix(venom): env variables with equal sign by @bramca in #721
• fix: godump formatter by @yesnault in #709
• fix(venom): output dump file by @yesnault in #729
• fix(venom): panic on failure by @yesnault in #731
• fix: it by @yesnault in #749
• fix: minor improvments by @fsamin in #744
• chore(deps): bump google.golang.org/grpc from 1.53.0 to 1.56.3 by @dependabot in #739
• chore(deps): bump google.golang.org/grpc from 1.53.0 to 1.56.3 in /tests/grpc by @dependabot in #738
• chore: bump go.mod by @yesnault in #730
• test: Adding test in the root package in order to test the run command by @fokion in #733

New Contributors

• @bramca made their first contribution in #721

Full Changelog: v1.2.0-beta.3...v1.2.0-beta.4

What's Changed

• Add an example for a post using a raw body by @moutyque in #677
• fix: prevent err EOF if .venomrc is all commented or empty by @yesnault in #678
• docs: update README.md with 1.1.0 release version of Venom by @nicolaslacroux in #679
• fix: Remove trailing slash on README example by @floriancazals in #693
• Add ShouldJSONEqual assertion by @philippgille in #676
• Adding secrets field and refactoring the logging process. by @fokion in #667
• Feature/xmlreport test id by @ivan-velasco in #688
• parse yaml files in the readfile by @fokion in #689
• add kafka headers for producer by @rhzs in #710

New Contributors

• @moutyque made their first contribution in #677
• @nicolaslacroux made their first contribution in #679
• @floriancazals made their first contribution in #693
• @rhzs made their first contribution in #710

Full Changelog: v1.2.0-beta.2...v1.2.0-beta.3

Major update

It's no more possible to reuse result.systemout from a previous testcase without exporting vars.

Example

before:

name: A testsuite

testcases:
- name: testA
  steps:
  - type: exec
    script: echo 'foo'
    assertions:
    - result.systemout ShouldEqual foo

- name: testB
  steps:
  - type: exec
    script: echo '__{{.testA.result.systemout}}__'
    assertions:
    - result.systemout ShouldEqual __foo__

after:

name: A testsuite

testcases:
- name: testA
  steps:
  - type: exec
    script: echo 'foo'
    assertions:
    - result.systemout ShouldEqual foo
    vars:
      systemout:
        from: result.systemout

- name: testB
  steps:
  - type: exec
    script: echo '__{{.testA.systemout}}__'
    assertions:
    - result.systemout ShouldEqual __foo__

What's Changed

• feat: removed result from testcase variables and removed errors warning and info from non verbose runs by @kilianpaquier in #670
• working on ShouldMatchRegex by @fokion in #674
• venom: improve verbose flag behavior by @yesnault in #675

Full Changelog: v1.2.0-beta.1...v1.2.0-beta.2

What's Changed

• feat(executor/dbfixtures): add support for sqlite3 by @etandel in #613
• feat(executor/mongo): mongo executor by @Thiht in #601
• feat(executor/mongo): add "loadFixtures" action by @Thiht in #653
• feat: VENOM_PRESERVE_CASE default ON by @yesnault in #570
• refactor(executor/imap): rewrite whole imap executor to add new commands by @tomadele in #611
• fix(executor/exec): panic on cmd.Start error by @fehrnah in #623
• fix: avoid nil pointer dereference in ShouldContain assertions by @iamleot in #615
• fix: TestSuiteXML is missing the Time property by @ivan-velasco in #627
• feat: removed result from testcase variables and removed errors warning and info from non verbose runs by @kilianpaquier in #617
• fix: revert #617 by @yesnault in #636
• chore(deps): bump libs by @yesnault in #644
• fix(http): preserve BodyFile absolute path by @fsamin in #635
• chore(deps): bump google.golang.org/protobuf from 1.29.0 to 1.29.1 by @dependabot in #647
• chore(deps): bump google.golang.org/protobuf from 1.29.0 to 1.29.1 in /tests/grpc by @dependabot in #646
• feat:(executor/kafka) Added an option to allow self-signed certs by @Armadindon in #648
• feat: show latest assertions errors in case of retry + added number of retries when success by @kilianpaquier in #616
• string interpolation by @fokion in #656
• refactor(executor/web) - Refactoring by @kevinramage in #551
• feat(executor/http): feat: allow specifying query parameters by @guoweis-outreach in #629

New Contributors

• @etandel made their first contribution in #613
• @tomadele made their first contribution in #611
• @fehrnah made their first contribution in #623
• @iamleot made their first contribution in #615
• @ivan-velasco made their first contribution in #627
• @kilianpaquier made their first contribution in #617
• @dependabot made their first contribution in #647
• @Armadindon made their first contribution in #648
• @fokion made their first contribution in #656

Full Changelog: v1.1.0...v1.2.0-beta.1