github.com/kubeflow/mpi-operator

Releases

1. v0.8.23 Jul 2026
   Release notes

   Changes since v0.8.0

   • Bug fixes:
     • Fix missing DeepCopy when mutating the launcher Job, which prevents accidental mutation of the shared informer cache. (#819, @GonzaloLuminary)
     • Prevent terminating launcher pods from being recreated. (#810, @GonzaloLuminary)
     • Fix the Running condition being re-emitted when the pod and Job informers are out-of-sync. (#787, @GonzaloSaez)
     • Honor stderrthreshold when logtostderr is enabled by opting into the fixed klog behavior. (#794, @pierluigilenoci)

   Acknowledgments

   Thank you to all the contributors (in no particular order): @terrytangyuan @GonzaloLuminary @GonzaloSaez @pierluigilenoci @kannon92 @tenzen-y

   Open source →
2. v0.8.12 Jul 2026

   Nothing published for this version

3. v0.8.017 Feb 2026
   Release notes

   Changes since v0.7.0

   • Features:
     • Support Mutable Scheduling Directives for suspended Jobs
       on Launcher Job, which allows us to propagate the scheduling directives from the MPIJob Launcher template to the Launcher batch/v1 Job only when in the suspended state. (#772, @GonzaloSaez)
   • Clean ups:
     • Upgrade Kubernetes dependencies to v1.35. (#769, @tenzen-y)

   Acknowledgments

   Thank you to all the contributors (in no particular order): @mimowo @terrytangyuan @GonzaloSaez @tenzen-y

   Open source →
4. v0.7.030 Oct 2025
   Release notes

   Changes since v0.6.0

   • Features:
     • Support custom cluster domain in MPI hostfile generation. (#704, #707, #738, @tenzen-y)
     • Enable Service publishNotReadyAddresses when runLauncherAsWorker to improve DNS discovery for workers. (#703, @tenzen-y)
     • Expose job controller workqueue rate-limiting configuration via operator flags to improve scalability tuning. (#674, @rotemelad)
   • Bug fixes:
     • Fix crash in PodGroup when runLauncherAsWorker=true. (#669, @GonzaloSaez)
     • Fix missing ReplicaIndexLabel when runLauncherAsWorker=true so the launcher pod gets the expected pod index label (helps Kueue/TAS rank discovery). (#690, @GonzaloSaez)
   • Clean ups:
     • Upgrade Kubernetes dependencies to v1.34. (#742, @tenzen-y)
     • Fix kustomize v5 warnings in manifests. (#700, @vikas-saxena02)
     • Upgrade Debian version to trixie and MPI versions are upgraded in the following: (#685, @tenzen-y)
       • OpenMPI: v4.1.4 -> v5.0.7
       • MPICH: v3.4.1 -> v4.2.1

   Acknowledgments

   Thank you to all the contributors (in no particular order): @rotemelad @mimowo @terrytangyuan @GonzaloSaez @vikas-saxena02 @tenzen-y

   Open source →
5. v0.6.016 Oct 2024
   Release notes

   Changes since v0.5.0

   • Features:
     • Support ManagedBy feature (.spec.runPolicy.managedBy) inspired by batch/v1 Job.
       • This allows us to dispatch MPIJobs to the multiple clusters powered by Kueue's MultiKueue. (#650, @mszadkow)
   • Clean ups:
     • Upgrade k8s libraries to v1.31 (#664, @ArangoGutierrez)
     • Upgrade debian version to bookworm and MPI versions are upgraded in the following: (#661, @tenzen-y)
       • OpenMPI: v4.1.0 -> v4.1.4
       • MPICH: 3.4.1 -> 4.0.2

   Acknowledgments

   Thank you to all the contributors (in no particular order): @mszadkow @mimowo @alculquicondor @terrytangyuan @ArangoGutierrez @tenzen-y

   Full Changelog: v0.5.0...v0.6.0

   Open source →
6. v0.5.018 Apr 2024
   Release notes

   Changes since v0.4.0

   • Features:
     • Add support for MPICH (#562, @sheevy)
     • Field runLauncherAsWorker allows to add the launcher pod into the hostfile as a worker (#612, @kuizhiqing)
     • Add PodGroup minResources calculation for volcano integration (#566, @lowang-bh)
   • Bug fixes:
     • Fix panic when using PodGroups and PriorityClasses (#561, @tenzen-y)
     • Fix installation of mpijob Python module (#579, @vsoch)
     • Fix hostfile when jobs in different namespaces have the same name (#622, @kuizhiqing)
   • Clean ups:
     • Upgrade k8s libraries to v1.29 (#633, @tenzen-y)
     • Fail the mpi-operator binary if access to API is denied (#619, @emsixteeen)

   Acknowledgments

   Thank you to all the contributors (in no particular order): @sheevy @alculquicondor @terrytangyuan @tenzen-y @kuizhiqing @lowang-bh @vsoch @emsixteeen @wang-mask @benash @yeahdongcn @xhejtman @pheianox @lianghao208

   Open source →
7. v0.4.1-0.20260810214245-f7cd2d49ca9a10 Aug 2026pre-release

   Nothing published for this version

8. v0.4.1-0.20260723191235-9671778d1a4423 Jul 2026pre-release

   Nothing published for this version

9. v0.4.1-0.20260713153111-b3b5b84250dd13 Jul 2026pre-release

   Nothing published for this version

10. v0.4.1-0.20260702170023-caa3c47fc42e2 Jul 2026pre-release

    Nothing published for this version

11. v0.4.1-0.20260701104016-9279121cc7ec1 Jul 2026pre-release

    Nothing published for this version

12. v0.4.1-0.20260625143537-4fe9abf5e81925 Jun 2026pre-release

    Nothing published for this version

13. v0.4.1-0.20260612155031-bc35744e33ac12 Jun 2026pre-release

    Nothing published for this version

14. v0.4.1-0.20260217182907-83100a9bea3617 Feb 2026pre-release

    Nothing published for this version

15. v0.4.1-0.20260217070728-c72caacfe9d617 Feb 2026pre-release

    Nothing published for this version

16. v0.4.1-0.20251110200056-9eb9a986e34910 Nov 2025pre-release

    Nothing published for this version

17. v0.4.1-0.20251030175211-73b1f428109330 Oct 2025pre-release

    Nothing published for this version

18. v0.4.1-0.20250922131901-b1c5c9d0606d22 Sept 2025pre-release

    Nothing published for this version

19. v0.4.1-0.20250915142834-5491d66d1a2415 Sept 2025pre-release

    Nothing published for this version

20. v0.4.1-0.20250909042835-80e36cc2ce679 Sept 2025pre-release

    Nothing published for this version

21. v0.4.1-0.20250825212819-c63710108d3825 Aug 2025pre-release

    Nothing published for this version

22. v0.4.1-0.20241016014218-c738a83b185b16 Oct 2024pre-release

    Nothing published for this version

23. v0.4.1-0.20240418041839-52cda2c7e85a18 Apr 2024pre-release

    Nothing published for this version

24. v0.4.1-0.20240314123258-79a9b379647c14 Mar 2024pre-release

    Nothing published for this version

25. v0.4.1-0.20240304154908-942a20afa6874 Mar 2024pre-release

    Nothing published for this version

26. v0.4.1-0.20240227132800-f92b9c7e74cb27 Feb 2024pre-release

    Nothing published for this version

27. v0.4.1-0.20240226151758-a6c2da887d4526 Feb 2024pre-release

    Nothing published for this version

28. v0.4.1-0.20240206074644-a1ff84cbeb2c6 Feb 2024pre-release

    Nothing published for this version

29. v0.4.1-0.20240127031515-d043c9a34c4927 Jan 2024pre-release

    Nothing published for this version

30. v0.4.1-0.20231219151338-d7a392e30de919 Dec 2023pre-release

    Nothing published for this version

31. v0.4.1-0.20231114174106-4a63d3cb354514 Nov 2023pre-release

    Nothing published for this version

32. v0.4.1-0.20230608171159-fda0532ba1a28 Jun 2023pre-release

    Nothing published for this version

33. v0.4.1-0.20230514130430-ccf2756f749314 May 2023pre-release

    Nothing published for this version

34. v0.4.05 Apr 2023
    Release notes

    Changes since 0.3.0

    • Breaking changes
      • Removed v1 operator. If you want to use MPIJob v1, you can use the training-operator.
    • Support for suspending semantics. Third party controllers can leverage the suspend field to implement queuing and preemption for an MPIJob.
    • Support for the coscheduling plugins of the scheduler-plugins.
    • The operator supports multi-architecture (amd64, aarch64, and ppc64le).
    • Bug fixes
      • Fix support for elastic Horovod.

    Acknowledgements

    Special thanks to @tenzen-y for multiple contributions.
    Thank you to all the contributors (in no particular order): @mimowo @adilhusain-s @davidLif @ArangoGutierrez @shaowei-su @ggaaooppeenngg @pugangxa @HeGaoYuan @Dimss @alculquicondor @terrytangyuan

    Open source →
35. v0.3.1-0.20230404201702-03bba1ff482f4 Apr 2023pre-release

    Nothing published for this version

36. v0.3.1-0.20230331162358-5583ba9f7d2a31 Mar 2023pre-release

    Nothing published for this version

37. v0.3.1-0.20230228224311-5946ef41575928 Feb 2023pre-release

    Nothing published for this version

38. v0.3.1-0.20230210191002-c21942d1e27d10 Feb 2023pre-release

    Nothing published for this version

39. v0.3.1-0.20230204005158-5f1914bfb29b4 Feb 2023pre-release

    Nothing published for this version

40. v0.3.1-0.20230106171956-52f0b81c489c6 Jan 2023pre-release

    Nothing published for this version

41. v0.3.1-0.20230105154811-b0815ad90cae5 Jan 2023pre-release

    Nothing published for this version

42. v0.3.1-0.20220831182455-5be2a42bf5af31 Aug 2022pre-release

    Nothing published for this version

43. v0.3.1-0.20220406191845-993b010e05c46 Apr 2022pre-release

    Nothing published for this version

44. v0.3.1-0.20220308150529-e267b015aee68 Mar 2022pre-release

    Nothing published for this version

45. v0.3.1-0.20220302182203-bb5e538085e02 Mar 2022pre-release

    Nothing published for this version

46. v0.3.1-0.20220215155341-8a1cf898d97515 Feb 2022pre-release

    Nothing published for this version

47. v0.3.1-0.20220212005110-c7ca5414515312 Feb 2022pre-release

    Nothing published for this version

48. v0.3.1-0.20220207234242-3f808b1c592c7 Feb 2022pre-release

    Nothing published for this version

49. v0.3.1-0.20211209024655-d7fc50603a4d9 Dec 2021pre-release

    Nothing published for this version

50. v0.3.1-0.20211130124430-b88edad03a4b30 Nov 2021pre-release

    Nothing published for this version

51. v0.3.1-0.20211122143337-285cb98d598522 Nov 2021pre-release

    Nothing published for this version

52. v0.3.1-0.20211122045036-a334c4c2b88b22 Nov 2021pre-release

    Nothing published for this version

53. v0.3.1-0.20211008135323-8943cf734da78 Oct 2021pre-release

    Nothing published for this version

54. v0.3.1-0.20211008112423-18b1822f4a9d8 Oct 2021pre-release

    Nothing published for this version

55. v0.3.1-0.20210920181600-c5c0c3ef99ec20 Sept 2021pre-release

    Nothing published for this version

56. v0.3.02 Sept 2021
    Release notes

    Release v0.3.0

    • Scalability improvements
      • Worker start up no longer issues requests to kube-apiserver.
      • Dropped kubectl-delivery init container, reducing stress on kube-apiserver.
    • Support for Intel MPI.
    • Support for runPolicy (ttlSecondsAfterFinish, activeDeadlineSeconds, backoffLimit)
      by using a k8s Job for the launcher.
    • Samples for plain MPI applications.
    • Production readiness improvements:
      • Increased coverage throughout unit, integration and E2E tests.
      • More robust API validation.
      • Revisited v2beta1 MPIJob API.
      • Using fully-qualified label names, in consistency with other kubeflow operators.

    Open source →
57. v0.2.4-0.20211008135323-8943cf734da78 Oct 2021pre-release

    Nothing published for this version

58. v0.2.4-0.20210902183420-db6930dcd5092 Sept 2021pre-release

    Nothing published for this version

59. v0.2.4-0.20210827203406-470d9821d71527 Aug 2021pre-release

    Nothing published for this version

60. v0.2.4-0.20210629110745-30cdf43f933129 Jun 2021pre-release

    Nothing published for this version