PyPI · #4332 most downloaded on PyPI

mlx-metal

0.32.3860K downloads/moml-explore/mlx ↗New releases in your daily digest, changelog included.

A framework for machine learning on Apple silicon.

Last release 6 days ago
29 Sep 2026
Ships fairly regularly
a new release about every 4 weeks
Most releases are documented
notes for 16 of 21 stable releases
Nothing withdrawn
no release was ever pulled
1 years old
21 releases · first in 2025

Release timeline

21 releases since 2025

20252026

One column per month.

Releases

0.30.118 Dec 2025
RDMA over thunderbolt with the JACCL backend (macOS >= 26.2) ( some numbers )
Highlights

RDMA over thunderbolt with the JACCL backend (macOS >= 26.2) (some numbers)

NAX with JIT so that they can be used in MLX Swift

CUDA improvements

Many improvements to SDPA (masking, T_q != T_kv)

Faster quantize/dequantize

QQMM to make use of faster tensor cores

Fix in col reduce speeds up training

What's Changed

patch + fix docs build by @awni in #2799

Fix macos release target and linux arm release by @awni in #2802

Fix cuda allocator copy condition by @awni in #2800

[CUDA] Partly fix random for large sizes by @awni in #2798

patch bump for future version by @awni in #2804

Centralize NAX condition by @awni in #2811

Tolerance for some ops tests on cuda by @awni in #2815

Fix typo: refs/head/main => refs/heads/main by @zcbenz in #2818

Add float64 Eig and complex64 SVD/Eig support (Fixes #2708) by @harsh-sutariya in #2737

Fix mx.core.load type annotation by @CC-Yeh in #2819

Force cudaGraphExec reinstantiation when clusters are used by @andportnoy in #2813

Bump actions/checkout from 5 to 6 by @dependabot[bot] in #2828

Fix mx.core.linspace type annotation by @CC-Yeh in #2820

[CUDA] Exit on crash and more helpful errors by @awni in #2830

[CUDA] Add debug env to save cuda graphs to dot files by @zcbenz in #2825

[CUDA] Output of SDPA should have same layout with inputs by @zcbenz in #2826

Merge build-cuda and build-linux actions by @zcbenz in #2783

[CUDA] Support array mask in SDPA by @zcbenz in #2822

[CUDA] Faster rms norm for small dimension by @awni in #2838

Added clarification to apply_fn parameter of apply_to_modules by @yuchaoran2011 in #2831

[CUDA] Use cuDNN attention when T_q != T_kv by @zcbenz in #2843

[CUDA] Migrate conv code to new cuDNN APIs by @zcbenz in #2847

Support more Numpy interfaces for masked_scatter by @CC-Yeh in #2832

use thread local cpature mode by @awni in #2850

Fix export scatters by @awni in #2852

Reduce JVP by @awni in #2854

Fix graph updating by @awni in #2857

Fix init from double by @awni in #2861

Update gumbel function signature parameters by @tianenchong in #2868

Added support for pytree types that inherit from tuple and typing.namedtuple by @romanoneg in #2845

Layer norm throws on dimension mismatch by @awni in #2870

fix compile copying by @awni in #2871

Do a PyPi release for cuda on arm by @awni in #2866

Add a 2-pass col reduce for CUDA by @angeloskath in #2863

[CUDA] Faster general copy by @awni in #2873

[CUDA] Release build for cuda 13 by @awni in #2872

Make allocator::malloc throw on allocation failure by @zcbenz in #2874

[Metal] No copy array init by @awni in #2875

Try not to fail when there should be memory available by @awni in #2869

[CUDA] Enable more graphs to be updatable by @awni in #2883

Fix docs: replace nonexistent mx.random.randn with mx.random.normal by @Satyam12singh in #2890

Allow events in sub graph to be updatable by @awni in #2886

bump minimum required Python version by @ngoldbaum in #2891

do not use simd neon intrinsics on x86 by @davidkoski in #2893

Fix input buffer donation in compile by @CC-Yeh in #2897

Update nanobind pin to most recent version by @ngoldbaum in #2896

fp quantize by @nastya236 in #2892

Fix grad in place updates by @awni in #2899

[CUDA] Add host nodes to subgraph types for graph update by @awni in #2901

fix: possible heap-buffer-overflow in RandomBits::eval_cpu (follow for new ASAN CI tests) by @incertum in #2877

Fix ccache getting disabled by @zcbenz in #2905

Fix attention for large sizes by @awni in #2903

No VJP for mask or sinks in attention by @awni in #2909

Bump actions/upload-artifact from 5 to 6 by @dependabot[bot] in #2911

Bump actions/download-artifact from 6 to 7 by @dependabot[bot] in #2912

Use CUDA runtime headers from local python package by @zcbenz in #2906

DOC : Add compile state example by @Satyam12singh in #2910

qqmm by @nastya236 in #2789

Thunderbolt RDMA communications backend by @angeloskath in #2808

Add JIT support for NAX kernels by @jagrit06 in #2916

Fix warnings for the NAX build by @angeloskath in #2921

New Contributors

@dependabot[bot] made their first contribution in #2828

@yuchaoran2011 made their first contribution in #2831

@tianenchong made their first contribution in #2868

@romanoneg made their first contribution in #2845

@Satyam12singh made their first contribution in #2890

@ngoldbaum made their first contribution in #2891

Full Changelog: v0.30.0...v0.30.1

0.30.020 Nov 2025

Support for Neural Accelerators on M5 (macOS >= 26.2)

Highlights

Support for Neural Accelerators on M5 (macOS >= 26.2)

What's Changed

Fix AdamW weight_decay default value in docstring by @goingreen in https://github.com/ml-explore/mlx/pull/2557
Fix dequantize python sig by @wrmsr in https://github.com/ml-explore/mlx/pull/2562
fix copies in sdpa by @awni in https://github.com/ml-explore/mlx/pull/2563
chore: Update Docs With Slice Copy Example by @krishi-saripalli in https://github.com/ml-explore/mlx/pull/2559
Fixed several type annotations in the MLX stubs which degraded to Unknown/Any by @Maalvi14 in https://github.com/ml-explore/mlx/pull/2560
typing: add type hints to mlx.core.array, linalg, and random by @XXXXRT666 in https://github.com/ml-explore/mlx/pull/2565
Set ccache size before building by @zcbenz in https://github.com/ml-explore/mlx/pull/2570
Faster fully depthwise-separable 1D conv by @awni in https://github.com/ml-explore/mlx/pull/2567
Fix a few ccache cache miss by @zcbenz in https://github.com/ml-explore/mlx/pull/2573
Some tweaks in cmake files by @zcbenz in https://github.com/ml-explore/mlx/pull/2574
Add batch offsets for mx.fast.rope by @awni in https://github.com/ml-explore/mlx/pull/2564
[CUDA] Use GEMM with epilogue instead of AddMM by @zcbenz in https://github.com/ml-explore/mlx/pull/2569
[CUDA] Fix alpha not respected when using bias epilogue by @zcbenz in https://github.com/ml-explore/mlx/pull/2578
Fix flaky addmm tests by @zcbenz in https://github.com/ml-explore/mlx/pull/2581
Adding Relu2 by @Goekdeniz-Guelmez in https://github.com/ml-explore/mlx/pull/2582
Add sdpa with sinks by @awni in https://github.com/ml-explore/mlx/pull/2558
[CUDA] Set bias as input when using bias epilogue by @zcbenz in https://github.com/ml-explore/mlx/pull/2584
[CUDA] Fix NCCL stub for release build by @awni in https://github.com/ml-explore/mlx/pull/2587
patch bump by @awni in https://github.com/ml-explore/mlx/pull/2588
Refactor code examples to use 'gelu' by @umbertomig in https://github.com/ml-explore/mlx/pull/2592
Fix metal scan by @awni in https://github.com/ml-explore/mlx/pull/2591
Fix typo in average_gradients function call by @umbertomig in https://github.com/ml-explore/mlx/pull/2594
No copy batch rope by @awni in https://github.com/ml-explore/mlx/pull/2595
Update export function example for array input by @umbertomig in https://github.com/ml-explore/mlx/pull/2598
Expose mx.depends to Python by @awni in https://github.com/ml-explore/mlx/pull/2606
fix: library loading for swift dynamic frameworks by @bilousoleksandr in https://github.com/ml-explore/mlx/pull/2568
Detect cache thrashing in LRUCache by @zcbenz in https://github.com/ml-explore/mlx/pull/2600
Lower sorted QMM gather threshold by @awni in https://github.com/ml-explore/mlx/pull/2609
implement Convolution::output_shape by @josharian in https://github.com/ml-explore/mlx/pull/2601
Avoid producing NaN in attention by @awni in https://github.com/ml-explore/mlx/pull/2608
[CUDA] Recycle CUDA events by @zcbenz in https://github.com/ml-explore/mlx/pull/2604
[CUDA] fix cudaGraphLaunch by @CC-Yeh in https://github.com/ml-explore/mlx/pull/2613
Support pickling array for bfloat16 by @CC-Yeh in https://github.com/ml-explore/mlx/pull/2586
New tuning for small K gemv by @jagrit06 in https://github.com/ml-explore/mlx/pull/2620
Allow None input to compiled functions by @awni in https://github.com/ml-explore/mlx/pull/2621
Compiled should not end in broadcast by @angeloskath in https://github.com/ml-explore/mlx/pull/2622
Bump the version by @angeloskath in https://github.com/ml-explore/mlx/pull/2627
[CUDA] Make CudaEvent work with multi-device by @zcbenz in https://github.com/ml-explore/mlx/pull/2614
Fix incorrect path and typos by @aisk in https://github.com/ml-explore/mlx/pull/2630
Fix for max block dim by @awni in https://github.com/ml-explore/mlx/pull/2631
Compile now can attach arbitrary data to an entry by @angeloskath in https://github.com/ml-explore/mlx/pull/2634
[CUDA] Wait for tasks in cuda by @awni in https://github.com/ml-explore/mlx/pull/2636
Fix status message by @angeloskath in https://github.com/ml-explore/mlx/pull/2638
fix cross entropy axis param by @awni in https://github.com/ml-explore/mlx/pull/2641
Faster triu, tril, where with scalar by @awni in https://github.com/ml-explore/mlx/pull/2644
[CUDA] Add a small column specialization to reduce by @angeloskath in https://github.com/ml-explore/mlx/pull/2642
[CUDA] Fix flaky test by @awni in https://github.com/ml-explore/mlx/pull/2646
Configure CMake to export compile_commands.json by @andportnoy in https://github.com/ml-explore/mlx/pull/2645
Faster complex matmul by @CC-Yeh in https://github.com/ml-explore/mlx/pull/2571
Fix compile when outputs change by @awni in https://github.com/ml-explore/mlx/pull/2648
Speed up compile for node with many parents by @awni in https://github.com/ml-explore/mlx/pull/2649
Fix and refactor row-reduce by @angeloskath in https://github.com/ml-explore/mlx/pull/2650
[CUDA] Fix jit file cache for large kernel names by @angeloskath in https://github.com/ml-explore/mlx/pull/2656
Fix all_gather vjp by @awni in https://github.com/ml-explore/mlx/pull/2654
Fix fast synch when fence is waited before a command buffer is created by @awni in https://github.com/ml-explore/mlx/pull/2657
Fix cumulative operations when axis=None by @aisk in https://github.com/ml-explore/mlx/pull/2653
Export with callback by @awni in https://github.com/ml-explore/mlx/pull/2612
bump patch by @awni in https://github.com/ml-explore/mlx/pull/2658
Enable addmm low-precision cpu by @awni in https://github.com/ml-explore/mlx/pull/2661
Precise sigmoid by @awni in https://github.com/ml-explore/mlx/pull/2659
Debug cuda conv by @awni in https://github.com/ml-explore/mlx/pull/2662
Speed up scalars part 2 by @awni in https://github.com/ml-explore/mlx/pull/2669
Normalize README bullet formatting and other Markdown small fixes by @Mistobaan in https://github.com/ml-explore/mlx/pull/2671
Modified sort behavior when running CPU or Metal to match NumPy/JAX by @Maalvi14 in https://github.com/ml-explore/mlx/pull/2667
remove unused unary file by @awni in https://github.com/ml-explore/mlx/pull/2672
Nccl timeout by @nastya236 in https://github.com/ml-explore/mlx/pull/2673
suppress gcc 10.1 warnings by @awni in https://github.com/ml-explore/mlx/pull/2679
patch bump by @awni in https://github.com/ml-explore/mlx/pull/2680
Improved mx.split() docs by @Maalvi14 in https://github.com/ml-explore/mlx/pull/2689
fix warnings showing up with -Wall by @andresy in https://github.com/ml-explore/mlx/pull/2692
Einsum error msg improvement by @Maalvi14 in https://github.com/ml-explore/mlx/pull/2690
optionally load metallib from framework by @davidkoski in https://github.com/ml-explore/mlx/pull/2702
Fix addmm cpu for beta != 1.0 by @awni in https://github.com/ml-explore/mlx/pull/2699
Add mx.median op by @awni in https://github.com/ml-explore/mlx/pull/2705
bump python by @awni in https://github.com/ml-explore/mlx/pull/2694
Fp8 conversion by @awni in https://github.com/ml-explore/mlx/pull/2686
fix: linux-{fedora}x86_64-build by @incertum in https://github.com/ml-explore/mlx/pull/2707
Add quantize/dequantize for mxfp8 and nvfp4 by @awni in https://github.com/ml-explore/mlx/pull/2688
Migrate CircleCI to GitHub Actions by @madrob in https://github.com/ml-explore/mlx/pull/2716
Fix KeyError for missing domain_uuid_key in Thunderbolt setup by @thechriswebb in https://github.com/ml-explore/mlx/pull/2682
fix memory count bug by @awni in https://github.com/ml-explore/mlx/pull/2717
Fix the order of hosts in the ring by @angeloskath in https://github.com/ml-explore/mlx/pull/2718
Fix docs path by @madrob in https://github.com/ml-explore/mlx/pull/2719
Use faster dequant for fp4 by @awni in https://github.com/ml-explore/mlx/pull/2720
update: add linux fedora container CI - CPP build test only by @incertum in https://github.com/ml-explore/mlx/pull/2722
add null check -- the bundleIdentifier is optional by @davidkoski in https://github.com/ml-explore/mlx/pull/2709
Fix compile multi capture by @awni in https://github.com/ml-explore/mlx/pull/2678
Set up publishing to PyPI and Test-PyPI by @madrob in https://github.com/ml-explore/mlx/pull/2721
Check isnan in maximum / minimum with CPU backend by @aisk in https://github.com/ml-explore/mlx/pull/2652
Fix addmm with empty matrices and beta != 1.0 by @harsh-sutariya in https://github.com/ml-explore/mlx/pull/2715
skip self-hosted runners on forks by @madrob in https://github.com/ml-explore/mlx/pull/2730
only build for macos 14 and up by @awni in https://github.com/ml-explore/mlx/pull/2731
don't test when doing release by @awni in https://github.com/ml-explore/mlx/pull/2734
Make cpu binary_op easily accessible by @angeloskath in https://github.com/ml-explore/mlx/pull/2733
fix property name by @madrob in https://github.com/ml-explore/mlx/pull/2736
Nccl reduce scatter, all gather by @nastya236 in https://github.com/ml-explore/mlx/pull/2727
[CUDA] Reduce use of managed memory by @awni in https://github.com/ml-explore/mlx/pull/2725
Shapeless support for zeros/ones_like by @CC-Yeh in https://github.com/ml-explore/mlx/pull/2726
Compatibility with pip-installed openmpi by @pcuenca in https://github.com/ml-explore/mlx/pull/2741
Fix release builds by @awni in https://github.com/ml-explore/mlx/pull/2746
patch bump by @awni in https://github.com/ml-explore/mlx/pull/2750
Fix dequantize python sig (dtype default) by @wrmsr in https://github.com/ml-explore/mlx/pull/2752
remove circle by @awni in https://github.com/ml-explore/mlx/pull/2753
Fix irregular_strides benchmark shape type by @wrmsr in https://github.com/ml-explore/mlx/pull/2754
Linux on arm by @awni in https://github.com/ml-explore/mlx/pull/2751
minor debugging for publishing by @madrob in https://github.com/ml-explore/mlx/pull/2739
Export custom kernel by @awni in https://github.com/ml-explore/mlx/pull/2756
Fix slice with negative strides by @awni in https://github.com/ml-explore/mlx/pull/2758
[CUDA] Check CUDA error in synchronize by @zcbenz in https://github.com/ml-explore/mlx/pull/2757
fix release by @awni in https://github.com/ml-explore/mlx/pull/2759
[CUDA] cuDNN forward attention by @zcbenz in https://github.com/ml-explore/mlx/pull/2743
Fix exporting with constants by @awni in https://github.com/ml-explore/mlx/pull/2769
Separate test-linux from build-linux/cuda in GitHub Actions by @zcbenz in https://github.com/ml-explore/mlx/pull/2765
[CUDA] Use arch specific targets when possible by @awni in https://github.com/ml-explore/mlx/pull/2771
Fix MPI distributed tests with CUDA backend by @zcbenz in https://github.com/ml-explore/mlx/pull/2775
Fix warnings with cmake 4.1 by @zcbenz in https://github.com/ml-explore/mlx/pull/2774
Use ccache in GitHub Actions by @zcbenz in https://github.com/ml-explore/mlx/pull/2773
[CUDA] Tune ops per buffer based on device by @awni in https://github.com/ml-explore/mlx/pull/2761
fix release 2 by @awni in https://github.com/ml-explore/mlx/pull/2767
Run CI for pushes by @zcbenz in https://github.com/ml-explore/mlx/pull/2777
Remove pip cache in GitHub Actions by @zcbenz in https://github.com/ml-explore/mlx/pull/2776
Build and test with multiple CUDA versions by @zcbenz in https://github.com/ml-explore/mlx/pull/2780
Use std::optional for mask_arr arg by @zcbenz in https://github.com/ml-explore/mlx/pull/2763
Do not run CPU tests in CUDA builds by @zcbenz in https://github.com/ml-explore/mlx/pull/2784
Test every commit in main branch by @zcbenz in https://github.com/ml-explore/mlx/pull/2781
Fix nightly build by @zcbenz in https://github.com/ml-explore/mlx/pull/2785
Remove unneeded tests in nightly build by @zcbenz in https://github.com/ml-explore/mlx/pull/2786
Fix building with CUDA < 12.8 by @zcbenz in https://github.com/ml-explore/mlx/pull/2782
Avoid duplicate CI runs when starting a PR from upstream branch by @zcbenz in https://github.com/ml-explore/mlx/pull/2788
build docs on linux by @awni in https://github.com/ml-explore/mlx/pull/2787
[CUDA] cuDNN backward attention by @zcbenz in https://github.com/ml-explore/mlx/pull/2762
more accurate rope fallback by @awni in https://github.com/ml-explore/mlx/pull/2792
Fix version tag by @awni in https://github.com/ml-explore/mlx/pull/2790
version by @awni in https://github.com/ml-explore/mlx/pull/2797
Add Masked Scatter by @CC-Yeh in https://github.com/ml-explore/mlx/pull/2663
Add Neural Accelerator Support by @jagrit06 in https://github.com/ml-explore/mlx/pull/2772

New Contributors

@goingreen made their first contribution in https://github.com/ml-explore/mlx/pull/2557
@krishi-saripalli made their first contribution in https://github.com/ml-explore/mlx/pull/2559
@Maalvi14 made their first contribution in https://github.com/ml-explore/mlx/pull/2560
@XXXXRT666 made their first contribution in https://github.com/ml-explore/mlx/pull/2565
@umbertomig made their first contribution in https://github.com/ml-explore/mlx/pull/2592
@bilousoleksandr made their first contribution in https://github.com/ml-explore/mlx/pull/2568
@josharian made their first contribution in https://github.com/ml-explore/mlx/pull/2601
@aisk made their first contribution in https://github.com/ml-explore/mlx/pull/2630
@Mistobaan made their first contribution in https://github.com/ml-explore/mlx/pull/2671
@incertum made their first contribution in https://github.com/ml-explore/mlx/pull/2707
@thechriswebb made their first contribution in https://github.com/ml-explore/mlx/pull/2682
@harsh-sutariya made their first contribution in https://github.com/ml-explore/mlx/pull/2715
@pcuenca made their first contribution in https://github.com/ml-explore/mlx/pull/2741

Full Changelog: https://github.com/ml-explore/mlx/compare/v0.29.0...v0.30.0

Open source →

0.29.029 Aug 2025

Support for mxfp4 quantization (Metal, CPU)

Highlights

Support for mxfp4 quantization (Metal, CPU)
More performance improvements, bug fixes, features in CUDA backend
mx.distributed supports NCCL back-end for CUDA

What's Changed

[CUDA] Optimize set_mm_device_pointers for small ndim by @zcbenz in https://github.com/ml-explore/mlx/pull/2473
Fix logsumexp/softmax not fused for some cases by @zcbenz in https://github.com/ml-explore/mlx/pull/2474
Use CMake <4.1 to avoid the nvpl error by @angeloskath in https://github.com/ml-explore/mlx/pull/2489
Fix incorrect interpretation of unsigned dtypes in reduce ops by @abeleinin in https://github.com/ml-explore/mlx/pull/2477
make code blocks copyable by @Dan-Yeh in https://github.com/ml-explore/mlx/pull/2480
Rename cu::Matmul to CublasGemm by @zcbenz in https://github.com/ml-explore/mlx/pull/2488
Faster general unary op by @awni in https://github.com/ml-explore/mlx/pull/2472
The naive_conv_2d is no longer used by @zcbenz in https://github.com/ml-explore/mlx/pull/2496
Remove the hack around SmallVector in cpu compile by @zcbenz in https://github.com/ml-explore/mlx/pull/2494
Clean up code handling both std::vector and SmallVector by @zcbenz in https://github.com/ml-explore/mlx/pull/2493
[CUDA] Fix conv grads with groups by @zcbenz in https://github.com/ml-explore/mlx/pull/2495
Update cuDNN Frontend to v1.14 by @zcbenz in https://github.com/ml-explore/mlx/pull/2505
Ensure small sort doesn't use indices if not argsort by @angeloskath in https://github.com/ml-explore/mlx/pull/2506
Ensure no oob read in gemv_masked by @angeloskath in https://github.com/ml-explore/mlx/pull/2508
fix custom kernel test by @awni in https://github.com/ml-explore/mlx/pull/2510
No segfault with uninitialized array.at by @awni in https://github.com/ml-explore/mlx/pull/2514
Fix lapack svd by @awni in https://github.com/ml-explore/mlx/pull/2515
Split cuDNN helpers into a separate header by @zcbenz in https://github.com/ml-explore/mlx/pull/2491
[CUDA] Add GEMM-based fallback convolution kernels by @zcbenz in https://github.com/ml-explore/mlx/pull/2511
Fix docs by @russellizadi in https://github.com/ml-explore/mlx/pull/2518
Fix overflow in large filter small channels by @angeloskath in https://github.com/ml-explore/mlx/pull/2520
[CUDA] Fix stride of singleton dims before passing to cuDNN by @zcbenz in https://github.com/ml-explore/mlx/pull/2521
Custom cuda kernel by @angeloskath in https://github.com/ml-explore/mlx/pull/2517
Fix docs omission by @angeloskath in https://github.com/ml-explore/mlx/pull/2524
Fix power by @awni in https://github.com/ml-explore/mlx/pull/2523
NCCL backend by @nastya236 in https://github.com/ml-explore/mlx/pull/2476
[CUDA] Nccl pypi dep + default for cuda by @awni in https://github.com/ml-explore/mlx/pull/2526
Fix warning 186-D from nvcc by @zcbenz in https://github.com/ml-explore/mlx/pull/2527
[CUDA] Update calls to cudaMemAdvise and cudaGraphAddDependencies for CUDA 13 by @andportnoy in https://github.com/ml-explore/mlx/pull/2525
nccl default for backend=any by @awni in https://github.com/ml-explore/mlx/pull/2528
Fix allocation bug in NCCL by @awni in https://github.com/ml-explore/mlx/pull/2530
Enable COMPILE_WARNING_AS_ERROR for linux builds in CI by @zcbenz in https://github.com/ml-explore/mlx/pull/2534
[CUDA] Remove thrust in arange by @zcbenz in https://github.com/ml-explore/mlx/pull/2535
Use nccl header only when nccl is not present by @awni in https://github.com/ml-explore/mlx/pull/2539
Allow pathlib.Path to save/load functions by @awni in https://github.com/ml-explore/mlx/pull/2541
Remove nccl install in release by @awni in https://github.com/ml-explore/mlx/pull/2542
[CUDA] Implement DynamicSlice/DynamicSliceUpdate by @zcbenz in https://github.com/ml-explore/mlx/pull/2533
Remove stream from average grads so it uses default by @awni in https://github.com/ml-explore/mlx/pull/2532
Enable cuda graph toggle by @awni in https://github.com/ml-explore/mlx/pull/2545
Tests for save/load with Path by @awni in https://github.com/ml-explore/mlx/pull/2543
Run CPP tests for CUDA build in CI by @zcbenz in https://github.com/ml-explore/mlx/pull/2544
Separate cpu compilation cache by versions by @zcbenz in https://github.com/ml-explore/mlx/pull/2548
[CUDA] Link with nccl by @awni in https://github.com/ml-explore/mlx/pull/2546
[CUDA] Use ConcurrentContext in concatenate_gpu by @zcbenz in https://github.com/ml-explore/mlx/pull/2549
[CUDA] fix sort by @awni in https://github.com/ml-explore/mlx/pull/2550
Add mode parameter for quantization by @awni in https://github.com/ml-explore/mlx/pull/2499
Bump xcode in circle by @awni in https://github.com/ml-explore/mlx/pull/2551
Fix METAL quantization in JIT + fix release build by @awni in https://github.com/ml-explore/mlx/pull/2553
Faster contiguous gather for indices in the first axis by @awni in https://github.com/ml-explore/mlx/pull/2552
version bump by @awni in https://github.com/ml-explore/mlx/pull/2554
Fix quantized vjp for mxfp4 by @awni in https://github.com/ml-explore/mlx/pull/2555

New Contributors

@Dan-Yeh made their first contribution in https://github.com/ml-explore/mlx/pull/2480
@russellizadi made their first contribution in https://github.com/ml-explore/mlx/pull/2518
@andportnoy made their first contribution in https://github.com/ml-explore/mlx/pull/2525

Full Changelog: https://github.com/ml-explore/mlx/compare/v0.28.0...v0.29.0

Open source →

0.28.07 Aug 2025

First version of fused sdpa vector for CUDA

Highlights

First version of fused sdpa vector for CUDA
Convolutions in CUDA
Speed improvements in CUDA normalization layers, softmax, compiled kernels, overheads and more

What's Changed

[CUDA] Fix segfault on exit by @awni in https://github.com/ml-explore/mlx/pull/2424
[CUDA] No occupancy query for launch params by @awni in https://github.com/ml-explore/mlx/pull/2426
[CUDA] More sizes for gemv by @awni in https://github.com/ml-explore/mlx/pull/2429
Add more CUDA architectures for PyPi package by @awni in https://github.com/ml-explore/mlx/pull/2427
Use ccache in CI by @zcbenz in https://github.com/ml-explore/mlx/pull/2414
[CUDA] Use aligned vector in Layer Norm and RMS norm by @awni in https://github.com/ml-explore/mlx/pull/2433
Cuda faster softmax by @awni in https://github.com/ml-explore/mlx/pull/2435
Remove the kernel arg from get_launch_args by @zcbenz in https://github.com/ml-explore/mlx/pull/2437
Move arange to its own file by @zcbenz in https://github.com/ml-explore/mlx/pull/2438
Use load_vector in arg_reduce by @zcbenz in https://github.com/ml-explore/mlx/pull/2439
Make CI faster by @zcbenz in https://github.com/ml-explore/mlx/pull/2440
[CUDA] Quantized refactoring by @angeloskath in https://github.com/ml-explore/mlx/pull/2442
fix circular reference by @awni in https://github.com/ml-explore/mlx/pull/2443
[CUDA] Fix gemv regression by @awni in https://github.com/ml-explore/mlx/pull/2445
Fix wrong graph key when using concurrent context by @zcbenz in https://github.com/ml-explore/mlx/pull/2447
Fix custom metal extension by @awni in https://github.com/ml-explore/mlx/pull/2446
Add tests for export including control flow models and quantized models by @junpeiz in https://github.com/ml-explore/mlx/pull/2430
[CUDA] Backward convolution by @zcbenz in https://github.com/ml-explore/mlx/pull/2431
[CUDA] Save primitive inputs faster by @zcbenz in https://github.com/ml-explore/mlx/pull/2449
[CUDA] Vectorize generated kernels by @angeloskath in https://github.com/ml-explore/mlx/pull/2444
[CUDA] Matmul utils initial commit by @angeloskath in https://github.com/ml-explore/mlx/pull/2441
Fix arctan2 grads by @angeloskath in https://github.com/ml-explore/mlx/pull/2453
Use LRU cache for cuda graph by @zcbenz in https://github.com/ml-explore/mlx/pull/2448
Add missing algorithm header to jit_compiler.cpp for Linux builds by @zamderax in https://github.com/ml-explore/mlx/pull/2460
Default install cuda on linux by @awni in https://github.com/ml-explore/mlx/pull/2462
fix wraps compile by @awni in https://github.com/ml-explore/mlx/pull/2461
Feat: add USE_SYSTEM_FMT CMake option by @GaetanLepage in https://github.com/ml-explore/mlx/pull/2219
Use SmallVector for shapes and strides by @zcbenz in https://github.com/ml-explore/mlx/pull/2454
Fix install tags by @awni in https://github.com/ml-explore/mlx/pull/2464
Faster gather qmm sorted test by @awni in https://github.com/ml-explore/mlx/pull/2463
Fix cublas on h100 by @awni in https://github.com/ml-explore/mlx/pull/2466
revert default cuda install by @awni in https://github.com/ml-explore/mlx/pull/2465
feat: support a destinations based in tree flatten/unflatten by @LVivona in https://github.com/ml-explore/mlx/pull/2450
Fix typo in metal command encoder by @angeloskath in https://github.com/ml-explore/mlx/pull/2471
Update CUDA sdpa by @jagrit06 in https://github.com/ml-explore/mlx/pull/2468
version by @awni in https://github.com/ml-explore/mlx/pull/2470

New Contributors

@junpeiz made their first contribution in https://github.com/ml-explore/mlx/pull/2430
@zamderax made their first contribution in https://github.com/ml-explore/mlx/pull/2460
@GaetanLepage made their first contribution in https://github.com/ml-explore/mlx/pull/2219
@LVivona made their first contribution in https://github.com/ml-explore/mlx/pull/2450

Full Changelog: https://github.com/ml-explore/mlx/compare/v0.27.1...v0.28.0

Open source →

0.27.125 Jul 2025

Initial PyPi release of the CUDA back-end.

Highlights

Initial PyPi release of the CUDA back-end.
CUDA back-end works for well with mlx-lm:
- Reasonably fast for LLM inference
- Supports single-machine training and LoRA fine-tuning

What's Changed

Avoid invoking allocator::malloc when creating CUDA event by @zcbenz in https://github.com/ml-explore/mlx/pull/2232
Share more common code in Compiled by @zcbenz in https://github.com/ml-explore/mlx/pull/2240
Avoid atomic updates across CPU/GPU in CUDA event by @zcbenz in https://github.com/ml-explore/mlx/pull/2231
Perf regression fix by @angeloskath in https://github.com/ml-explore/mlx/pull/2243
Add profiler annotations in common primitives for CUDA backend by @zcbenz in https://github.com/ml-explore/mlx/pull/2244
Default strict mode for module update and update_modules by @awni in https://github.com/ml-explore/mlx/pull/2239
Fix linux linking error by @awni in https://github.com/ml-explore/mlx/pull/2248
Improve metal elementwise kernels by @awni in https://github.com/ml-explore/mlx/pull/2247
CUDA backend: matmul by @zcbenz in https://github.com/ml-explore/mlx/pull/2241
Change layernorms to two pass algorithm by @angeloskath in https://github.com/ml-explore/mlx/pull/2246
Fix unintuitive metal kernel caching by @awni in https://github.com/ml-explore/mlx/pull/2242
Refactor the lu test by @emmanuel-ferdman in https://github.com/ml-explore/mlx/pull/2250
CUDA backend: unary ops by @zcbenz in https://github.com/ml-explore/mlx/pull/2158
Fix export to work with gather/scatter axis by @awni in https://github.com/ml-explore/mlx/pull/2263
CUDA backend: binary ops by @zcbenz in https://github.com/ml-explore/mlx/pull/2259
Report number of missing parameters by @FL33TW00D in https://github.com/ml-explore/mlx/pull/2264
CUDA backend: sort by @zcbenz in https://github.com/ml-explore/mlx/pull/2262
CUDA backend: random by @zcbenz in https://github.com/ml-explore/mlx/pull/2261
Fix conv export by @awni in https://github.com/ml-explore/mlx/pull/2265
CUDA backend: copy ops by @zcbenz in https://github.com/ml-explore/mlx/pull/2260
Fix building cpp benchmarks on Linux by @zcbenz in https://github.com/ml-explore/mlx/pull/2268
Add load_safe to the general conv loaders by @angeloskath in https://github.com/ml-explore/mlx/pull/2258
start cuda circle config by @awni in https://github.com/ml-explore/mlx/pull/2256
CUDA backend: reduce by @zcbenz in https://github.com/ml-explore/mlx/pull/2269
CUDA backend: argreduce by @zcbenz in https://github.com/ml-explore/mlx/pull/2270
CUDA backend: softmax by @zcbenz in https://github.com/ml-explore/mlx/pull/2272
CUDA backend: layernorm by @zcbenz in https://github.com/ml-explore/mlx/pull/2271
Fix warnings from latest CUDA toolkit by @zcbenz in https://github.com/ml-explore/mlx/pull/2275
Make sliceUpdate general by @awni in https://github.com/ml-explore/mlx/pull/2282
CUDA backend: compile by @zcbenz in https://github.com/ml-explore/mlx/pull/2276
[CUDA] RMSNorm and VJP by @awni in https://github.com/ml-explore/mlx/pull/2280
[CUDA] Fix build by @awni in https://github.com/ml-explore/mlx/pull/2284
[CUDA] ternary with select op by @awni in https://github.com/ml-explore/mlx/pull/2283
CUDA backend: indexing ops by @zcbenz in https://github.com/ml-explore/mlx/pull/2277
Collection of refactors by @jagrit06 in https://github.com/ml-explore/mlx/pull/2274
Fix complex power and print by @awni in https://github.com/ml-explore/mlx/pull/2286
fix cuda jit by @awni in https://github.com/ml-explore/mlx/pull/2287
Fix cuda gemm for bf16 by @awni in https://github.com/ml-explore/mlx/pull/2288
Fix cuda arg reduce by @awni in https://github.com/ml-explore/mlx/pull/2291
RoPE for CUDA by @angeloskath in https://github.com/ml-explore/mlx/pull/2293
Add python testing for cuda with ability to skip list of tests by @awni in https://github.com/ml-explore/mlx/pull/2295
[CUDA] Fix back-end bugs and enable corresponding tests by @awni in https://github.com/ml-explore/mlx/pull/2296
Cuda bug fixes 2 by @awni in https://github.com/ml-explore/mlx/pull/2298
[CUDA] Divmod, Partition, and sort fixes by @awni in https://github.com/ml-explore/mlx/pull/2302
[CUDA] synch properly waits for all tasks to finish and clear by @awni in https://github.com/ml-explore/mlx/pull/2303
Make ptx cache settable by environment variable by @angeloskath in https://github.com/ml-explore/mlx/pull/2304
Build CUDA release in Circle by @awni in https://github.com/ml-explore/mlx/pull/2306
Cuda perf tuning by @awni in https://github.com/ml-explore/mlx/pull/2307
Fix update_modules() when providing a subset by @angeloskath in https://github.com/ml-explore/mlx/pull/2308
Compile float64 functions on CPU by @awni in https://github.com/ml-explore/mlx/pull/2311
Fix get 2d grid dims by @angeloskath in https://github.com/ml-explore/mlx/pull/2316
Split broadcast so it is always fused in compile by @angeloskath in https://github.com/ml-explore/mlx/pull/2318
[CUDA] Fix reductions by @angeloskath in https://github.com/ml-explore/mlx/pull/2314
Fix module update in strict mode by @awni in https://github.com/ml-explore/mlx/pull/2321
MLX_SWITCH macros to templates by @angeloskath in https://github.com/ml-explore/mlx/pull/2320
Use fp32 for testing, add more complex ops by @awni in https://github.com/ml-explore/mlx/pull/2322
Patch bump by @awni in https://github.com/ml-explore/mlx/pull/2324
Allow parameters to be deleted from a module by @awni in https://github.com/ml-explore/mlx/pull/2325
Fix compilation error from integral_constant by @zcbenz in https://github.com/ml-explore/mlx/pull/2326
[CUDA] Switch to CUDA graphs by @awni in https://github.com/ml-explore/mlx/pull/2317
[CUDA] Fix graphs for older cuda by @awni in https://github.com/ml-explore/mlx/pull/2328
[CUDA] Add MLX_CUDA_GRAPH_CACHE_SIZE env for setting graph cache size by @zcbenz in https://github.com/ml-explore/mlx/pull/2329
Fix layernorm race condition by @angeloskath in https://github.com/ml-explore/mlx/pull/2340
Build with all cpu cores by default by @zcbenz in https://github.com/ml-explore/mlx/pull/2336
[CUDA] Do vectorized store/load in binary ops by @zcbenz in https://github.com/ml-explore/mlx/pull/2330
Auto build linux release by @awni in https://github.com/ml-explore/mlx/pull/2341
MoE backward improvements by @angeloskath in https://github.com/ml-explore/mlx/pull/2335
Fix compilation with CUDA 11 by @zcbenz in https://github.com/ml-explore/mlx/pull/2331
patch bump by @awni in https://github.com/ml-explore/mlx/pull/2343
Align mlx::core::max op nan propagation with NumPy by @jhavukainen in https://github.com/ml-explore/mlx/pull/2339
Add zero for argsort vjp by @awni in https://github.com/ml-explore/mlx/pull/2345
[CUDA] Do vectorized store/load in contiguous elementwise ops by @zcbenz in https://github.com/ml-explore/mlx/pull/2342
Align mlx::core::min op nan propagation with NumPy by @jhavukainen in https://github.com/ml-explore/mlx/pull/2346
[CUDA] Set current device before cudaGraphLaunch by @zcbenz in https://github.com/ml-explore/mlx/pull/2351
[CUDA] Put version in ptx cache dir path by @zcbenz in https://github.com/ml-explore/mlx/pull/2352
Fix type promotion in Adam with bias correction by @angeloskath in https://github.com/ml-explore/mlx/pull/2350
Fix edge check in QuantizedBlockLoader for qmm_n by @angeloskath in https://github.com/ml-explore/mlx/pull/2355
[CUDA] Implement Scan kernel by @zcbenz in https://github.com/ml-explore/mlx/pull/2347
[Metal] fix copy dispatch by @awni in https://github.com/ml-explore/mlx/pull/2360
[CUDA] Bundle CCCL for JIT compilation by @zcbenz in https://github.com/ml-explore/mlx/pull/2357
[CUDA] Do not put kernels in annoymous namespace by @zcbenz in https://github.com/ml-explore/mlx/pull/2362
Fix imag() vjp by @angeloskath in https://github.com/ml-explore/mlx/pull/2367
Add Primitive::name and remove Primitive::print by @zcbenz in https://github.com/ml-explore/mlx/pull/2365
update linux build by @awni in https://github.com/ml-explore/mlx/pull/2370
[CUDA] Affine quantize by @awni in https://github.com/ml-explore/mlx/pull/2354
Fix flaky linux test by @awni in https://github.com/ml-explore/mlx/pull/2371
Install linux with mlx[cuda] and mlx[cpu] by @awni in https://github.com/ml-explore/mlx/pull/2356
[CUDA] Use cuda::std::complex in place of cuComplex by @zcbenz in https://github.com/ml-explore/mlx/pull/2372
lower memory uniform sampling by @awni in https://github.com/ml-explore/mlx/pull/2361
[CUDA] Fix complex reduce + nan propagation in min and max by @awni in https://github.com/ml-explore/mlx/pull/2377
Rename the copy util in cpu/copy.h to copy_cpu by @zcbenz in https://github.com/ml-explore/mlx/pull/2378
fix ring distributed test by @awni in https://github.com/ml-explore/mlx/pull/2380
Test with CUDA 12.2 by @awni in https://github.com/ml-explore/mlx/pull/2375
[CUDA] Add work per thread to compile by @angeloskath in https://github.com/ml-explore/mlx/pull/2368
[CUDA] Fix resource leaks in matmul and graph by @awni in https://github.com/ml-explore/mlx/pull/2383
[CUDA] Add more ways finding CCCL headers in JIT by @zcbenz in https://github.com/ml-explore/mlx/pull/2382
Add contiguous_copy_gpu util for copying array by @zcbenz in https://github.com/ml-explore/mlx/pull/2379
Adding support for the Muon Optimizer by @Goekdeniz-Guelmez in https://github.com/ml-explore/mlx/pull/1914
Patch bump by @awni in https://github.com/ml-explore/mlx/pull/2386
Fix release build + patch bump by @awni in https://github.com/ml-explore/mlx/pull/2387
Fix cuda manylinux version to match others by @awni in https://github.com/ml-explore/mlx/pull/2388
[CUDA] speedup handling scalars by @awni in https://github.com/ml-explore/mlx/pull/2389
Remove thrust iterators by @zcbenz in https://github.com/ml-explore/mlx/pull/2396
Add contiguous_copy_cpu util for copying array by @zcbenz in https://github.com/ml-explore/mlx/pull/2397
Fix including stubs in wheel by @awni in https://github.com/ml-explore/mlx/pull/2398
use size option in binary by @awni in https://github.com/ml-explore/mlx/pull/2399
[CUDA] Simplify allocator by @awni in https://github.com/ml-explore/mlx/pull/2392
Add cuda gemv by @awni in https://github.com/ml-explore/mlx/pull/2400
Fix an error in the comment for mx.dequantize by @csukuangfj in https://github.com/ml-explore/mlx/pull/2409
Remove unused code in Convolution::vjp by @zcbenz in https://github.com/ml-explore/mlx/pull/2408
[CUDA] --compress-mode requires CUDA 12.8 by @zcbenz in https://github.com/ml-explore/mlx/pull/2407
full row mask in sdpa consistently gives nan by @awni in https://github.com/ml-explore/mlx/pull/2406
Fix uv install and add dev release by @awni in https://github.com/ml-explore/mlx/pull/2411
[Metal] Release metal events by @awni in https://github.com/ml-explore/mlx/pull/2412
Test on cuda 12.2 and 12.9 by @awni in https://github.com/ml-explore/mlx/pull/2413
[CUDA] Initial implementation of Convolution with cuDNN by @zcbenz in https://github.com/ml-explore/mlx/pull/2385
[DOCS]: Fix eps placement in Adam and AdamW by @Skonor in https://github.com/ml-explore/mlx/pull/2416
[CUDA] Always use batched matmul by @awni in https://github.com/ml-explore/mlx/pull/2404
Fix qvm splitk by @awni in https://github.com/ml-explore/mlx/pull/2415
Update install docs and requirements by @awni in https://github.com/ml-explore/mlx/pull/2419
version by @awni in https://github.com/ml-explore/mlx/pull/2420

New Contributors

@emmanuel-ferdman made their first contribution in https://github.com/ml-explore/mlx/pull/2250
@FL33TW00D made their first contribution in https://github.com/ml-explore/mlx/pull/2264
@jhavukainen made their first contribution in https://github.com/ml-explore/mlx/pull/2339
@Goekdeniz-Guelmez made their first contribution in https://github.com/ml-explore/mlx/pull/1914
@Skonor made their first contribution in https://github.com/ml-explore/mlx/pull/2416

Full Changelog: https://github.com/ml-explore/mlx/compare/v0.26.0...v0.27.0

Open source →