Microsoft.IO.RecyclableMemoryStream

Breaking Changes

• Removed int-based constructor and GetStream overloads where long-based methods exist.
• Removed all methods marked with [Obsolete]:
  • StreamDisposedEventArgs.ctor(Guid, string, string, string)
  • RecyclableMemoryStreamManager.GetStream(Guid, string, Memory<byte>)
  • RecyclableMemoryStreamManager.GetStream(Memory<byte>)
  • RecyclableMemoryStreamManager.GetStream(string, Memory<byte>)
• Enable nullable annotations and warnings. i.e., added <Nullable>enabled</Nullable> to the project file.
• All overloads of RecyclableMemoryStreamManager.GetStream now return type RecyclableMemoryStream instead of MemoryStream.
• Removed explicit targets for net462, netcoreapp2.1, and net5.0. Supported targets are netstandard2.0, netstandard2.1, and net6.0 (there are a few net6.0-specific optimizations).
• Moved all the configuration settings for RecyclableMemoryStreamManager to the new RecyclableMemoryStreamManager.Options class. Removed many of the constructors as a result. This class will facilitate easier dependency injection through use of the Options pattern, for those who need it.
• Renamed some settings' names to be more consistent (e.g., MaximumLargePoolFreeBytes)

New Features

• Added a new option for RecyclableMemoryStreamManager: ZeroOutBuffer, which will cause all buffers to be cleared on allocation and when returning to the pool. Off by default.

Other Changes

• Upgrade NUnit test library to version 4.
• Fix some spelling issues in comments and variable names.
• Update code to the latest recommended C# syntax.

NuGet: Microsoft.IO.RecyclableMemoryStream 3.0.0

Optimizations:

• Calculating blocks and offsets was made more efficient by using Math.DivRem.
• Reading and writing to the stream was made more efficient with fewer array accesses.
• CopyTo was overridden to avoid using the slower default implementation.

NuGet: Microsoft.IO.RecyclableMemoryStream 2.3.2

New Feature:

• Stream lifetime (creation through dispose) is now tracked and reported through the MemoryStreamDispose EventSource event, as well as through the StreamDisposed .NET event.

Changes:

• The pool statistics used to be reported only when blocks/buffers were returned to the pool. This could lead to lopsided reporting patterns in some cases. Now, pool statistics are reported on stream creation and disposal.
• Added pool stats information to the MemoryStreamDiscardBuffer event.
• Changed events relating to buffer creation to be at the warning level instead of verbose. These are signals that the pool might not be large enough to handle the load.

Bug Fixes:

• Fixed allocation/finalization bug that could cause a NullReferenceException in some low-memory scenarios.

Internal:

• .NET 7 SDK used to build
• Changed coding style to match some newer patterns (and added .editorconfig file to enforce in the future)
• Fixed punctuation and spelling in API documentation.

NuGet: Microsoft.IO.RecyclableMemoryStream 2.3.1

Co-authored-by: Ben Watson bewatson@microsoft.com

API change:

• There are now overloads that take a type long parameter for requestedSize.

Bug Fix:

• ToString will no longer throw an exception if the stream is disposed.

NuGet: Microsoft.IO.RecyclableMemoryStream 2.2.1

Additional framework targets, better .Net Core support, simplified build.

Additional framework targets, better .Net Core support, simplified build.

Changes:

• Fixed an integer overflow bug when buffer sizes are near Int32.MaximumValue

NuGet: Microsoft.IO.RecyclableMemoryStream 2.1.2

• Fixed a bug introduced in 2.1.0 related to security inheritance rules

NuGet: Microsoft.IO.RecyclableMemoryStream 2.1.1

• Added RecyclableMemoryStreamManager constructor overloads that take parameters for specifying the maximum free pool sizes. Updated IntelliSense documentation to make clear that these values need to be explicitly set to avoid unbounded pool growth.
• Buffers are now allocated using GC.AllocateUninitializedArray in .NET 5.
• net462 and netstandard2.0 targets can now support the Span-related APIs via a dependency on System.Memory.
• Updated documentation to fix typos and clarify language in some parts.
• Support for Source Link

• Added netstandard2.0 target. There was an issue calling GetBuffer from a netstandard2.0 project, which would resolve to the netstandard1.4 target of RMS. netstandard1.4 doesn't support overriding GetBuffer, so you could hit UnauthorizedAccessException.
• A bug fix for CopyToAsync. It was copying the entire stream, but the expected behavior based on System.IO.MemoryStream is to copy from the current position.
• Some performance improvements to CopyToAsync.

Minor updates

• Override CopyToAsync to save some allocations.
• Apply AllowPartiallyTrustedCallers attribute to assembly

Performance Improvements

• WriteByte has been significantly optimized to be faster.
• CheckDisposed, which is called in many code paths, has similarly been optimized.

New API

• void WriteTo(Stream stream, int offset, int count) -- Allows you to write a portion of the current stream to a destination stream without first having to call GetBuffer.

Functionality

• Added RecyclableMemoryStreamManager.ThrowExceptionOnToArray. Causes a NotSupportedException to be thrown if RecyclableMemoryStream.ToArray is called. Default is false.
• Added overloads of RecyclableMemoryStreamManager.GetStream that accept Memory<byte> arguments.

Meta

• Added changes.md to solution
• Regenerated API documentation for new XML comments and new APIs.

Bug Fixes

• Removed a buggy and unnecessary boundary check in Write methods.

Performance

• Removed LINQ iteration in some properties.
• Overloads of Read, SafeRead, and Write that accept Span arguments (.NET Core and .NET Standard targets only)

Functionality

• New buffer allocation strategy: exponential. Instead of linearly increasing large buffer sizes by a fixed multiple (say, 1MB), you can choose to have it increase exponentially in size, starting with smaller large buffers. This will allow you more efficient use of space, especially in smaller heap scenarios where you don't have gobs of memory to keep in a pool. We use this in Bing in some data centers that are more resource constrained than others.
• New targets for .NET Framework 4.6, .NET Standard 2.1
• Overload for TryGetBuffer, introduced in .NET Framework 4.6.
• Allow the Stream's GUID to be set explicitly

Meta

• Removed CBT build support files. Using dotnet.exe to build now.
• Added public key for delayed signing during build
• Consolidate and updated all NuGet package settings in the .csproj file.
• Added setting for generating a NuGet package for symbols (.snupkg)

• Bugs fixed when allocating very large streams.
• Concurrent methods for reading from a single stream added.
• Support for .NET 4.0 (without ETW instrumentation).
• It is now safe to call Dispose from multiple threads on the same object.

• Binaries on nuget.org are now signed through Microsoft.
• Some documentation enhancements and typo-cleanup.
• Some minor performance improvements.
• Fix behavior of Dispose() to be safe on double-dispose.

• Initial release.