github.com/go-graphite/go-carbon

• trie/realtime: set wspConfigRetriever when realtime index is enabled #395 #396
• Go v1.15.3

• carbonserver: fix incorrect hanlding of counting and indexing files in updateFileList #385

• trie/bug fixes and finally adds some simple fuzzing logics #383

• Go v1.15.3
• carbonserver: fix findError information lost due to unexported fields #380
• Upgrade golangci-lint #378
• A concurrent version of trie index (#334)
• carbonserver: fix two panics related to prometheus #374 (#376)
• Add service.version for all the traces (#373)
• trie: add a little documentation about efficient metric naming patterns (#370)
• Implementing linters (#368)
• Go v1.15.1 (#367)
• Tracing/Opentelemetry (#364)
• [travis-ci] Add apt-get update and go mod vendor to sync gox installation in Travis (#361)
• Fix pubsub test (#360)
• fix packages.sh (#359)

• Migrate to go modules (#351)
• Moving to go-graphite organization (#347)
• Carbonlink support fixed with Python 3 Pickle Compatible Metric Request Parser (#340)
• (EXPERIMENTAL) Adding ability to update index for metrics even if there is no whisper file created on disk (#338)
• bugfix: unconfirmed metrics (#319)
• Implement context cancellations for find and find part of render (#307)
• (EXPERIMENTAL) Trie Index (#303)
• Populate metric details and access times only if stats are enabled (#299)
• Automatically delete empty whisper file caused by edge cases like server reboot (#293)
• (EXPERIMENTAL) Added new options and upgraded go-whisper library to have compressed format (cwhisper) support

• Accept UDP messages in plain protocol without trailing newline
• Added whisper.hard-max-creates-per-second option #242
• No longer trying to combine separate UDP messages from one sender into single stream
• [carbonserver] Added metrics for prometheus
• [carbonserver] Improved compatibility with graphite-web (#250, #251)

• Added whisper.max-creates-per-second option
• Support multiple targets in carbonserver
• Support new carbonapi_v3_pb protocol. This allows recent versions of carbonapi to get metadata alongside with data

• Tags support was added (only with graphite-web)
• flock support for persister and carbonserver
• cache.max-size and cache.write-strategy can be changed without restart (HUP signal)
• Google PubSub protocol was added. It receives data from PubSub Subscriptions and can decode protobuf, plain, or pickle messages.
  • The default format is plain. Specify protobuf or pickle by adding an attribute named 'content-type' to the PubSub messsages:
    • application/protobuf
    • application/python-pickle
  • Sample configuration:

[receiver.pubsub]
protocol = "pubsub"
project = "project-name"
subscription = "subscription-name"
# receiver_go_routines = 4
# receiver_max_messages = 1000
# receiver_max_bytes = 500000000 # default 500MB

• GRPC api for query cache was added
• Added support for an unlimited number of receivers
• Protobuf protocol was added. Sample configuration:

[receiver.protobuf]
protocol = "protobuf"
listen = ":2005"

• HTTP protocol was added. It receives data from POST requests body. Data can be encoded in plain, pickle (Content-Type: application/python-pickle) and protobuf (Content-Type: application/protobuf) formats. Sample configuration:

[receiver.http]
protocol = "http"
listen = ":2006"

• Kafka protocol was added. It receives data from Kafka and can decode protobuf, plain or pickle messages. You need manually specify message format in the config file. Sample configuration:

[receiver.kafka]
protocol = "kafka"
parse-protocol = "protobuf" # can be also "plain" or "pickle"
brokers = [ "localhost:9092" ]
topic = "graphite"
partition = 0
state-file = "/var/lib/graphite/kafka.state"
initial-offset = "-30m" # In case of absent or damaged state file fetch last 30 mins of messages

Breaking changes:

• common: logfile and log-level in common config section are deprecated
• changed config defaults:
  • user changed to carbon
  • whisper directory changed to /var/lib/graphite/whisper/
  • schemas config changed to /etc/go-carbon/storage-schemas.conf
• rpm:
  • binary moved to /usr/bin/go-carbon
  • configs moved to /etc/go-carbon/
• deb:
  • binary moved to /usr/bin/go-carbon

Other changes:

• common: Requires Go 1.8 or newer
• common: Logging refactored. Format changed to structured JSON. Added support of multiple logging handlers with separate output, level and encoding
• dump/restore: New dump format. Added go-carbon -cat filename command for printing dump to console. New version of go-carbon can read old dump
• dump/restore: [fix] go-carbon can not stop after dump (with enabled dump and carbonserver)
• carbonserver: [feature] IdleTimeout is now configurable in carbonserver part
• carbonserver: [feature] support /render query cache (query-cache-* options in config file)
• carbonserver: [feature] support /metrics/find cache (find-cache-* option in config file)
• carbonserver: [feature] support /metrics/details handler, that returns information about metrics (require enabled trigram-index)
• carbonserver: [feature] Add config option to disable trigram index (before that to disable index you should set scan-interval to 0)
• carbonserver: [fix] fix #146 (metrics_known was broken if metrics were not sent as counters)

• Always stop on USR2 signal (previously did not stop with disabled dump/restore) #135

• Completely new internal architecture
• Removed flush to whisper and stop on USR2 signal. Use dump/restore instead
• Removed global queue (channel) between receivers and cache, added optional per-receiver queues
• Built-in carbonserver (thanks Vladimir Smirnov)
• Added runtime tunables to internal metrics #70

• Bug fix: The synchronous config reload (HUP signal) and launch of the internal collecting statistics procedure (every "metric-interval") could cause deadlock (thanks Maxim Ivanov)

• Fully refactored and optimizer cache module (core of go-carbon) (thanks Maxim Ivanov)
• Added noop cache.write-strategy (thanks Maxim Ivanov)
• New optional dump/restore functional for minimize data loss on restart
• Refactored internal stat mechanics. common.graph-prefix and common.metric-interval now can be changed without restart (on HUP signal)
• Customizable internal metrics endpoint. common.metric-endpoint param. Valid values: "local" and "" (write directly to whisper), "tcp://host:port", "udp://host:port"

• Added cache.write-strategy option (values "max" or "sorted") (thanks Alexander Akulov)
• commitedPoints metric renamed to committedPoints

• Added sparse file creation (whisper.sparse-create config option)
• Enable reload in init script (thanks Jose Riguera)
• Clean up schemas parser code (thanks Dieter Plaetinck)
• Better go-whisper error handling (thanks Hiroaki Nakamura)
• Don't try to create whisper file if exists with bad permissions #21

• Fixed problem: Points in queue (channel) between cache and persister subsystems was invisible for carbonlink

• Cache module optimization

• Fix RPM init script

• Improved validation of bad wsp files
• RPM init script checks config before restart
• Debug logging of bad pickle messages

• Fix bug in go-whisper library: UpdateMany saves first point if many points has identical timestamp

• Reduced error level of "bad messages" in tcp and pickle receivers. Now info
• Configurable logging level. log-level option
• Fix wrong carbonlink request error in log

• -check-config validates schemas and aggregation configs
• Fix broken internal metrics tcp.active and pickle.active
• Optional udp incomplete messages logging: log-incomplete setting
• Fixes for working on x86-32
• logging fsnotify: fix ONCE rotation bug

• Optional whisper throttle setting #8: max-updates-per-second

• Fix bug in go-whisper: points in long archives missed if metrics retention count >=3

• Bug fix schemas parser