We've migrated the majority of the features from frontend heavy architecture to backend side. This enables us to gather logs even over 10M logs.
In addition to this big architecture change, we've implemented full text search index in backend side. This allows us to search resources containing logs with specific keywords really faster. It would return the full text search query for 10M logs in few secounds!

Note I'll skip v0.58.0 and v0.58.1 for OSS release for some reasons. This v0.58.2 is our first release of v0.58.x.

What's Changed

Bug Fixes 🐛

• perf(web): pool and reuse layout components across layout transitions by @kyasbal in #904
• fix(web): update form validation on in-flight requests and migrate to signals by @kyasbal in #907
• fix(progressutil): resolve race condition in ProgressUpdator by @kyasbal in #910
• fix(inspection): fix missing filter resource name fields and query estimation metadata by @kyasbal in #911
• fix(timeline): resolve shader asset paths relative to baseUrl and cache WebGL assets by @kyasbal in #929
• perf(core): optimize orderedMapNode reader access and release raw logs after ingestion by @kyasbal in #931
• fix(csm): return structured.Node from TrackAndGetManifest to fix ResourceBody intern error by @kyasbal in #943
• fix(inspection/googlecloudcommon): avoid race condition dropping partition boundary logs in log fetcher by @kyasbal in #947
• fix(timeline): unify dashed border stripe coordinates to screen pixels by @kyasbal in #949
• Handle truncated Kubernetes audit logs by @Haihan-Jiang in #697

Development Environment 💻

• feat(taskrecord): introduce DAG task record and replay test framework by @kyasbal in #924
• docs(skills): add backward-compatibility-policy skill and update coding rules by @kyasbal in #939

Documentation 📝

• docs: add release notes for v0.58.0 by @kyasbal in #927

Other Changes 🛠

• perf: introduce DAG-based Initializer system, eliminate ServerFactory, and remove ViewerMode by @kyasbal in #890
• feat(api,web): introduce Connect-RPC and chunked .khi file import workflow by @kyasbal in #891
• feat: introduce Workbench service with backend CEL filtering and on-demand struct loading by @kyasbal in #892
• feat(khifile): partition client and server intern pools into dedicated chunks by @kyasbal in #893
• feat: display the summary of envoy access logs by @K53 in #887
• perf(workbench,filter): optimize filter result payload with SparseBitset and IdBitset by @kyasbal in #894
• feat(inspection): structured log query estimation and inspection log volume UI redesign by @kyasbal in #895
• feat(popup): migrate popup service to Connect-RPC with server-streaming WatchPopup and polymorphic UI registry by @kyasbal in #897
• feat(googlecloud): add adaptive rate limiter for Cloud Logging API queries by @kyasbal in #896
• feat(upload): migrate file parameter upload to Connect-RPC FileParameterUploadService with chunked uploader and async verifier by @kyasbal in #898
• perf(workbench): accelerate regex log filtering with Roaring Bitmap TrigramIndex and optimized SearchIndex by @kyasbal in #899
• docs(agents): add Jujutsu (jj) workflow skill by @kyasbal in #901
• fix(estimator): inject call options in StructuredLogEstimator and document Google API guidelines by @kyasbal in #900
• perf(server): optimize server-side .khi file loading and timeline filtering by @kyasbal in #903
• feat(server_status): separate ServerStatusService into standalone Connect-RPC with CPU usage monitoring by @kyasbal in #902
• feat(workbench): persistent background Trigram indexing and search optimization by @kyasbal in #905
• feat(api): configure Connect-RPC serialization format based on environment by @kyasbal in #906
• feat(inspection): migrate Inspection REST APIs to Connect-RPC and enable HTTP/2 support by @kyasbal in #908
• feat(inspection): add pending status for asynchronous validation and estimation by @kyasbal in #909
• feat(api): add polling fallback APIs for streaming RPCs and transparent interceptor by @kyasbal in #912
• refactor(web): clean up unused frontend store fields and worker remnants by @kyasbal in #913
• feat(web): support dynamic upload/download config overrides and binary transport by @kyasbal in #915
• feat(workbench): introduce timeline severity bitmask cache and hasSeverity CEL function by @kyasbal in #914
• feat(web): tune legacy polling intervals and switch to sequential short polling for async jobs by @kyasbal in #916
• feat(web): detect workbench session expiration and support reopening by @kyasbal in #917
• feat(workbench): generate architecture graph on backend via GetArchitectureGraph RPC by @kyasbal in #918
• feat(workbench): add batch ReadStructYAMLs RPC and client-side prefetching by @kyasbal in #919
• feat(graph): add toolbar menu, image export, and node pod phase resolution by @kyasbal in #921
• feat(parser,store): stream v6 chunks directly into dynamic stores and introduce StructStore by @kyasbal in #920
• perf(workbench): optimize memory footprint and ingestion performance for .khi datasets by @kyasbal in #922
• feat(web): add Connect-RPC retry interceptor and resilient polling/upload/download by @kyasbal in #923
• perf(web): migrate WebGL timeline rendering to IdBitset and optimize selection resolution by @kyasbal in #925
• refactor(structured,parsers): optimize log parsing with FieldPath interning and Extractor pattern by @kyasbal in #928
• feat(logestimator): introduce EstimatedCountPreset for rough query log estimation by @kyasbal in #926
• refactor(web): unify log naming conventions and optimize log list data structure by @kyasbal in #930
• feat(controlplane): support HPA controller logs parsing and timeline mapping by @kyasbal in #932
• perf(core): optimize structured Node fast lookup and flattenNode allocations by @kyasbal in #933
• perf(khifile): optimize InternPool memory retention, ID resolutions, and ToInternedStruct allocations by @kyasbal in #935
• feat(googlecloudcommon): parallelize Cloud Logging conversion with k-way merge and display fetch ETA by @kyasbal in #936
• perf(workbench): pack CEL TrigramKey into uint64 and serialize StructYAMLs on-demand by @kyasbal in #938
• refactor(model): extract id generator into pkg/model/id and use uint32 for log ID by @kyasbal in #937
• perf(core,inspection): parallelize log filtering and optimize filter extractors by @kyasbal in #940
• refactor(model): refactor TimelineBuilder revisions and events to lightweight types by @kyasbal in #941
• perf(patternfinder): optimize Trie memory efficiency with Radix Tree by @kyasbal in #944
• docs(skill): add workspace isolation and prefer-jj guidelines to jj-workflow by @kyasbal in #946
• ci: cache dependencies and share frontend build artifacts across workflows by @kyasbal in #945
• perf(khifile): optimize in-memory model via flat structure-of-arrays representation by @kyasbal in #950
• feat(timeline): extract multi-term log search as shared chip-search-bar dumb component by @kyasbal in #951

Full Changelog: v0.58.0...v0.58.2

What's Changed

Bug Fixes 🐛

• Correct managed airflow product name by @kyasbal in #882
• fix(inspection): deduplicate feature tasks by SelectionPriority in SetInspectionType by @kyasbal in #884

Other Changes 🛠

• perf(core): adopt LazyJSONNode for log ingestion and optimize Kubernetes manifest memory footprint by @kyasbal in #885

Full Changelog: v0.57.9...v0.57.10

What's Changed

Bug Fixes 🐛

• Excluding composer audit log from composer environment log query by @kyasbal in #880
• Updated color of GCP resource timelines by @kyasbal in #881

Other Changes 🛠

• adding support for Managed airflow audit log by @kyasbal in #878
• feat(composer): use cloud monitoring metrics for historical GKE cluster discovery in composer by @kyasbal in #879

Full Changelog: v0.57.6...v0.57.9

What's Changed

Bug Fixes 🐛

• fix: remove CSM traffic log from the container log filter by @K53 in #874

CI/CD ⚙️

• Updated Go version to 1.26 in dockerfile by @kyasbal in #876

Other Changes 🛠

• Updated dependencies by @kyasbal in #872

Note that v0.57.5 is abandoned due to our CD pipeline failure and tag immutability policy

Full Changelog: v0.57.4...v0.57.6

What's Changed

Bug Fixes 🐛

• fix: remove CSM traffic log from the container log filter by @K53 in #874

Other Changes 🛠

• Updated dependencies by @kyasbal in #872

Full Changelog: v0.57.4...v0.57.5

What's Changed

Bug Fixes 🐛

• refactor: rename terminology from CSM Access log to Traffic log by @K53 in #869
• fixed Composer parser bugs by @kyasbal in #873

Other Changes 🛠

• refactor(composer): refine Airflow timeline styles and path hierarchy by @kyasbal in #871

New Contributors

• @K53 made their first contribution in #869

Full Changelog: v0.57.3...v0.57.4

What's Changed

Bug Fixes 🐛

• feat(inspection): add NodeNameDiscoveryTask for k8snode and k8scontainer log parsers by @kyasbal in #860
• fix(web): resolve selection issues in SelectionManager and History view by @kyasbal in #859

Other Changes 🛠

• docs: modernize and split KHI task system conceptual guide into modular files by @kyasbal in #865
• feat(logutil): Add SelectorLogParser and ZapConsoleTextParser by @kyasbal in #848
• feat(inspection): handle GKE dryRun audit logs as events (#866) by @kyasbal in #867

Full Changelog: v0.57.2...v0.57.3

This change includes organizing the top page README and minor frontend useful feature improvements.

Check our new KHI introductory video out!

623308348-591357d0-9402-4dd1-b30f-6ae7e25b5cc9.mp4

What's Changed

Bug Fixes 🐛

• Fix cluster name normalization for GKE on AWS/Azure in node log parsers (#838) by @kyasbal in #845

Documentation 📝

• improved the top page document by @kyasbal in #839
• docs: update video thumbnail link, refine execution guide, and add job mode guide by @kyasbal in #843
• minor style improvement on README by @kyasbal in #844
• Added KHI introduction video by @kyasbal in #840
• Change asset link in README by @kyasbal in #841
• Replace asset link in README.ja.md by @kyasbal in #842

Other Changes 🛠

• feat(web): make log view left columns sticky on horizontal scroll by @kyasbal in #849
• feat(web): add collapse and expand feature for timeline hierarchy by @kyasbal in #850

Full Changelog: v0.57.1...v0.57.2

KHI v0.57.1

Compare

Choose a tag to compare

KHI v0.57.0

Compare

Choose a tag to compare

KHI v0.56.7

Compare

Choose a tag to compare