Skip to content

DOCS-1738 - Document 256KB log message size support - #6881

Merged
JV0812 merged 11 commits into
mainfrom
DOCS-1738-256kb-log-message-size
Aug 27, 2026
Merged

DOCS-1738 - Document 256KB log message size support#6881
JV0812 merged 11 commits into
mainfrom
DOCS-1738-256kb-log-message-size

Conversation

@JV0812

@JV0812 JV0812 commented Jul 9, 2026

Copy link
Copy Markdown
Collaborator

Purpose of this pull request

This pull request documents the increase of the maximum log message size from 64KB to 256KB, calls out the known limitations, and adds a service release note. It also bundles DOCS-1773 (Slack and Jira Cloud webhook character-limit documentation).

Changes:

  • Updated max-message-size references from 64KB to 256KB (and _size truncation from 65536 to 262144) in search-large-messages.md, collect-multiline-logs.md, cloud-syslog-source/index.md, and qualys-vmdr-source.md.
  • Added a Known limitations section to search-large-messages.md (LogCompare/LogReduce, UI 25-messages-per-page, Cloud SIEM, FER).
  • Added LogCompare/LogReduce truncation + response-time notes on logcompare.md and detect-patterns-with-logreduce.md.
  • Clarified in fer-limitations.md that the 64KB cumulative field cap applies regardless of message size.
  • Added Known limitations sections to slack.md (40,000-character Slack message limit) and jira-cloud.md (32,767-character Jira Cloud issue description limit) — DOCS-1773.
  • New service release note blog-service/2026-08-19-search.md (renamed from 2026-07-09-search.md to match actual publish date).

Open items to confirm before marking ready

  • FER cumulative field limit stays 64KB (documented as such) — confirmed by @lei-sumo: FER works with 256KB logs, only the cumulative extracted-field size is capped at 64KB.
  • Cloud SIEM limitation wording ("might not process messages larger than 64KB correctly") — confirmed accurate. SUMO-257908 is closed as "Not a Bug — work by design," and the umbrella epic SUMO-282954 explicitly states Cloud SIEM is excluded from this 256KB GA and will be addressed in a follow-up effort. The doc wording makes no claim about 256KB — it only states the existing 64KB parsing/mapping limitation, which remains accurate and unchanged.
  • Release note date/category (2026-08-19 / Search).

Select the type of change

  • Minor Changes - Typos, formatting, slight revisions
  • Update Content - Revisions, updating sections
  • New Content - New features, sections, pages, tutorials
  • Site and Tools - .clabot, version updates, maintenance, dependencies, new packages for the site (Docusaurus, Gatsby, React, etc.)

Ticket (if applicable)

https://sumologic.atlassian.net/browse/DOCS-1738 (epic: SUMO-288529)

Also bundles: https://sumologic.atlassian.net/browse/DOCS-1773

Update max log message size references from 64KB to 256KB across search,
collection, and source docs; add a Known limitations section and
LogCompare/LogReduce truncation notes; clarify the FER 64KB cap; and add a
service release note.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@JV0812 JV0812 self-assigned this Jul 9, 2026
@cla-bot cla-bot Bot added the cla-signed Contributor approved, listed in .clabot file label Jul 9, 2026
Comment thread docs/search/get-started-with-search/search-basics/search-large-messages.md Outdated
Comment thread blog-service/2026-07-09-search.md Outdated
Update the Log Search messages-table limitation to the GA behavior (table
shows up to 64KB after expansion; full message via Log Message Inspector),
and drop the unverified large-log source examples from the release note.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@JV0812
JV0812 requested a review from lei-sumo July 21, 2026 08:36
@JV0812
JV0812 marked this pull request as ready for review July 21, 2026 08:37
@kimsauce

Copy link
Copy Markdown
Collaborator

Holding off on approval — the PR description lists three open items still unconfirmed:

  • FER cumulative field limit stays 64KB (documented as such) — confirm not raised.
  • Cloud SIEM limitation wording ("might not process messages larger than 64KB correctly"; ref SUMO-257908).
  • Release note date/category (2026-07-09 / Search).

Could you confirm these and check the boxes before this goes up for merge? The doc mechanics (links, cross-references, consistency of the 64KB→256KB updates across all affected files) all check out — just want the factual claims nailed down first.

JV0812 added 2 commits July 28, 2026 11:33
Adds known-limitation notes for Slack's message truncation and
Jira Cloud's 32,767-character issue description limit, called out
directly on each webhook connection page and cross-linked from the
central 256KB known limitations list, since larger messages make
both limits more likely to be hit.
Adds Slack's 40,000-character hard limit, splits the search-large-
messages known limitations into Sumo Logic platform vs. downstream
webhook connection limitations for clarity, previews both in the
intro, and tightens the release note with the same distinction.
Comment thread blog-service/2026-07-09-search.md Outdated
Comment thread docs/search/get-started-with-search/search-basics/search-large-messages.md Outdated
Comment thread blog-service/2026-08-27-search.md
Comment thread blog-service/2026-08-27-search.md
Comment thread docs/alerts/webhook-connections/jira-cloud.md Outdated
Comment thread docs/search/get-started-with-search/search-basics/search-large-messages.md Outdated

@lei-sumo lei-sumo left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

during GNG meeting, we made another pass and left several comments.

…elease note

- Correct the Log Search messages table limit from 64KB to the GA value of
  25,000 characters, and note that JSON values in larger messages aren't
  rendered as JSON fields by default (per ssharma-sumo).
- Correct Jira Cloud webhook behavior: oversized descriptions are truncated
  with "..." and the issue is still created, not a 400 Bad Request failure
  (per lei-sumo).
- Drop the release note's summarized limitations bullets, which mischaracterized
  the Field Extraction Rule limit as a message-size cap rather than a
  cumulative-field-size cap (per kevin-sumo/lei-sumo), and link to the doc's
  Known limitations section instead.

@lei-sumo lei-sumo left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@JV0812
JV0812 requested a review from ssharma-sumo August 10, 2026 12:37

@kimsauce kimsauce left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fast content-accuracy pass on this doc PR. Nothing blocking, but flagging a few unsourced/unconfirmed technical claims worth a second look before merge (see inline comments). Also noting the PR description itself still has 3 unchecked "confirm before ready" items (FER limit, Cloud SIEM wording, release note date).

Comment thread docs/send-data/hosted-collectors/cloud-syslog-source/index.md
@JV0812
JV0812 requested a review from kimsauce August 24, 2026 07:26

@amee-sumo amee-sumo left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approving — the doc mechanics are solid: all 64KB→256KB / 65536→262144 conversions check out, cross-links between search-large-messages.md, logcompare.md, detect-patterns-with-logreduce.md, slack.md, and jira-cloud.md are correct and reciprocal, and most of the factual-accuracy concerns raised earlier in this thread (25,000-char table limit, LogCompare/LogReduce truncation, cloud syslog/multiline/Qualys C2C) have real confirmations behind them now.

One blocking item before merge: the PR description's own checklist still has "Cloud SIEM limitation wording" unchecked. The "Parsing and mapping might not process messages larger than 64KB correctly" claim in search-large-messages.md's Known Limitations section is sourced from the DOCS-1738 ticket text, but per @JV0812's Aug 19 comment it's still pending a final nod from the SIEM team (ref SUMO-257908) — please get that confirmation and check the box before merging.

Non-blocking paperwork nits: the PR description still references the old release-note filename (2026-07-09-search.md, renamed to 2026-08-19-search.md), and doesn't mention the Slack/Jira Cloud webhook char-limit work (DOCS-1773) that's bundled into this branch — worth updating for a complete paper trail.

@JV0812

JV0812 commented Aug 24, 2026

Copy link
Copy Markdown
Collaborator Author

Thanks @amee-sumo! Fixed both non-blocking items in the PR description:

  • Updated the release-note filename reference to `2026-08-19-search.md` (it was renamed from `2026-07-09-search.md` to match its actual publish date).
  • Added a bullet for the bundled Slack/Jira Cloud webhook char-limit work and linked the ticket, DOCS-1773 ("Document: Add slack and jira webhooks limitations on char limits").

The blocking item (Cloud SIEM wording, ref SUMO-257908) is still open — still waiting on that final confirmation from the SIEM team before checking the box.

@JV0812

JV0812 commented Aug 24, 2026

Copy link
Copy Markdown
Collaborator Author

@amee-sumo Confirmation received on the blocking item — checked the box.

SUMO-257908 is closed as "Not a Bug — work by design." More importantly, the umbrella epic for this 256KB GA (SUMO-282954) explicitly states: "CSIEM product will NOT be part of the initial GA but will be addressed as a follow up effort." So Cloud SIEM staying capped at 64KB is deliberate, not a pending fix — and the doc line itself doesn't make any claim about 256KB, it just states the existing 64KB parsing/mapping limitation, which remains accurate as written.

All three "Open items to confirm" are now checked off. Should be ready to merge.

@JV0812
JV0812 enabled auto-merge August 27, 2026 06:47
@JV0812
JV0812 added this pull request to the merge queue Aug 27, 2026
Merged via the queue into main with commit 77e0172 Aug 27, 2026
4 checks passed
@JV0812
JV0812 deleted the DOCS-1738-256kb-log-message-size branch August 27, 2026 06:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla-signed Contributor approved, listed in .clabot file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants