Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Druid 30.0.0 release notes #16412

Merged
merged 14 commits into from
May 27, 2024
Merged

Conversation

ektravel
Copy link
Contributor

@ektravel ektravel commented May 7, 2024

Release and upgrade notes for Druid 30.0.0

This PR has:

  • been self-reviewed

@317brian 317brian added this to the 30.0.0 milestone May 8, 2024
@ektravel ektravel marked this pull request as ready for review May 8, 2024 19:44
Copy link
Member

@asdf2014 asdf2014 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, also left some comments here

docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
@ektravel ektravel changed the title Druid 30.0.0 release notes - WIP Druid 30.0.0 release notes May 10, 2024
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
Copy link
Contributor

@kfaraz kfaraz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left some suggestions.

Review of release notes for PR #15817 is still pending.

docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
docs/release-info/release-notes.md Outdated Show resolved Hide resolved
@LakshSingla
Copy link
Contributor

@ektravel I don't see the changes introduced by this PR #16322 in the release notes. It should be added in SQL-based Ingestion/Querying.
The functionality added by this is:
a. It allows the MSQ engine to sort complex columns.
b. It allows the MSQ engine to group on complex columns (we might omit if it has been iterated already)
c. It allows the MSQ engine to roll up on supported complex columns (JSON columns are the only columns supported for this atm).


#### Selective loading of lookups

Druid now supports selective loading of lookups in the task layer.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Druid now supports selective loading of lookups in the task layer.
We have built the foundation of selective lookup loading. As part of enabling this, `KillUnusedSegmentsTask` does not load lookups.

@@ -57,50 +57,689 @@ For tips about how to write a good release note, see [Release notes](https://git

This section contains important information about new and existing features.

### Improved native queries
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IMO we should explicitly mention "Support grouping on complex columns and nested arrays"

@@ -57,50 +57,689 @@ For tips about how to write a good release note, see [Release notes](https://git

This section contains important information about new and existing features.

### Improved native queries

Native queries can now group on nested columns and arrays.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Native queries can now group on nested columns and arrays.
Native queries can now group on supported complex columns and nested arrays.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is it possible to expand upon the feature a bit more - maybe we can add an example and an image.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should mention that rollup on complex columns is supported via MSQ, and the possible advantages of doing so. I think we can combine it in the same section.

@cryptoe cryptoe merged commit 00f91af into apache:30.0.0 May 27, 2024
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

10 participants