From 97858886e9b2a1bde15174469407aa55a9906da8 Mon Sep 17 00:00:00 2001 From: David Radley Date: Fri, 13 Oct 2023 11:33:08 +0100 Subject: [PATCH 01/16] add licenses to dark and lisk css files Signed-off-by: David Radley --- docs/assets/_code-dark.scss | 17 +++++++++++++++++ docs/assets/_code-light.scss | 17 +++++++++++++++++ 2 files changed, 34 insertions(+) diff --git a/docs/assets/_code-dark.scss b/docs/assets/_code-dark.scss index 3f51ed3537..494f9612f3 100644 --- a/docs/assets/_code-dark.scss +++ b/docs/assets/_code-dark.scss @@ -1,3 +1,20 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agreements. See the NOTICE file +// distributed with this work for additional information +// regarding copyright ownership. The ASF licenses this file +// to you under the Apache License, Version 2.0 (the +// "License"); you may not use this file except in compliance +// with the License. You may obtain a copy of the License at +// +// http://www.apache.org/licenses/LICENSE-2.0 +// +// Unless required by applicable law or agreed to in writing, +// software distributed under the License is distributed on an +// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +// KIND, either express or implied. See the License for the +// specific language governing permissions and limitations +// under the License. + /** * Syntax highlighting generated via * hugo gen chromastyles --style=github-dark > chroma.css diff --git a/docs/assets/_code-light.scss b/docs/assets/_code-light.scss index e002a99c2e..82c5162037 100644 --- a/docs/assets/_code-light.scss +++ b/docs/assets/_code-light.scss @@ -1,3 +1,20 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agreements. See the NOTICE file +// distributed with this work for additional information +// regarding copyright ownership. The ASF licenses this file +// to you under the Apache License, Version 2.0 (the +// "License"); you may not use this file except in compliance +// with the License. You may obtain a copy of the License at +// +// http://www.apache.org/licenses/LICENSE-2.0 +// +// Unless required by applicable law or agreed to in writing, +// software distributed under the License is distributed on an +// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +// KIND, either express or implied. See the License for the +// specific language governing permissions and limitations +// under the License. + /** * Syntax highlighting generated via * hugo gen chromastyles --style=github > chroma.css From fbcee23b4dae2fbc1d7e8d4ce780319a4a786d99 Mon Sep 17 00:00:00 2001 From: "david_radley@uk.ibm.com" Date: Tue, 3 Feb 2026 14:25:31 +0000 Subject: [PATCH 02/16] Community blog February 2026 Signed-off-by: david_radley@uk.ibm.com --- .../posts/2026-02-01-community-update.md | 109 ++++++++++++++++++ 1 file changed, 109 insertions(+) create mode 100644 docs/content/posts/2026-02-01-community-update.md diff --git a/docs/content/posts/2026-02-01-community-update.md b/docs/content/posts/2026-02-01-community-update.md new file mode 100644 index 0000000000..d3bc1f0059 --- /dev/null +++ b/docs/content/posts/2026-02-01-community-update.md @@ -0,0 +1,109 @@ +--- +authors: +- davidrad: null + name: David Radley +date: "2026-02-02T08:00:00Z" +excerpt: Flink Community update for February 2026 +title: Flink Community Update - February'26 +aliases: +- /news/2026/02/02/community-update.html +--- + +# This past month in Flink + + +* [This past month in Flink](#this-past-month-in-flink) + * [Flink related Blogs](#flink-related-blogs) + * [Summary of Apache Flink Dev List (covering January 2026)](#summary-of-apache-flink-dev-list-covering-january-2026) + * [📊 Key Themes](#-key-themes) + * [🎉 Community Announcements](#-community-announcements) + * [📋 Active FLIPs](#-active-flips) + * [🔧 Kubernetes Operator 1.14.0 Release](#-kubernetes-operator-1140-release) + * [❓For more information](#for-more-information) + + +Previous Blog : +[http://localhost:1313/2020/09/04/flink-community-update-august20/](http://localhost:1313/2020/09/04/flink-community-update-august20/) + +After a gap, the Community update is back for February 2026! As usual this update will summarise what has happened in the previous month (January). +- In the last few years the Flink PR backlog got to around 1200. We introduced the stale bot last year, and it came down to around 200. +Interestingly, in the last month or so the backlog has been creeping up again and is over 250. +- The previous month has seen the connector parent v2 being released, the long awaited connector parent brought up to date and flink 2 ready. +- The AWS connectors have been enhanced and are about be to be released for Flink v1 and v2. +- Flink dev connector slack brought up an interesting discussion the Python connectors are in the Flink core repository + but the rest of the connector code is in its own repository. +- Flink HTTP connector, addressed all outstanding raised PRs. Preparing for releasing it. +- Flink Kafka connector had quite a busy month with around 10 commits going in. The most interesting were: + - [FLINK-38947] Handle errors in onCompletion callback only once (#214) + - [FLINK-38876] Support per-cluster offset in Dynamic Kafka Source (#209) +- Flink Kubenetes operator + - had 9 commits, improvements to the blue-green deployment stood out. + - Preparing to release Kubernetes Operator 1.14.0 + +## Flink related Blogs + +* Extensive view on the streaming trends for 2026 +[https://www.kai-waehner.de/blog/2025/12/10/top-trends-for-data-streaming-with-apache-kafka-and-flink-in-2026/](https://www.kai-waehner.de/blog/2025/12/10/top-trends-for-data-streaming-with-apache-kafka-and-flink-in-2026/) +* A view on the Flink world from Ververica +[https://www.ververica.com/blog/a-world-without-kafka](https://www.ververica.com/blog/a-world-without-kafka) +* A blog on Flink being the future of stream processing +[https://www.oreateai.com/blog/understanding-apache-flink-the-future-of-stream-processing/284a4ec5131c57f2dbf5b0b2660f896f](https://www.oreateai.com/blog/understanding-apache-flink-the-future-of-stream-processing/284a4ec5131c57f2dbf5b0b2660f896f) + +## Summary of Apache Flink Dev List (covering January 2026) + +AI summary. + +### 📊 Key Themes + +1. Enhanced Application Mode for batch processing +2. Improved observability and error reporting +3. SQL syntax evolution for diverse artifacts +4. Performance optimization through adaptive partitioning +5. Kubernetes Operator maturity + +### 🎉 Community Announcements + +**New Committers:** +- **David Radley** +- **Yuepeng Pan (RocMarshal)** + +**New PMC Member:** +- **Hang Ruan** + +### 📋 Active FLIPs + +**FLIP-560: Application Capability Enhancement** (Yi Zhang) +- Multi-job execution in Application Mode +- Re-running main method after JobManager restarts +- Expose main method exceptions via REST/UI +- Active discussion on error handling and diagnostics + +**FLIP-559: Add ARTIFACT Keyword** (Mika Naylor) +- Generic ARTIFACT keyword for CREATE FUNCTION +- Supports future artifact types beyond JARs +- Moving toward vote + +**FLIP-487: Rescale History in Web UI** (Yuepeng Pan) +- Vote started January 7, 2026 +- Improves rescaling observability + +**FLIP-558: SinkUpsertMaterializer Improvements** (Dawid) +- Vote started + +**FLIP-339: Adaptive Partition Selection** (Yuepeng Pan) +- Dynamic partitioning based on downstream load +- Focuses on rebalance/rescale, debate on shuffle() + +**FLIP-561: Restructure Flink documentation** (Martijn Visser) +- Vote started January 15, 2026 + +### 🔧 Kubernetes Operator 1.14.0 Release + +- **Target:** Release cut January 30, RC vote early February +- **Release Manager:** Gyula Fóra +- **Key Features:** FlinkBlueGreenDeployment fixes from Shopify team + +### ❓For more information + +Anything you think has been misrepresented, is wrong or missing, please let me know via Flink Slack. +If you would like to keep a closer eye on what’s happening in the community, subscribe to the Flink [@community mailing list](https://flink.apache.org/community.html#mailing-lists) to get fine-grained weekly updates, upcoming event announcements and more. \ No newline at end of file From f19db520dfd31b6221c65a76bc07cda140a224d1 Mon Sep 17 00:00:00 2001 From: "david_radley@uk.ibm.com" Date: Wed, 4 Feb 2026 09:41:58 +0000 Subject: [PATCH 03/16] Fix url for previous blog Signed-off-by: david_radley@uk.ibm.com --- docs/content/posts/2026-02-01-community-update.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/content/posts/2026-02-01-community-update.md b/docs/content/posts/2026-02-01-community-update.md index d3bc1f0059..3e19dc1c02 100644 --- a/docs/content/posts/2026-02-01-community-update.md +++ b/docs/content/posts/2026-02-01-community-update.md @@ -23,7 +23,7 @@ aliases: Previous Blog : -[http://localhost:1313/2020/09/04/flink-community-update-august20/](http://localhost:1313/2020/09/04/flink-community-update-august20/) +[https:/flink.apache.org/2020/09/04/flink-community-update-august20/](https:/flink.apache.org/2020/09/04/flink-community-update-august20/) After a gap, the Community update is back for February 2026! As usual this update will summarise what has happened in the previous month (January). - In the last few years the Flink PR backlog got to around 1200. We introduced the stale bot last year, and it came down to around 200. From df420d50857681b043ac7453ed199e7deaee391e Mon Sep 17 00:00:00 2001 From: "david_radley@uk.ibm.com" Date: Wed, 4 Feb 2026 12:38:31 +0000 Subject: [PATCH 04/16] address review comments Signed-off-by: david_radley@uk.ibm.com --- .../posts/2026-02-01-community-update.md | 35 +++++++++---------- 1 file changed, 17 insertions(+), 18 deletions(-) diff --git a/docs/content/posts/2026-02-01-community-update.md b/docs/content/posts/2026-02-01-community-update.md index 3e19dc1c02..7e127f2f1f 100644 --- a/docs/content/posts/2026-02-01-community-update.md +++ b/docs/content/posts/2026-02-01-community-update.md @@ -15,11 +15,11 @@ aliases: * [This past month in Flink](#this-past-month-in-flink) * [Flink related Blogs](#flink-related-blogs) * [Summary of Apache Flink Dev List (covering January 2026)](#summary-of-apache-flink-dev-list-covering-january-2026) - * [📊 Key Themes](#-key-themes) - * [🎉 Community Announcements](#-community-announcements) - * [📋 Active FLIPs](#-active-flips) - * [🔧 Kubernetes Operator 1.14.0 Release](#-kubernetes-operator-1140-release) - * [❓For more information](#for-more-information) + * [Key Themes](#key-themes) + * [Community Announcements](#community-announcements) + * [Active FLIPs](#active-flips) + * [Kubernetes Operator 1.14.0 Release](#kubernetes-operator-1140-release) + * [For more information](#for-more-information) Previous Blog : @@ -28,22 +28,21 @@ Previous Blog : After a gap, the Community update is back for February 2026! As usual this update will summarise what has happened in the previous month (January). - In the last few years the Flink PR backlog got to around 1200. We introduced the stale bot last year, and it came down to around 200. Interestingly, in the last month or so the backlog has been creeping up again and is over 250. -- The previous month has seen the connector parent v2 being released, the long awaited connector parent brought up to date and flink 2 ready. +- The previous month has seen the connector parent v2 being released, the long awaited connector parent brought up to date and flink v2 ready. - The AWS connectors have been enhanced and are about be to be released for Flink v1 and v2. -- Flink dev connector slack brought up an interesting discussion the Python connectors are in the Flink core repository - but the rest of the connector code is in its own repository. +- Flink dev connector Slack brought up an interesting discussion: the Python connectors are in the Flink core repository, but the rest of the connector code is in their own connector specific repository. - Flink HTTP connector, addressed all outstanding raised PRs. Preparing for releasing it. - Flink Kafka connector had quite a busy month with around 10 commits going in. The most interesting were: - - [FLINK-38947] Handle errors in onCompletion callback only once (#214) - - [FLINK-38876] Support per-cluster offset in Dynamic Kafka Source (#209) + - [FLINK-38947] Handle errors in onCompletion callback only once ([#214](https://github.com/apache/flink-connector-kafka/pull/214)) + - [FLINK-38876] Support per-cluster offset in Dynamic Kafka Source ([#209](https://github.com/apache/flink-connector-kafka/pull/209)) - Flink Kubenetes operator - - had 9 commits, improvements to the blue-green deployment stood out. + - 9 commits, improvements to the blue-green deployment stood out. - Preparing to release Kubernetes Operator 1.14.0 ## Flink related Blogs -* Extensive view on the streaming trends for 2026 -[https://www.kai-waehner.de/blog/2025/12/10/top-trends-for-data-streaming-with-apache-kafka-and-flink-in-2026/](https://www.kai-waehner.de/blog/2025/12/10/top-trends-for-data-streaming-with-apache-kafka-and-flink-in-2026/) +* Kai Waehner +[Extensive view on the streaming trends for 2026](https://www.kai-waehner.de/blog/2025/12/10/top-trends-for-data-streaming-with-apache-kafka-and-flink-in-2026/) * A view on the Flink world from Ververica [https://www.ververica.com/blog/a-world-without-kafka](https://www.ververica.com/blog/a-world-without-kafka) * A blog on Flink being the future of stream processing @@ -53,7 +52,7 @@ Interestingly, in the last month or so the backlog has been creeping up again an AI summary. -### 📊 Key Themes +### Key Themes 1. Enhanced Application Mode for batch processing 2. Improved observability and error reporting @@ -61,7 +60,7 @@ AI summary. 4. Performance optimization through adaptive partitioning 5. Kubernetes Operator maturity -### 🎉 Community Announcements +### Community Announcements **New Committers:** - **David Radley** @@ -70,7 +69,7 @@ AI summary. **New PMC Member:** - **Hang Ruan** -### 📋 Active FLIPs +### Active FLIPs **FLIP-560: Application Capability Enhancement** (Yi Zhang) - Multi-job execution in Application Mode @@ -97,13 +96,13 @@ AI summary. **FLIP-561: Restructure Flink documentation** (Martijn Visser) - Vote started January 15, 2026 -### 🔧 Kubernetes Operator 1.14.0 Release +### Kubernetes Operator 1.14.0 Release - **Target:** Release cut January 30, RC vote early February - **Release Manager:** Gyula Fóra - **Key Features:** FlinkBlueGreenDeployment fixes from Shopify team -### ❓For more information +## For more information Anything you think has been misrepresented, is wrong or missing, please let me know via Flink Slack. If you would like to keep a closer eye on what’s happening in the community, subscribe to the Flink [@community mailing list](https://flink.apache.org/community.html#mailing-lists) to get fine-grained weekly updates, upcoming event announcements and more. \ No newline at end of file From 2a7e18d69d885532db740837df0e0fe86959c25a Mon Sep 17 00:00:00 2001 From: "david_radley@uk.ibm.com" Date: Wed, 4 Feb 2026 13:41:15 +0000 Subject: [PATCH 05/16] address more review comments Signed-off-by: david_radley@uk.ibm.com --- .../posts/2026-02-01-community-update.md | 23 +++++++++++-------- 1 file changed, 13 insertions(+), 10 deletions(-) diff --git a/docs/content/posts/2026-02-01-community-update.md b/docs/content/posts/2026-02-01-community-update.md index 7e127f2f1f..b4925da826 100644 --- a/docs/content/posts/2026-02-01-community-update.md +++ b/docs/content/posts/2026-02-01-community-update.md @@ -71,29 +71,27 @@ AI summary. ### Active FLIPs -**FLIP-560: Application Capability Enhancement** (Yi Zhang) -- Multi-job execution in Application Mode -- Re-running main method after JobManager restarts -- Expose main method exceptions via REST/UI +**[FLIP-560](https://cwiki.apache.org/confluence/display/FLINK/FLIP-560%3A+Application+Capability+Enhancement) Application Capability Enhancement** (Yi Zhang) +- Job manager Config and exceptions exposed in REST/UI - Active discussion on error handling and diagnostics -**FLIP-559: Add ARTIFACT Keyword** (Mika Naylor) +**[FLIP-559](https://cwiki.apache.org/confluence/display/FLINK/FLIP-559%3A+Add+ARTIFACT+keyword+option+in+CREATE+FUNCTION%27s+USING+clause): Add ARTIFACT Keyword** (Mika Naylor) - Generic ARTIFACT keyword for CREATE FUNCTION - Supports future artifact types beyond JARs - Moving toward vote -**FLIP-487: Rescale History in Web UI** (Yuepeng Pan) +**[FLIP-487](https://cwiki.apache.org/confluence/display/FLINK/FLIP-487%3A+Show+history+of+rescales+in+Web+UI+for+AdaptiveScheduler): Rescale History in Web UI** (Yuepeng Pan) - Vote started January 7, 2026 - Improves rescaling observability -**FLIP-558: SinkUpsertMaterializer Improvements** (Dawid) +**[FLIP-558](https://cwiki.apache.org/confluence/display/FLINK/FLIP-558%3A+Improvements+to+SinkUpsertMaterializer+and+changelog+disorder): SinkUpsertMaterializer Improvements** (Dawid) - Vote started -**FLIP-339: Adaptive Partition Selection** (Yuepeng Pan) +**[FLIP-339](https://cwiki.apache.org/confluence/display/FLINK/FLIP-339%3A+Support+Adaptive+Partition+Selection+for+StreamPartitioner): Adaptive Partition Selection** (Yuepeng Pan) - Dynamic partitioning based on downstream load - Focuses on rebalance/rescale, debate on shuffle() -**FLIP-561: Restructure Flink documentation** (Martijn Visser) +**[FLIP-561](https://cwiki.apache.org/confluence/display/FLINK/FLIP-561%3A+Restructure+Flink+documentation): Restructure Flink documentation** (Martijn Visser) - Vote started January 15, 2026 ### Kubernetes Operator 1.14.0 Release @@ -105,4 +103,9 @@ AI summary. ## For more information Anything you think has been misrepresented, is wrong or missing, please let me know via Flink Slack. -If you would like to keep a closer eye on what’s happening in the community, subscribe to the Flink [@community mailing list](https://flink.apache.org/community.html#mailing-lists) to get fine-grained weekly updates, upcoming event announcements and more. \ No newline at end of file + +If you would like to keep a closer eye on what’s happening in the community, subscribe to one of the Flink [@community mailing list](https://flink.apache.org/community.html#mailing-lists) to get fine-grained weekly updates, upcoming event announcements and more. +Two popular mailing lists are: +* the [dev list](https://lists.apache.org/list.html?dev@flink.apache.org) for development related discussions +* the [user list](https://lists.apache.org/list.html?user@flink.apache.org) for user support and questions + From 89778d3e78789e08a11d2b1ea8f931d823ff162c Mon Sep 17 00:00:00 2001 From: "david_radley@uk.ibm.com" Date: Wed, 4 Feb 2026 16:02:47 +0000 Subject: [PATCH 06/16] Address Roberts feedback Signed-off-by: david_radley@uk.ibm.com --- .../posts/2026-02-01-community-update.md | 22 +++++++++++-------- 1 file changed, 13 insertions(+), 9 deletions(-) diff --git a/docs/content/posts/2026-02-01-community-update.md b/docs/content/posts/2026-02-01-community-update.md index b4925da826..a1abb0c051 100644 --- a/docs/content/posts/2026-02-01-community-update.md +++ b/docs/content/posts/2026-02-01-community-update.md @@ -45,20 +45,24 @@ Interestingly, in the last month or so the backlog has been creeping up again an [Extensive view on the streaming trends for 2026](https://www.kai-waehner.de/blog/2025/12/10/top-trends-for-data-streaming-with-apache-kafka-and-flink-in-2026/) * A view on the Flink world from Ververica [https://www.ververica.com/blog/a-world-without-kafka](https://www.ververica.com/blog/a-world-without-kafka) -* A blog on Flink being the future of stream processing -[https://www.oreateai.com/blog/understanding-apache-flink-the-future-of-stream-processing/284a4ec5131c57f2dbf5b0b2660f896f](https://www.oreateai.com/blog/understanding-apache-flink-the-future-of-stream-processing/284a4ec5131c57f2dbf5b0b2660f896f) ## Summary of Apache Flink Dev List (covering January 2026) -AI summary. - ### Key Themes -1. Enhanced Application Mode for batch processing -2. Improved observability and error reporting -3. SQL syntax evolution for diverse artifacts -4. Performance optimization through adaptive partitioning -5. Kubernetes Operator maturity +1. SQL improvements + - Altering query should be possible if MATERIALIZED TABLE schema contains non persisted columns [https://lists.apache.org/thread/rbnv8k9qbvlrv087x196o3st3rrvswcw](https://lists.apache.org/thread/rbnv8k9qbvlrv087x196o3st3rrvswcw) + - SQL syntax evolution for diverse artifacts https://lists.apache.org/thread/ty6pscdlr2sllx4no4mvj6sb2kdvc9rz + - Support INET_ATON and INET_NTOA functions for IP address conversion [https://lists.apache.org/thread/d39vxv3fjwbvzdrlrxo9g1wlwk6gc9fz](https://lists.apache.org/thread/d39vxv3fjwbvzdrlrxo9g1wlwk6gc9fz) + - Exception creating table of nested objects [https://lists.apache.org/list?dev@flink.apache.org:lte=1M:FLINK-38913](https://lists.apache.org/list?dev@flink.apache.org:lte=1M:FLINK-38913) +2. More Scala to java rule conversion in the table planner including: + - [https://lists.apache.org/thread/x8fyng2pz2t16jxthqgb47h17cftjjsn](https://lists.apache.org/thread/x8fyng2pz2t16jxthqgb47h17cftjjsn) +3. Kubernetes Operator maturity + - FlinkBlueGreenDeployment + - [FLINK-38867](https://issues.apache.org/jira/browse/FLINK-38867) + - [FLINK-38915](https://issues.apache.org/jira/browse/FLINK-38915) + - [FLINK-38787](https://issues.apache.org/jira/browse/FLINK-38787) + - [New release planning](https://lists.apache.org/thread/scrs2664s0hznjf15tz2dd5g5yh923tr) ### Community Announcements From ae514c96e2a8a0a7833bb217d1a40fb813471136 Mon Sep 17 00:00:00 2001 From: "david_radley@uk.ibm.com" Date: Wed, 4 Feb 2026 16:55:02 +0000 Subject: [PATCH 07/16] respoonded to more review feedback Signed-off-by: david_radley@uk.ibm.com --- .../posts/2026-02-01-community-update.md | 41 +++++++++++++------ 1 file changed, 29 insertions(+), 12 deletions(-) diff --git a/docs/content/posts/2026-02-01-community-update.md b/docs/content/posts/2026-02-01-community-update.md index a1abb0c051..0bd7511609 100644 --- a/docs/content/posts/2026-02-01-community-update.md +++ b/docs/content/posts/2026-02-01-community-update.md @@ -25,19 +25,36 @@ aliases: Previous Blog : [https:/flink.apache.org/2020/09/04/flink-community-update-august20/](https:/flink.apache.org/2020/09/04/flink-community-update-august20/) -After a gap, the Community update is back for February 2026! As usual this update will summarise what has happened in the previous month (January). -- In the last few years the Flink PR backlog got to around 1200. We introduced the stale bot last year, and it came down to around 200. +After a gap, the Community update is back for February 2026! The intention going forward is that we will look to produce a monthly blog, that will +highlight what has occurred in the community over the previous month. This will include new PMC and committers, any interesting blogs, new releases, active Flips and +a view of the themes in the dev list from the previous month. +

+Since 2020, the Flink community has been very busy, to give a flavour of what has changed; Flink has + +* added many new connectors, moved out to their own repositories. +* benefited from newer Calcite levels +* introduced Change Data Capture +* introduced Kubenetes Operator support +* added support for AI capabilities +* new DataStream API V2 +* new Flink SQL gateway +* released Flink v2, with disaggregated state, support of more up to date JAVA levels and removing deprecated APIs. +

+In the last few years the Flink PR backlog got to around 1200. We introduced the stale bot last year, and it came down to around 200. Interestingly, in the last month or so the backlog has been creeping up again and is over 250. -- The previous month has seen the connector parent v2 being released, the long awaited connector parent brought up to date and flink v2 ready. -- The AWS connectors have been enhanced and are about be to be released for Flink v1 and v2. -- Flink dev connector Slack brought up an interesting discussion: the Python connectors are in the Flink core repository, but the rest of the connector code is in their own connector specific repository. -- Flink HTTP connector, addressed all outstanding raised PRs. Preparing for releasing it. -- Flink Kafka connector had quite a busy month with around 10 commits going in. The most interesting were: - - [FLINK-38947] Handle errors in onCompletion callback only once ([#214](https://github.com/apache/flink-connector-kafka/pull/214)) - - [FLINK-38876] Support per-cluster offset in Dynamic Kafka Source ([#209](https://github.com/apache/flink-connector-kafka/pull/209)) -- Flink Kubenetes operator - - 9 commits, improvements to the blue-green deployment stood out. - - Preparing to release Kubernetes Operator 1.14.0 +

+As usual this update will summarise what has happened in the previous month (January). + +* The previous month has seen the connector parent v2 being released, the long awaited connector parent brought up to date and flink v2 ready. +* The AWS connectors have been enhanced and are about be to be released for Flink v1 and v2. +* Flink dev connector Slack brought up an interesting discussion: the Python connectors are in the Flink core repository, but the rest of the connector code is in their own connector specific repository. +* Flink HTTP connector, addressed all outstanding raised PRs. Preparing for releasing it. +* Flink Kafka connector had quite a busy month with around 10 commits going in. The most interesting were: + * [FLINK-38947] Handle errors in onCompletion callback only once ([#214](https://github.com/apache/flink-connector-kafka/pull/214)) + * [FLINK-38876] Support per-cluster offset in Dynamic Kafka Source ([#209](https://github.com/apache/flink-connector-kafka/pull/209)) +* Flink Kubenetes operator + * commits, improvements to the blue-green deployment stood out. + * Preparing to release Kubernetes Operator 1.14.0 ## Flink related Blogs From 6e5f964b9280c8fe2d425df4e9667967bc9ffbcd Mon Sep 17 00:00:00 2001 From: "david_radley@uk.ibm.com" Date: Wed, 4 Feb 2026 17:01:49 +0000 Subject: [PATCH 08/16] Address more review feedback Signed-off-by: david_radley@uk.ibm.com --- docs/content/posts/2026-02-01-community-update.md | 12 +++++++----- 1 file changed, 7 insertions(+), 5 deletions(-) diff --git a/docs/content/posts/2026-02-01-community-update.md b/docs/content/posts/2026-02-01-community-update.md index 0bd7511609..70affa909d 100644 --- a/docs/content/posts/2026-02-01-community-update.md +++ b/docs/content/posts/2026-02-01-community-update.md @@ -23,7 +23,7 @@ aliases: Previous Blog : -[https:/flink.apache.org/2020/09/04/flink-community-update-august20/](https:/flink.apache.org/2020/09/04/flink-community-update-august20/) +[https://flink.apache.org/2020/09/04/flink-community-update-august20/](https://flink.apache.org/2020/09/04/flink-community-update-august20/) After a gap, the Community update is back for February 2026! The intention going forward is that we will look to produce a monthly blog, that will highlight what has occurred in the community over the previous month. This will include new PMC and committers, any interesting blogs, new releases, active Flips and @@ -34,7 +34,7 @@ Since 2020, the Flink community has been very busy, to give a flavour of what ha * added many new connectors, moved out to their own repositories. * benefited from newer Calcite levels * introduced Change Data Capture -* introduced Kubenetes Operator support +* introduced kubernetes Operator support * added support for AI capabilities * new DataStream API V2 * new Flink SQL gateway @@ -46,13 +46,13 @@ Interestingly, in the last month or so the backlog has been creeping up again an As usual this update will summarise what has happened in the previous month (January). * The previous month has seen the connector parent v2 being released, the long awaited connector parent brought up to date and flink v2 ready. -* The AWS connectors have been enhanced and are about be to be released for Flink v1 and v2. -* Flink dev connector Slack brought up an interesting discussion: the Python connectors are in the Flink core repository, but the rest of the connector code is in their own connector specific repository. +* The AWS connectors have been enhanced and are about to be released for Flink v1 and v2. +* An interesting discussion in the Flink dev connector Slack channel highlighted that Python connectors are in the Flink core repository, but the rest of the connector code is in their own connector specific repository. * Flink HTTP connector, addressed all outstanding raised PRs. Preparing for releasing it. * Flink Kafka connector had quite a busy month with around 10 commits going in. The most interesting were: * [FLINK-38947] Handle errors in onCompletion callback only once ([#214](https://github.com/apache/flink-connector-kafka/pull/214)) * [FLINK-38876] Support per-cluster offset in Dynamic Kafka Source ([#209](https://github.com/apache/flink-connector-kafka/pull/209)) -* Flink Kubenetes operator +* Flink kubernetes operator * commits, improvements to the blue-green deployment stood out. * Preparing to release Kubernetes Operator 1.14.0 @@ -65,6 +65,8 @@ As usual this update will summarise what has happened in the previous month (Jan ## Summary of Apache Flink Dev List (covering January 2026) +The following section was generated with AI assistance and reviewed by the community. + ### Key Themes 1. SQL improvements From 4eaf7be565e48dbfa3993a53a5fc554c75597abc Mon Sep 17 00:00:00 2001 From: "david_radley@uk.ibm.com" Date: Wed, 4 Feb 2026 17:18:53 +0000 Subject: [PATCH 09/16] Address more review feedback Signed-off-by: david_radley@uk.ibm.com --- docs/content/posts/2026-02-01-community-update.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/content/posts/2026-02-01-community-update.md b/docs/content/posts/2026-02-01-community-update.md index 70affa909d..558f6f087d 100644 --- a/docs/content/posts/2026-02-01-community-update.md +++ b/docs/content/posts/2026-02-01-community-update.md @@ -29,7 +29,7 @@ After a gap, the Community update is back for February 2026! The intention going highlight what has occurred in the community over the previous month. This will include new PMC and committers, any interesting blogs, new releases, active Flips and a view of the themes in the dev list from the previous month.

-Since 2020, the Flink community has been very busy, to give a flavour of what has changed; Flink has +Since 2020, the Flink community has been very busy, to give a flavour of what has changed, Flink has * added many new connectors, moved out to their own repositories. * benefited from newer Calcite levels From 8acfa2f9b2628993653ef9dc7b13f35504a9331d Mon Sep 17 00:00:00 2001 From: "david_radley@uk.ibm.com" Date: Thu, 5 Feb 2026 15:28:32 +0000 Subject: [PATCH 10/16] Add more hyperlink Signed-off-by: david_radley@uk.ibm.com --- .../posts/2026-02-01-community-update.md | 50 +++++++++++-------- 1 file changed, 29 insertions(+), 21 deletions(-) diff --git a/docs/content/posts/2026-02-01-community-update.md b/docs/content/posts/2026-02-01-community-update.md index 558f6f087d..3f35e7297b 100644 --- a/docs/content/posts/2026-02-01-community-update.md +++ b/docs/content/posts/2026-02-01-community-update.md @@ -9,7 +9,7 @@ aliases: - /news/2026/02/02/community-update.html --- -# This past month in Flink +# Flink Community update for February 2026 * [This past month in Flink](#this-past-month-in-flink) @@ -25,24 +25,30 @@ aliases: Previous Blog : [https://flink.apache.org/2020/09/04/flink-community-update-august20/](https://flink.apache.org/2020/09/04/flink-community-update-august20/) -After a gap, the Community update is back for February 2026! The intention going forward is that we will look to produce a monthly blog, that will -highlight what has occurred in the community over the previous month. This will include new PMC and committers, any interesting blogs, new releases, active Flips and +After a [gap](https://flink.apache.org/2020/09/04/flink-community-update-august20/), the Community update is back for February 2026! The intention going forward is that we will look to produce a monthly blog, that will +highlight what has occurred in the community over the previous month. This will include new PMC and committers, any interesting blogs, new releases, active FLIPs and a view of the themes in the dev list from the previous month.

-Since 2020, the Flink community has been very busy, to give a flavour of what has changed, Flink has - -* added many new connectors, moved out to their own repositories. -* benefited from newer Calcite levels -* introduced Change Data Capture -* introduced kubernetes Operator support -* added support for AI capabilities -* new DataStream API V2 -* new Flink SQL gateway -* released Flink v2, with disaggregated state, support of more up to date JAVA levels and removing deprecated APIs. -

+ +## Bringing us up to date - a brief summary of what has happened in Flink since 2020 up to end of 2025. +Since 2020, the Flink community has been very busy, to give a flavour of what has improved, Flink has + +* added many new connectors, moved out to their own repositories - increasing the reach of Flink flows. +* added canonical state, a unified the binary format of savepoints across different state backends, then further performant refinement in the native form. +* benefited from newer Calcite levels - the latest one Flink has adopted brings in support for nullables in nested objects. +* introduced Change Data Capture - with a new easy way of defining simple flows. +* introduced kubernetes Operator support - making Flink enterprise ready. +* added support for AI capabilities - enriching flows so they benefit from AI. +* new DataStream API V2 - new simpler datastream API. +* new Flink SQL gateway - a more flexible way of submitting SQL. +* released Flink v2, with disaggregated state, materialized tables , PTFs, support of more up to date JAVA levels and removing deprecated APIs. +

+ In the last few years the Flink PR backlog got to around 1200. We introduced the stale bot last year, and it came down to around 200. Interestingly, in the last month or so the backlog has been creeping up again and is over 250.

+ +## January 2026 overview As usual this update will summarise what has happened in the previous month (January). * The previous month has seen the connector parent v2 being released, the long awaited connector parent brought up to date and flink v2 ready. @@ -70,12 +76,12 @@ The following section was generated with AI assistance and reviewed by the commu ### Key Themes 1. SQL improvements - - Altering query should be possible if MATERIALIZED TABLE schema contains non persisted columns [https://lists.apache.org/thread/rbnv8k9qbvlrv087x196o3st3rrvswcw](https://lists.apache.org/thread/rbnv8k9qbvlrv087x196o3st3rrvswcw) - - SQL syntax evolution for diverse artifacts https://lists.apache.org/thread/ty6pscdlr2sllx4no4mvj6sb2kdvc9rz - - Support INET_ATON and INET_NTOA functions for IP address conversion [https://lists.apache.org/thread/d39vxv3fjwbvzdrlrxo9g1wlwk6gc9fz](https://lists.apache.org/thread/d39vxv3fjwbvzdrlrxo9g1wlwk6gc9fz) - - Exception creating table of nested objects [https://lists.apache.org/list?dev@flink.apache.org:lte=1M:FLINK-38913](https://lists.apache.org/list?dev@flink.apache.org:lte=1M:FLINK-38913) -2. More Scala to java rule conversion in the table planner including: - - [https://lists.apache.org/thread/x8fyng2pz2t16jxthqgb47h17cftjjsn](https://lists.apache.org/thread/x8fyng2pz2t16jxthqgb47h17cftjjsn) + - [Altering query should be possible if MATERIALIZED TABLE schema contains non persisted columns](https://lists.apache.org/thread/rbnv8k9qbvlrv087x196o3st3rrvswcw) + - [SQL syntax evolution for diverse artifacts](https://lists.apache.org/thread/ty6pscdlr2sllx4no4mvj6sb2kdvc9rz) + - [Support INET_ATON and INET_NTOA functions for IP address conversion](https://lists.apache.org/thread/d39vxv3fjwbvzdrlrxo9g1wlwk6gc9fz) + - [Exception creating table of nested objects](https://lists.apache.org/list?dev@flink.apache.org:lte=1M:FLINK-38913) +2. More Scala to JAVA rule conversion in the table planner including: + - [Migrate BatchPhysicalSortMergeJoinRule](https://lists.apache.org/thread/x8fyng2pz2t16jxthqgb47h17cftjjsn) 3. Kubernetes Operator maturity - FlinkBlueGreenDeployment - [FLINK-38867](https://issues.apache.org/jira/browse/FLINK-38867) @@ -125,7 +131,9 @@ The following section was generated with AI assistance and reviewed by the commu ## For more information -Anything you think has been misrepresented, is wrong or missing, please let me know via Flink Slack. +Follow this blog to keep up to date with what is happening in the Flink community. + +If you have ideas for what you would like to see in these blogs or there is anything you think has been misrepresented, is wrong or missing, please let us know via the dev list (detail below) or [slack](https://flink.apache.org/how-to-contribute/getting-help/#slack). If you would like to keep a closer eye on what’s happening in the community, subscribe to one of the Flink [@community mailing list](https://flink.apache.org/community.html#mailing-lists) to get fine-grained weekly updates, upcoming event announcements and more. Two popular mailing lists are: From 8225245b706ba77dc7de933ceada36fe9d5b9d0a Mon Sep 17 00:00:00 2001 From: "david_radley@uk.ibm.com" Date: Thu, 5 Feb 2026 15:38:03 +0000 Subject: [PATCH 11/16] more addressing review comments Signed-off-by: david_radley@uk.ibm.com --- docs/content/posts/2026-02-01-community-update.md | 14 ++++++++------ 1 file changed, 8 insertions(+), 6 deletions(-) diff --git a/docs/content/posts/2026-02-01-community-update.md b/docs/content/posts/2026-02-01-community-update.md index 3f35e7297b..ec35d2268d 100644 --- a/docs/content/posts/2026-02-01-community-update.md +++ b/docs/content/posts/2026-02-01-community-update.md @@ -12,7 +12,9 @@ aliases: # Flink Community update for February 2026 -* [This past month in Flink](#this-past-month-in-flink) +* [Flink Community update for February 2026](#flink-community-update-for-february-2026) + * [Bringing us up to date - a brief summary of what has happened in Flink since 2020 up to end of 2025.](#bringing-us-up-to-date---a-brief-summary-of-what-has-happened-in-flink-since-2020-up-to-end-of-2025) + * [January 2026 overview](#january-2026-overview) * [Flink related Blogs](#flink-related-blogs) * [Summary of Apache Flink Dev List (covering January 2026)](#summary-of-apache-flink-dev-list-covering-january-2026) * [Key Themes](#key-themes) @@ -31,17 +33,17 @@ a view of the themes in the dev list from the previous month.

## Bringing us up to date - a brief summary of what has happened in Flink since 2020 up to end of 2025. -Since 2020, the Flink community has been very busy, to give a flavour of what has improved, Flink has +Since 2020, the Flink community has been very busy. Here is a flavour of what has improved. * added many new connectors, moved out to their own repositories - increasing the reach of Flink flows. -* added canonical state, a unified the binary format of savepoints across different state backends, then further performant refinement in the native form. -* benefited from newer Calcite levels - the latest one Flink has adopted brings in support for nullables in nested objects. -* introduced Change Data Capture - with a new easy way of defining simple flows. +* added canonical state, a unified the binary format of savepoints across different state backends, then a further more performant refinement in the native form. +* benefited from newer Calcite levels - the [latest one](https://calcite.apache.org/news/2023/11/10/release-1.36.0/) Flink has adopted brings in support for nullables in nested objects. +* introduced Change Data Capture - with a new easy way to define simple flows. * introduced kubernetes Operator support - making Flink enterprise ready. * added support for AI capabilities - enriching flows so they benefit from AI. * new DataStream API V2 - new simpler datastream API. * new Flink SQL gateway - a more flexible way of submitting SQL. -* released Flink v2, with disaggregated state, materialized tables , PTFs, support of more up to date JAVA levels and removing deprecated APIs. +* released Flink v2, with disaggregated state, materialized tables, PTFs, support for more up to date JAVA levels and removing deprecated APIs.

In the last few years the Flink PR backlog got to around 1200. We introduced the stale bot last year, and it came down to around 200. From 323ff808cab35107709315cee32a74ff38c5bc3b Mon Sep 17 00:00:00 2001 From: "david_radley@uk.ibm.com" Date: Thu, 5 Feb 2026 15:45:04 +0000 Subject: [PATCH 12/16] changed the community announcement in response to the review Signed-off-by: david_radley@uk.ibm.com --- docs/content/posts/2026-02-01-community-update.md | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/docs/content/posts/2026-02-01-community-update.md b/docs/content/posts/2026-02-01-community-update.md index ec35d2268d..0cc5c551e7 100644 --- a/docs/content/posts/2026-02-01-community-update.md +++ b/docs/content/posts/2026-02-01-community-update.md @@ -93,12 +93,12 @@ The following section was generated with AI assistance and reviewed by the commu ### Community Announcements -**New Committers:** -- **David Radley** -- **Yuepeng Pan (RocMarshal)** +#### New Committers +- David Radley +- Yuepeng Pan (RocMarshal) -**New PMC Member:** -- **Hang Ruan** +#### New PMC Member +- Hang Ruan ### Active FLIPs From 566ca7bd2f715c5573efae9a6faf936ef0ac83f9 Mon Sep 17 00:00:00 2001 From: "david_radley@uk.ibm.com" Date: Fri, 6 Feb 2026 09:43:04 +0000 Subject: [PATCH 13/16] add name to the ververica hyperlink Signed-off-by: david_radley@uk.ibm.com --- docs/content/posts/2026-02-01-community-update.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/docs/content/posts/2026-02-01-community-update.md b/docs/content/posts/2026-02-01-community-update.md index 0cc5c551e7..8d459b07d5 100644 --- a/docs/content/posts/2026-02-01-community-update.md +++ b/docs/content/posts/2026-02-01-community-update.md @@ -68,8 +68,8 @@ As usual this update will summarise what has happened in the previous month (Jan * Kai Waehner [Extensive view on the streaming trends for 2026](https://www.kai-waehner.de/blog/2025/12/10/top-trends-for-data-streaming-with-apache-kafka-and-flink-in-2026/) -* A view on the Flink world from Ververica -[https://www.ververica.com/blog/a-world-without-kafka](https://www.ververica.com/blog/a-world-without-kafka) +* A view on the Flink from Ververica +[A world without Kafka](https://www.ververica.com/blog/a-world-without-kafka) ## Summary of Apache Flink Dev List (covering January 2026) From 95105ca7cd1de7a51ca9a5061aba2ba46c040c09 Mon Sep 17 00:00:00 2001 From: "david_radley@uk.ibm.com" Date: Fri, 6 Feb 2026 10:43:21 +0000 Subject: [PATCH 14/16] remove the Signed-off-by: david_radley@uk.ibm.com --- docs/content/posts/2026-02-01-community-update.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/content/posts/2026-02-01-community-update.md b/docs/content/posts/2026-02-01-community-update.md index 8d459b07d5..493ebd1b65 100644 --- a/docs/content/posts/2026-02-01-community-update.md +++ b/docs/content/posts/2026-02-01-community-update.md @@ -68,7 +68,7 @@ As usual this update will summarise what has happened in the previous month (Jan * Kai Waehner [Extensive view on the streaming trends for 2026](https://www.kai-waehner.de/blog/2025/12/10/top-trends-for-data-streaming-with-apache-kafka-and-flink-in-2026/) -* A view on the Flink from Ververica +* A view on Flink from Ververica [A world without Kafka](https://www.ververica.com/blog/a-world-without-kafka) ## Summary of Apache Flink Dev List (covering January 2026) From 3ca66968cfb8bc478b8ad32c276b8df62250a5a4 Mon Sep 17 00:00:00 2001 From: "david_radley@uk.ibm.com" Date: Mon, 9 Feb 2026 17:21:20 +0000 Subject: [PATCH 15/16] small formatting changes Signed-off-by: david_radley@uk.ibm.com --- .../posts/2026-02-01-community-update.md | 73 +++++++++++-------- 1 file changed, 43 insertions(+), 30 deletions(-) diff --git a/docs/content/posts/2026-02-01-community-update.md b/docs/content/posts/2026-02-01-community-update.md index 493ebd1b65..0f54e81ddf 100644 --- a/docs/content/posts/2026-02-01-community-update.md +++ b/docs/content/posts/2026-02-01-community-update.md @@ -19,7 +19,11 @@ aliases: * [Summary of Apache Flink Dev List (covering January 2026)](#summary-of-apache-flink-dev-list-covering-january-2026) * [Key Themes](#key-themes) * [Community Announcements](#community-announcements) - * [Active FLIPs](#active-flips) + * [New Committers](#new-committers) + * [New PMC Member](#new-pmc-member) + * [FLIP Activity](#flip-activity) + * [Accepted - being implemented](#accepted---being-implemented) + * [Being discussed](#being-discussed) * [Kubernetes Operator 1.14.0 Release](#kubernetes-operator-1140-release) * [For more information](#for-more-information) @@ -35,15 +39,17 @@ a view of the themes in the dev list from the previous month. ## Bringing us up to date - a brief summary of what has happened in Flink since 2020 up to end of 2025. Since 2020, the Flink community has been very busy. Here is a flavour of what has improved. -* added many new connectors, moved out to their own repositories - increasing the reach of Flink flows. -* added canonical state, a unified the binary format of savepoints across different state backends, then a further more performant refinement in the native form. -* benefited from newer Calcite levels - the [latest one](https://calcite.apache.org/news/2023/11/10/release-1.36.0/) Flink has adopted brings in support for nullables in nested objects. -* introduced Change Data Capture - with a new easy way to define simple flows. -* introduced kubernetes Operator support - making Flink enterprise ready. -* added support for AI capabilities - enriching flows so they benefit from AI. -* new DataStream API V2 - new simpler datastream API. -* new Flink SQL gateway - a more flexible way of submitting SQL. -* released Flink v2, with disaggregated state, materialized tables, PTFs, support for more up to date JAVA levels and removing deprecated APIs. +* Flink Kubernetes (k8s) Operator + * Enterprise ready. + * Autoscaling - tuning jobs to meet the utilization target set by the user. + * k8s experience. +* Flink 2.0 + * Process Table Functions (PTFs) - bringing datastream flexibility to SQL. + * Disaggregated state. + * Deprecation of older APIs, leaving the strategic ones. +* Materialized tables + * Bringing a consistent developer experience to batch and streaming. +

In the last few years the Flink PR backlog got to around 1200. We introduced the stale bot last year, and it came down to around 200. @@ -54,7 +60,9 @@ Interestingly, in the last month or so the backlog has been creeping up again an As usual this update will summarise what has happened in the previous month (January). * The previous month has seen the connector parent v2 being released, the long awaited connector parent brought up to date and flink v2 ready. -* The AWS connectors have been enhanced and are about to be released for Flink v1 and v2. +* The AWS connectors have been enhanced and are about to be released for Flink v1 and v2. + * Version 5.1 [fixes](https://github.com/apache/flink-connector-aws/pull/193) a data loss issue for DynamoDB Streams and Kinesis Source which was caused when a job restarts from a inflight shard rotation / split during checkpoints. + * Version 6.0 introduces [support](https://github.com/apache/flink-connector-aws/pull/219) for the ShardFilter API for DynamoDB Streams source, improving efficiency and responsiveness when processing data from DynamoDB Streams. * An interesting discussion in the Flink dev connector Slack channel highlighted that Python connectors are in the Flink core repository, but the rest of the connector code is in their own connector specific repository. * Flink HTTP connector, addressed all outstanding raised PRs. Preparing for releasing it. * Flink Kafka connector had quite a busy month with around 10 commits going in. The most interesting were: @@ -62,7 +70,7 @@ As usual this update will summarise what has happened in the previous month (Jan * [FLINK-38876] Support per-cluster offset in Dynamic Kafka Source ([#209](https://github.com/apache/flink-connector-kafka/pull/209)) * Flink kubernetes operator * commits, improvements to the blue-green deployment stood out. - * Preparing to release Kubernetes Operator 1.14.0 + * Preparing to release Kubernetes Operator 1.14.0. ## Flink related Blogs @@ -73,8 +81,6 @@ As usual this update will summarise what has happened in the previous month (Jan ## Summary of Apache Flink Dev List (covering January 2026) -The following section was generated with AI assistance and reviewed by the community. - ### Key Themes 1. SQL improvements @@ -82,7 +88,7 @@ The following section was generated with AI assistance and reviewed by the commu - [SQL syntax evolution for diverse artifacts](https://lists.apache.org/thread/ty6pscdlr2sllx4no4mvj6sb2kdvc9rz) - [Support INET_ATON and INET_NTOA functions for IP address conversion](https://lists.apache.org/thread/d39vxv3fjwbvzdrlrxo9g1wlwk6gc9fz) - [Exception creating table of nested objects](https://lists.apache.org/list?dev@flink.apache.org:lte=1M:FLINK-38913) -2. More Scala to JAVA rule conversion in the table planner including: +2. Technical debt - more Scala to JAVA rule conversions in the table planner including: - [Migrate BatchPhysicalSortMergeJoinRule](https://lists.apache.org/thread/x8fyng2pz2t16jxthqgb47h17cftjjsn) 3. Kubernetes Operator maturity - FlinkBlueGreenDeployment @@ -100,30 +106,37 @@ The following section was generated with AI assistance and reviewed by the commu #### New PMC Member - Hang Ruan -### Active FLIPs - -**[FLIP-560](https://cwiki.apache.org/confluence/display/FLINK/FLIP-560%3A+Application+Capability+Enhancement) Application Capability Enhancement** (Yi Zhang) -- Job manager Config and exceptions exposed in REST/UI -- Active discussion on error handling and diagnostics +### FLIP Activity -**[FLIP-559](https://cwiki.apache.org/confluence/display/FLINK/FLIP-559%3A+Add+ARTIFACT+keyword+option+in+CREATE+FUNCTION%27s+USING+clause): Add ARTIFACT Keyword** (Mika Naylor) -- Generic ARTIFACT keyword for CREATE FUNCTION -- Supports future artifact types beyond JARs -- Moving toward vote +#### Accepted - being implemented +**[FLIP-339](https://cwiki.apache.org/confluence/display/FLINK/FLIP-339%3A+Support+Adaptive+Partition+Selection+for+StreamPartitioner): Adaptive Partition Selection** (Yuepeng Pan) +- Dynamic partitioning based on downstream load +- Focuses on rebalance/rescale, debate on shuffle() **[FLIP-487](https://cwiki.apache.org/confluence/display/FLINK/FLIP-487%3A+Show+history+of+rescales+in+Web+UI+for+AdaptiveScheduler): Rescale History in Web UI** (Yuepeng Pan) -- Vote started January 7, 2026 - Improves rescaling observability **[FLIP-558](https://cwiki.apache.org/confluence/display/FLINK/FLIP-558%3A+Improvements+to+SinkUpsertMaterializer+and+changelog+disorder): SinkUpsertMaterializer Improvements** (Dawid) -- Vote started +- Addresses the poor performance and high resource consumption caused by Flink's current implicit handling of data integrity issues, specifically when the upsert key of a stream differs from the PRIMARY KEY of the sink (the use case requiring the Sink Upsert Materializer, or SUM). -**[FLIP-339](https://cwiki.apache.org/confluence/display/FLINK/FLIP-339%3A+Support+Adaptive+Partition+Selection+for+StreamPartitioner): Adaptive Partition Selection** (Yuepeng Pan) -- Dynamic partitioning based on downstream load -- Focuses on rebalance/rescale, debate on shuffle() +**[FLIP-560](https://cwiki.apache.org/confluence/display/FLINK/FLIP-560%3A+Application+Capability+Enhancement) Application Capability Enhancement** (Yi Zhang) +- Job manager Config and exceptions exposed in REST/UI **[FLIP-561](https://cwiki.apache.org/confluence/display/FLINK/FLIP-561%3A+Restructure+Flink+documentation): Restructure Flink documentation** (Martijn Visser) -- Vote started January 15, 2026 +- A more intuitive structure of the documentation. + +#### Being discussed +**[FLIP-557](https://cwiki.apache.org/confluence/display/FLINK/FLIP-557%3A+Granular+Control+over+Data+Reprocessing+and+State+Retention+in+Materialized+Table+Evolution) Granular Control over Data Reprocessing and State Retention in Materialized Table Evolution** (Ramin Gharib) +- Introduces control of the data processing window for the evolution of materialized tables. +- Allows the scope of state retention to be specified for materialized tables. + +**[FLIP-559](https://cwiki.apache.org/confluence/display/FLINK/FLIP-559%3A+Add+ARTIFACT+keyword+option+in+CREATE+FUNCTION%27s+USING+clause): Add ARTIFACT Keyword** (Mika Naylor) +- Generic ARTIFACT keyword for CREATE FUNCTION +- Supports future artifact types beyond JARs +- Moving toward vote + +**[FLIP-563](https://cwiki.apache.org/confluence/display/FLINK/FLIP-563+Support+provided+lib+archives+for+YARN+application+mode) Support provided lib archives for YARN application mode** (Archit Goyal) +- Discussion thread started but no responses yet. ### Kubernetes Operator 1.14.0 Release From c85b587ad0fdedf59fc6f4e4ed3cefe812e69ddd Mon Sep 17 00:00:00 2001 From: "david_radley@uk.ibm.com" Date: Fri, 13 Feb 2026 10:40:45 +0000 Subject: [PATCH 16/16] Fixing up more nits from review Signed-off-by: david_radley@uk.ibm.com --- .../posts/2026-02-01-community-update.md | 66 +++++++------------ 1 file changed, 23 insertions(+), 43 deletions(-) diff --git a/docs/content/posts/2026-02-01-community-update.md b/docs/content/posts/2026-02-01-community-update.md index 0f54e81ddf..dd860321a1 100644 --- a/docs/content/posts/2026-02-01-community-update.md +++ b/docs/content/posts/2026-02-01-community-update.md @@ -2,18 +2,14 @@ authors: - davidrad: null name: David Radley -date: "2026-02-02T08:00:00Z" +date: "2026-02-01T08:00:00Z" excerpt: Flink Community update for February 2026 title: Flink Community Update - February'26 aliases: -- /news/2026/02/02/community-update.html +- /news/2026/02/01/community-update.html --- -# Flink Community update for February 2026 - -* [Flink Community update for February 2026](#flink-community-update-for-february-2026) - * [Bringing us up to date - a brief summary of what has happened in Flink since 2020 up to end of 2025.](#bringing-us-up-to-date---a-brief-summary-of-what-has-happened-in-flink-since-2020-up-to-end-of-2025) * [January 2026 overview](#january-2026-overview) * [Flink related Blogs](#flink-related-blogs) * [Summary of Apache Flink Dev List (covering January 2026)](#summary-of-apache-flink-dev-list-covering-january-2026) @@ -28,49 +24,33 @@ aliases: * [For more information](#for-more-information) -Previous Blog : +Previous Blog: [https://flink.apache.org/2020/09/04/flink-community-update-august20/](https://flink.apache.org/2020/09/04/flink-community-update-august20/) -After a [gap](https://flink.apache.org/2020/09/04/flink-community-update-august20/), the Community update is back for February 2026! The intention going forward is that we will look to produce a monthly blog, that will +After a [gap](https://flink.apache.org/2020/09/04/flink-community-update-august20/), the Community update is back for February 2026! The intention going forward is that we will look to produce a monthly blog that will highlight what has occurred in the community over the previous month. This will include new PMC and committers, any interesting blogs, new releases, active FLIPs and a view of the themes in the dev list from the previous month. -

- -## Bringing us up to date - a brief summary of what has happened in Flink since 2020 up to end of 2025. -Since 2020, the Flink community has been very busy. Here is a flavour of what has improved. - -* Flink Kubernetes (k8s) Operator - * Enterprise ready. - * Autoscaling - tuning jobs to meet the utilization target set by the user. - * k8s experience. -* Flink 2.0 - * Process Table Functions (PTFs) - bringing datastream flexibility to SQL. - * Disaggregated state. - * Deprecation of older APIs, leaving the strategic ones. -* Materialized tables - * Bringing a consistent developer experience to batch and streaming. -

+The Flink community has made many improvements during the last five years since the last blog; this blog will not cover those achievements. It is focused on the previous month (January 2026). In the last few years the Flink PR backlog got to around 1200. We introduced the stale bot last year, and it came down to around 200. Interestingly, in the last month or so the backlog has been creeping up again and is over 250. -

## January 2026 overview -As usual this update will summarise what has happened in the previous month (January). +This will summarise what has happened in the previous month (January). -* The previous month has seen the connector parent v2 being released, the long awaited connector parent brought up to date and flink v2 ready. -* The AWS connectors have been enhanced and are about to be released for Flink v1 and v2. - * Version 5.1 [fixes](https://github.com/apache/flink-connector-aws/pull/193) a data loss issue for DynamoDB Streams and Kinesis Source which was caused when a job restarts from a inflight shard rotation / split during checkpoints. +* The previous month has seen the [connector parent](https://github.com/apache/flink-connector-shared-utils/tree/parent_pom) v2 being released, the long-awaited connector parent brought up to date and flink v2 ready. +* The [AWS connectors](https://github.com/apache/flink-connector-aws) have been enhanced and are about to be released for Flink v1 and v2. + * Version 5.1 [fixes](https://github.com/apache/flink-connector-aws/pull/193) a data loss issue for DynamoDB Streams and Kinesis Source which was caused when a job restarts from an inflight shard rotation / split during checkpoints. * Version 6.0 introduces [support](https://github.com/apache/flink-connector-aws/pull/219) for the ShardFilter API for DynamoDB Streams source, improving efficiency and responsiveness when processing data from DynamoDB Streams. -* An interesting discussion in the Flink dev connector Slack channel highlighted that Python connectors are in the Flink core repository, but the rest of the connector code is in their own connector specific repository. -* Flink HTTP connector, addressed all outstanding raised PRs. Preparing for releasing it. +* An interesting discussion in the Flink dev connector Slack channel highlighted that Python connectors are in the Flink core repository, but the rest of the connector code is in its own connector-specific repository. +* Flink HTTP connector addressed all outstanding raised PRs. We are preparing to release it. * Flink Kafka connector had quite a busy month with around 10 commits going in. The most interesting were: - * [FLINK-38947] Handle errors in onCompletion callback only once ([#214](https://github.com/apache/flink-connector-kafka/pull/214)) - * [FLINK-38876] Support per-cluster offset in Dynamic Kafka Source ([#209](https://github.com/apache/flink-connector-kafka/pull/209)) -* Flink kubernetes operator - * commits, improvements to the blue-green deployment stood out. - * Preparing to release Kubernetes Operator 1.14.0. + * [FLINK-38947] Handle errors in onCompletion callback only once ([#214](https://github.com/apache/flink-connector-kafka/pull/214)) + * [FLINK-38876] Support per-cluster offset in Dynamic Kafka Source ([#209](https://github.com/apache/flink-connector-kafka/pull/209)) +* Flink Kubernetes operator + * Improvements to the blue-green deployment stood out. + * Preparing to release Kubernetes Operator 1.14.0. ## Flink related Blogs @@ -88,7 +68,7 @@ As usual this update will summarise what has happened in the previous month (Jan - [SQL syntax evolution for diverse artifacts](https://lists.apache.org/thread/ty6pscdlr2sllx4no4mvj6sb2kdvc9rz) - [Support INET_ATON and INET_NTOA functions for IP address conversion](https://lists.apache.org/thread/d39vxv3fjwbvzdrlrxo9g1wlwk6gc9fz) - [Exception creating table of nested objects](https://lists.apache.org/list?dev@flink.apache.org:lte=1M:FLINK-38913) -2. Technical debt - more Scala to JAVA rule conversions in the table planner including: +2. Technical debt - more Scala to Java rule conversions in the table planner including: - [Migrate BatchPhysicalSortMergeJoinRule](https://lists.apache.org/thread/x8fyng2pz2t16jxthqgb47h17cftjjsn) 3. Kubernetes Operator maturity - FlinkBlueGreenDeployment @@ -117,16 +97,16 @@ As usual this update will summarise what has happened in the previous month (Jan - Improves rescaling observability **[FLIP-558](https://cwiki.apache.org/confluence/display/FLINK/FLIP-558%3A+Improvements+to+SinkUpsertMaterializer+and+changelog+disorder): SinkUpsertMaterializer Improvements** (Dawid) -- Addresses the poor performance and high resource consumption caused by Flink's current implicit handling of data integrity issues, specifically when the upsert key of a stream differs from the PRIMARY KEY of the sink (the use case requiring the Sink Upsert Materializer, or SUM). +- Addresses the poor performance and high resource consumption caused by Flink's current implicit handling of data integrity issues, specifically when the upsert key of a stream differs from the PRIMARY KEY of the sink; the use case requiring the Sink Upsert Materializer (SUM). -**[FLIP-560](https://cwiki.apache.org/confluence/display/FLINK/FLIP-560%3A+Application+Capability+Enhancement) Application Capability Enhancement** (Yi Zhang) -- Job manager Config and exceptions exposed in REST/UI +**[FLIP-560](https://cwiki.apache.org/confluence/display/FLINK/FLIP-560%3A+Application+Capability+Enhancement): Application Capability Enhancement** (Yi Zhang) +- Job Manager Configuration and exceptions exposed in REST/UI **[FLIP-561](https://cwiki.apache.org/confluence/display/FLINK/FLIP-561%3A+Restructure+Flink+documentation): Restructure Flink documentation** (Martijn Visser) - A more intuitive structure of the documentation. #### Being discussed -**[FLIP-557](https://cwiki.apache.org/confluence/display/FLINK/FLIP-557%3A+Granular+Control+over+Data+Reprocessing+and+State+Retention+in+Materialized+Table+Evolution) Granular Control over Data Reprocessing and State Retention in Materialized Table Evolution** (Ramin Gharib) +**[FLIP-557](https://cwiki.apache.org/confluence/display/FLINK/FLIP-557%3A+Granular+Control+over+Data+Reprocessing+and+State+Retention+in+Materialized+Table+Evolution): Granular Control over Data Reprocessing and State Retention in Materialized Table Evolution** (Ramin Gharib) - Introduces control of the data processing window for the evolution of materialized tables. - Allows the scope of state retention to be specified for materialized tables. @@ -135,7 +115,7 @@ As usual this update will summarise what has happened in the previous month (Jan - Supports future artifact types beyond JARs - Moving toward vote -**[FLIP-563](https://cwiki.apache.org/confluence/display/FLINK/FLIP-563+Support+provided+lib+archives+for+YARN+application+mode) Support provided lib archives for YARN application mode** (Archit Goyal) +**[FLIP-563](https://cwiki.apache.org/confluence/display/FLINK/FLIP-563+Support+provided+lib+archives+for+YARN+application+mode): Support provided lib archives for YARN application mode** (Archit Goyal) - Discussion thread started but no responses yet. ### Kubernetes Operator 1.14.0 Release @@ -148,7 +128,7 @@ As usual this update will summarise what has happened in the previous month (Jan Follow this blog to keep up to date with what is happening in the Flink community. -If you have ideas for what you would like to see in these blogs or there is anything you think has been misrepresented, is wrong or missing, please let us know via the dev list (detail below) or [slack](https://flink.apache.org/how-to-contribute/getting-help/#slack). +If you have ideas for what you would like to see in these blogs or there is anything you think has been misrepresented, is wrong or missing, please let us know via the dev list (detail below) or [Slack](https://flink.apache.org/how-to-contribute/getting-help/#slack). If you would like to keep a closer eye on what’s happening in the community, subscribe to one of the Flink [@community mailing list](https://flink.apache.org/community.html#mailing-lists) to get fine-grained weekly updates, upcoming event announcements and more. Two popular mailing lists are: