Skip to content

Commit a99a3a5

Browse files
Increase SAAS WorkerScheduler WorkerPartition AcknowledgementSet timeout to 2 hours (opensearch-project#6298)
*What?** This commit incerases SAAS worker partition AcknowledgementSet timeout from 20 seconds to 2 hours. **Why?** 20 seconds is not enough for finish processing each worker partition. Increase it to infinite high to ensure each worker partition has enough time for processing. Signed-off-by: Wenjie Yao <wjyao@amazon.com> Co-authored-by: Wenjie Yao <wjyao@amazon.com>
1 parent 200b97b commit a99a3a5

File tree

1 file changed

+1
-1
lines changed
  • data-prepper-plugins/saas-source-plugins/source-crawler/src/main/java/org/opensearch/dataprepper/plugins/source/source_crawler/coordination/scheduler

1 file changed

+1
-1
lines changed

data-prepper-plugins/saas-source-plugins/source-crawler/src/main/java/org/opensearch/dataprepper/plugins/source/source_crawler/coordination/scheduler/WorkerScheduler.java

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -32,7 +32,7 @@ public class WorkerScheduler implements Runnable {
3232
public static final String WORKER_PARTITIONS_FAILED = "workerPartitionsFailed";
3333
public static final String WORKER_PARTITIONS_COMPLETED = "workerPartitionsCompleted";
3434

35-
private static final Duration ACKNOWLEDGEMENT_SET_TIMEOUT = Duration.ofSeconds(20);
35+
private static final Duration ACKNOWLEDGEMENT_SET_TIMEOUT = Duration.ofHours(2);
3636
private static final Logger log = LoggerFactory.getLogger(WorkerScheduler.class);
3737
private static final int RETRY_BACKOFF_ON_EXCEPTION_MILLIS = 5_000;
3838
private static final Duration DEFAULT_SLEEP_DURATION_MILLIS = Duration.ofMillis(10000);

0 commit comments

Comments
 (0)