Skip to content

Commit

Permalink
[ML-DataFrame] increase the scheduler interval to 10s (#42845)
Browse files Browse the repository at this point in the history
increases the scheduler interval to fire less frequently, namely changing it from 1s to 10s. The scheduler interval is used for retrying after an error condition.
  • Loading branch information
Hendrik Muhs authored and mayya-sharipova committed Jun 7, 2019
1 parent 0831af1 commit baf90ba
Showing 1 changed file with 3 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -53,6 +53,8 @@

public class DataFrameTransformTask extends AllocatedPersistentTask implements SchedulerEngine.Listener {

// interval the scheduler sends an event
private static final int SCHEDULER_NEXT_MILLISECONDS = 10000;
private static final Logger logger = LogManager.getLogger(DataFrameTransformTask.class);
// TODO consider moving to dynamic cluster setting
private static final int MAX_CONTINUOUS_FAILURES = 10;
Expand Down Expand Up @@ -337,7 +339,7 @@ private String schedulerJobName() {

private SchedulerEngine.Schedule next() {
return (startTime, now) -> {
return now + 1000; // to be fixed, hardcode something
return now + SCHEDULER_NEXT_MILLISECONDS;
};
}

Expand Down

0 comments on commit baf90ba

Please sign in to comment.