Skip to content

Rate limit replica scale up after parameter change #84

@bowei

Description

@bowei

After a configuration update, it is possible for the number of replicas to experience a large change (e.g. from 1k replicas => 2k), overwhelming the other parts of the infrastructure.

We should have a tunable scale up rate of change parameter such as "scale_up_replicas_per_second" that can control how fast we increase replica counts.

Note: it can default to infinity which is the policy today.

Metadata

Metadata

Assignees

No one assigned

    Labels

    lifecycle/frozenIndicates that an issue or PR should not be auto-closed due to staleness.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions