Add VerticalPodAutoscaler for application-controller

[awx-fuyuanchu]

Is your feature request related to a problem?

We have hundreds of applications on the cluster. When we want to update the settings for all applications in one shot, we usually encounter the OOMKilled issue for application-controller, which leads to the inability of the sync for all applications in a reasonable time.

It is not cost-efficiency if we give more memory resources at the beginning.

Related helm chart

argo-cd

Describe the solution you'd like

We have the VPA controller on the cluster. So want to have the VPA resource in the helm chart to help scale the application controller.

Describe alternatives you've considered

No response

Additional context

No response

[ritaCanavarro]

@mkilchhofer have you tried setting up the VPA CRD "by hand" either using Terraform or the chart?

We were also facing the same need and managed to get VPA recommendations by using the TF kubernetes_manifest resource.