Allow charset=utf-8 in response Content-Type

[mkjois]

Addresses #1 which clones hashicorp/terraform#15164. Uses mime for proper parsing.

Testing

2 new test cases which both working correctly after change:

• allow response with Content-Type: text/plain; charset=utf-8
• disallow response with Content-Type application/json; charset=utf-16

[apparentlymart]

Thanks for working on this, @mkjois! This looks good to me.

[shan0809]

Hi i am trying to fetch data from external source using the http provider however it is failing with below err:

Error: Unsupported block type

on var.tf line 57, in data "http" "OMSAgent":
57: request_headers {

Blocks of type "request_headers" are not expected here. Did you mean to define
argument "request_headers"? If so, use the equals sign to assign it a value.

Releasing state lock. This may take a few moments...

Code :
data "http" "OMSAgent" {
url = "https://github.com/microsoft/OMS-Agent-for-Linux/blob/master/installer/scripts/onboard_agent.sh"
request_headers {
Accept = "text/plain"
}
}

[github-actions]

I'm going to lock this pull request because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active contributions.
If you have found a problem that seems related to this change, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.