When using a python client, a RunEvent does not validate a date time provided as a string. It's pretty easy to make an error like:
event = RunEvent(
RunState.START,
"2020-01-01", # this should be a date time, preferably with a timezone
Run("123e4567-e89b-12d3-a456-426614174000"),
Job("openlineage", "job"),
"http://producer"
)
c = OpenLineageClient(url=<<some-url>>)
c.emit(event=event)
which returns:
'{"code":400,"message":"Unable to process JSON"}'
which could be more meaningful to find a cause of an issue.
Following improvements should be done:
- date time should be validated on a pathon client side,
- in case of
JsonProcessingException, Marquez should include exception in returned error message.
When using a python client, a
RunEventdoes not validate a date time provided as a string. It's pretty easy to make an error like:which returns:
which could be more meaningful to find a cause of an issue.
Following improvements should be done:
JsonProcessingException, Marquez should include exception in returned error message.