Kafka: Chunk sizes don't match error when combining jsonSpec and simpleSpec

[ablaagaard]

Description

I tried to consume a Kafka topic to a table with a jsonSpec extracting a single column from the key and a simpleSpec to get the value as another column.
It resulted in an error like:
Chunk sizes don't match: 500, 500, 500, 1000, 0
Debugging, it looks like 500 records are processed and the 3 automatically added Kafka columns have a matching chunk size, but my key column has 1000 and the value column 0?

If I change the key spec to a simpleSpec it works.

Versions

• Deephaven: 41.0

[rcaudy]

Thank you for the report, @ablaagaard, @devinrsmith is attempting to reproduce.

[devinrsmith]

Thanks for the issue. I've been able to reproduce this and will have a fix out shortly.

Ultimately, there is some mis-indexing in our code when there is a "complex" key spec and a "simple" value spec (not specific to JSON).