You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The current avro source (only append-only allows no schema registry) and sink (unreleased yet) uses the file header, which is huge and intended to be shared by multiple records within the same file. As messages in a queue, we shall switch to one of the earlier options.
The text was updated successfully, but these errors were encountered:
When using confluent schema registry, there is a 5-byte header during serialization:
https://docs.confluent.io/platform/current/schema-registry/fundamentals/serdes-develop/index.html#messages-wire-format
When not using confluent schema registry, we have several options:
from_avro_datum
/to_avro_datum
)GenericSingleObjectReader
/GenericSingleObjectWriter
)Reader
/Writer
)The current avro source (only append-only allows no schema registry) and sink (unreleased yet) uses the file header, which is huge and intended to be shared by multiple records within the same file. As messages in a queue, we shall switch to one of the earlier options.
The text was updated successfully, but these errors were encountered: