Comments (5)
Thanks for the contribution, it is released as part of v2.14.1
from avro.
I have looked at the code, and it seems it relies on the schema cache; if the type is not in the cache, the parser assumes the type definition is unknown. (and sometimes the type definition does exist, but it has not been cached yet)
I would see three approaches to fixing this issue:
1- a quick full schema scan cache the types
2- defer parsing any unknown type to the end, so the cache eventually will have the type definition if it does exist.
3- preprocess the schema by expanding any reference type so that each type would be populated with the exact definition.
from avro.
Hi,
I am reasonably certain the second case is not valid according to the spec. From my reading, name references must reference a previously defined name, meaning the definition for the name must be before the reference is used.
from avro.
@nrwiersma, thanks for a clear answer; you are correct; the definition must be defined first before using it, and now I just found the real issue in my code. Which is not related to ordering rather than naming. Here is an example of a schema that can be parsed in java avro-tool
{
"name": "a.b.rootType",
"type": "record",
"fields": [
{
"name": "someEnum1",
"type": {
"name": "classEnum",
"type": "enum",
"symbols": [
"A",
"B",
"C"
]
}
},
{
"name": "someEnum2",
"type": "a.b.classEnum"
}
]
}
but when I used it with avrosv
I got the following error
Error: avro: unknown type: a.b.classEnum
from avro.
That does seem like a bug.
from avro.
Related Issues (20)
- Support TextMarshaler/TextUnmarshaler for map keys HOT 2
- need an method generate schema from struct HOT 7
- Bug for tree typed schema HOT 2
- [BUG] array schema cannot be correctly parsed HOT 4
- Local timestamp logical types HOT 1
- Add support for Zstandard compression
- Enum schema evolution for missing value in reader schema but with default HOT 3
- Question about max byte slice HOT 6
- Performance degradation in v2.19.0 HOT 4
- Wrong decoding of nested map HOT 1
- Infinite loop parsing recursive array type HOT 1
- "unknown union type long" error HOT 2
- Support nested array of record HOT 3
- Bug with encoding union + fixed + decimal HOT 6
- Problem with empty slices vs nil. HOT 8
- Decode Array - Panic: Allocation size out of range Error HOT 1
- I struggle to have more than one "registered" type in the same field of a schema HOT 9
- Reasoning behind swallowing EOF errors? HOT 2
- Decoding of map[string]any behavior changed HOT 3
- [avrogen] tags - having omitEmpty in the json generated object HOT 8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from avro.