Comments (3)
Thanks for submitting an issue for the first time! We will take a look at it.
from datacatalog-connectors-bi.
Hi, @anugrah86, thanks for filling this feature request.
We need more details to evaluate the feasibility of such a feature, ok?
As you noticed, the Qlik Sense Connector currently scrapes metadata from Master Items (Dimensions, Measures, Visualizations) and Sheets through the Engine JSON API.
-
For Master Items, we perform the API calls in the following order:
OpenDoc
>GetAllInfos
><GET-ITEM>
>GetProperties
, replacing<GET-ITEM>
withGetDimension
,GetMeasure
, andGetObject
respectly.We filter
GetAllInfos
's response to:
1.1. find all elements that have"qType": "dimension"
and then make the subsequentGetDimension
calls;
1.2. find all elements that have"qType": "measure"
and then make the subsequentGetMeasure
calls;
1.3. find all elements that have"qType": "masterobject"
and then make the subsequentGetObject
calls. -
For Sheets, we call
OpenDoc
>GetObjects
, passing the below params:'params': { 'qOptions': { 'qTypes': ['sheet'], }, },
This means we don't use API calls with "qType": "DimensionList"
so far.
That said, could you provide more details on how "qType": "FieldList"
could be used to scrape Fields' metadata?
Thanks,
from datacatalog-connectors-bi.
This issue has been automatically marked as stale because it hasn't had any activity in 60 days. It will be closed in 7 days if no further activity occurs (e.g. changing labels, comments, commits, etc.). Please feel free to tag a maintainer and ask them to remove the label if you think it doesn't apply. Thank you for submitting this issue and helping to make Google Data Catalog Connectors better!
from datacatalog-connectors-bi.
Related Issues (17)
- Looker - what does it integrate? HOT 2
- [BUG] Initial full sync entries in data catalog are not searchable HOT 4
- [BUG] Tableau connector is always returning empty metadata.
- [FEATURE] Tableau - Verify that resolved GraphQL query is valid on unit tests and improve error message. HOT 1
- [FEATURE] Looker - Add option to filter the ingested types. HOT 1
- [BUG] Looker - error.SDKError when scrapping query_generated_sql data.
- [BUG] HOT 3
- [BUG] Looker connector throws "Requires authentication" error when scraping metadata takes too long HOT 2
- [FEATURE] Add support for Qlik
- [BUG] Error when site name contains space for Tableau connector HOT 11
- [BUG] List of Systems do not get updated after Tableau sync HOT 2
- ADD support for Python3.6 on looker2datacatalog HOT 2
- [FEATURE] Turn the WebsocketResponsesManager thread safe HOT 1
- [FEATURE] Create a BI connector for Sisense HOT 8
- [FEATURE] Publish connectors to pypi.
- [FEATURE] ADD Tags with links to Looker on ingested Entries. HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from datacatalog-connectors-bi.