GithubHelp home page GithubHelp logo

open-metadata / openmetadata Goto Github PK

View Code? Open in Web Editor NEW
4.2K 4.2K 836.0 1.33 GB

Open Standard for Metadata. A Single place to Discover, Collaborate and Get your data right.

Home Page: https://open-metadata.org

License: Apache License 2.0

Makefile 0.08% Shell 0.15% Java 27.02% JavaScript 0.28% HTML 0.12% TypeScript 42.86% CSS 0.07% Dockerfile 0.06% Python 26.43% Jinja 0.01% ANTLR 0.02% PLpgSQL 0.12% Less 2.31% FreeMarker 0.48% LookML 0.01%
data-catalog data-collaboration data-contracts data-discovery data-governance data-lineage data-observability data-profiling data-quality data-quality-checks data-science data-validation datacatalog datadiscovery dataengineering dataquality dbt metadata metadata-management snowflake

openmetadata's People

Contributors

07himank avatar akash-jain-10 avatar amiorin avatar aniketkatkar97 avatar ashish8689 avatar ayush-shah avatar chirag-madlani avatar codingwithabhi avatar darth-coder00 avatar dependabot[bot] avatar harsh-vador avatar harshach avatar karanh37 avatar milanbariya avatar mithmatt avatar mohityadav766 avatar nahuelverdugo avatar nihardoshi99 avatar onkarvo7 avatar parthp2107 avatar pmbrull avatar sachin-chaurasiya avatar shaileshparmar11 avatar shannonbradshaw avatar shilpavernekar avatar sureshms avatar sushi30 avatar teddycr avatar ulixius9 avatar vivekratnavel avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

openmetadata's Issues

All Tiers should be displayed in a sort order

image

We should display
Tier 1
Tier 2
Tier 3
Tier 4
Tier 5

Even if the aggregations are not returned for all of them. Lets display all of those labels when the counts are available show those counts otherwise it should be set to 0

API to return if the logged in user owns a dataset or not

If the API requesting table information is passing a field like "owners". We should return owners filed as we do today and include "ownedByMe" in extra fields.

  1. If the logged-in user is owned dataset returns true
  2. if the team is owned and logged in user belongs to the tam return true
  3. for all other cases we should return false.

Need fullyQualifiedName field for data assets and profile field for users of team.

Currently, we are getting only these 4 fields for owns and 5 fields for users

owns:[
   {
      "id": "155ce023-843e-4b4b-a6bc-10d989d4182f",
      "type": "table",
      "name": "users",
      "href": "http://localhost:8585/api/v1/tables/155ce023-843e-4b4b-a6bc-10d989d4182f"
    },
],
users:[
{ 
     "description": "Robert Cole"
    "href": "http://localhost:8585/api/v1/users/03a8a9ac-e29b-4a9a-8ad1-00339b849310"
    "id": "03a8a9ac-e29b-4a9a-8ad1-00339b849310"
    "name": "robert_cole6"
    "type": "user"
}
]
 1. use case: FQN to redirect users from team page to dataset details page 
 2. use case: Profile to show user profile pic beside the username

Entity(database, table) API to claim ownership

  1. Provide an API to claim an entity such as (database, table)
  2. We will not allow other users to claim a table if there is an owner and active. Transfer of ownership needs to be thought through and can come in later.
  3. If there is no owner is associated with a table anyone can claim it.

Merge secure and non-secure tests

There are two versions of the tests. Secure tests with authentication and non-secure tests with no authentication. Merging them together into a single version of tests that always require authentication.

Replace catalog to openmetadata

Need to change catalog string to openmetadata in the following places:

  • DB Name and Credentials
  • Final package name
  • Yaml file name
  • Server start filename

Changing Tier does not replace the previously selected Tier

Patch API : api/v1/tables/

Payload:

[{"op":"replace","path":"/tags/0/tagFQN","value":"Tier.Tier3"}]

Response:

{
  "id": "338fe5bb-b125-4ba6-aa61-313b29e9947d",
  "name": "sql_sizing_profiles",
  "href": "http://localhost:8585/api/v1/tables/338fe5bb-b125-4ba6-aa61-313b29e9947d",
  "fullyQualifiedName": "aws_redshift.information_schema.sql_sizing_profiles",

  <----------Other_fields------------->

  "tags": [
    {
      "tagFQN": "Tier.Tier1",
      "labelType": "Manual",
      "state": "Confirmed"
    },
    {
      "tagFQN": "Tier.Tier3",
      "labelType": "Manual",
      "state": "Confirmed"
    }
  ]
}

Expected behaviour:
Response should only have 1 Tier set, i.e. Tier3 in this case

404 page - Page Not Found

  • If no data is found under any module, then show consistent 404 error
  • If page link is broken then show proper 404 error

Show ServiceType in search suggestions

image

In the above example, we have a users table from MySQL and a users table from redshift. Can't tell the difference here, good to have a service type icon next to them.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.