Topic: data Goto Github

Some thing interesting about data

👇 Here are 18030 public repositories matching this topic...

airbnb / knowledge-repo

data,A next-generation curated knowledge sharing platform for data scientists and other technical professions.

Organization: airbnb

data data-science knowledge data-analysis

airbytehq / airbyte

data,The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

Organization: airbytehq

Home Page: https://airbyte.com

data pipeline data-analysis data-engineering java python etl change-data-capture data-collection data-integration

akfamily / akshare

data,AKShare is an elegant and simple financial data interface library for Python, built for human beings! 开源财经数据接口库

Organization: akfamily

Home Page: https://akshare.akfamily.xyz

futures financial-data data-science quant fundamental akshare option stock data datasets

apple / pkl

data,A configuration as code language with rich validation and tooling.

Organization: apple

Home Page: https://pkl-lang.org

pkl java kotlin config configuration data functional json language object-oriented

arroyosystems / arroyo

data,Distributed stream processing engine in Rust

Organization: arroyosystems

Home Page: https://arroyo.dev

data dev-tools infrastructure kafka rust sql stream-processing data-stream-processing stream-processing-engine

axa-group / parsr

data,Transforms PDF, Documents and Images into Enriched Structured Data

Organization: axa-group

parsr pdf images extraction data typescript python ocr document nlp

bchavez / bogus

data,:card_index: A simple fake data generator for C#, F#, and VB.NET. Based on and ported from the famed faker.js.

User: bchavez

fake data generator dotnet csharp faker c-sharp bogus poco data-access-layer database seed test-data data-generator

belval / textrecognitiondatagenerator

data,A synthetic data generator for text recognition

User: belval

synthetic data text-recognition training-set-generator ocr dataset fake text

brianvoe / gofakeit

data,Random fake data generator written in go

User: brianvoe

go data generator random fake golang seed

data,CKAN is an open-source DMS (data management system) for powering data hubs and data portals. CKAN makes it easy to publish, share and use data. It powers catalog.data.gov, open.canada.ca/data, data.humdata.org among many other sites.

Organization: ckan

Home Page: https://ckan.org/

python open-data data catalog api ckan ckanext digitalpublicgoods dpg sdg16

cloudquery / cloudquery

data,The open source high performance ELT framework powered by Apache Arrow

Organization: cloudquery

Home Page: https://cloudquery.io

aws gcp azure sql data-integration elt etl etl-framework bigquery data-collection

countly / countly-server

data,Countly is a product analytics platform that helps teams track, analyze and act-on their user actions and behaviour on mobile, web and desktop applications.

Organization: countly

Home Page: https://countly.com

web-analytics dashboard mobile-analytics analytics push-notifications crash-reports insights data tracking product-management

cue-lang / cue

data,The home of the CUE language! Validate and define text-based and dynamic configuration

Organization: cue-lang

Home Page: https://cuelang.org

data validation configuration kubernetes

dataexpert-io / data-engineer-handbook

data,This is a repo with links to everything you'd ever want to learn about data engineering

Organization: dataexpert-io

apachespark awesome bigdata data dataengineering sql

dformoso / machine-learning-mindmap

data,A mindmap summarising Machine Learning concepts, from Data Analysis to Deep Learning.

User: dformoso

machine learning data science python jupyter cheatsheet mindmap machine-learning

dtinit / data-transfer-project

data,The Data Transfer Project makes it easy for platforms to build interoperable user data portability features. We are establishing a common framework, including data models and protocols, to enable direct transfer of data both into and out of participating online service providers.

Organization: dtinit

Home Page: https://dtinit.org/docs/dtp-what-is-it

data transfer portability data-portability

faker-js / faker

data,Generate massive amounts of fake data in the browser and node.js

Organization: faker-js

Home Page: https://fakerjs.dev

faker data fake nodejs browser javascript

fivethirtyeight / data

data,Data and code behind the articles and graphics at FiveThirtyEight

Organization: fivethirtyeight

Home Page: https://data.fivethirtyeight.com/

data

flyteorg / flyte

data,Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

Organization: flyteorg

Home Page: https://flyte.org

flyte machine-learning golang scale workflow data-science data-analysis data kubernetes-operator kubernetes

glideapps / glide-data-grid

data,🚀 Glide Data Grid is a no compromise, outrageously react fast data grid with rich rendering, first class accessibility, and full TypeScript support.

Organization: glideapps

Home Page: https://grid.glideapps.com

accessible data datagrid grid javascript react reactjs table typescript

heroku / react-refetch

data,A simple, declarative, and composable way to fetch data for React components

Organization: heroku

Home Page: https://blog.heroku.com/react-refetch

react rest api data fetch

jdorfman / awesome-json-datasets

data,A curated list of awesome JSON datasets that don't require authentication.

User: jdorfman

awesome awesome-list data dataset datasets json json-dataset list

jonschlinkert / gray-matter

data,Smarter YAML front matter parser, used by metalsmith, Gatsby, Netlify, Assemble, mapbox-gl, phenomic, vuejs vitepress, TinaCMS, Shopify Polaris, Ant Design, Astro, hashicorp, garden, slidev, saber, sourcegraph, and many others. Simple to use, and battle tested. Parses YAML by default but can also parse JSON Front Matter, Coffee Front Matter, TOML Front Matter, and has support for custom parsers. Please follow gray-matter's author: https://github.com/jonschlinkert

User: jonschlinkert

Home Page: https://github.com/jonschlinkert

yaml front-matter matter javascript parse markdown data gatsby assemble phenomic

kestra-io / kestra

data,Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.

Organization: kestra-io

Home Page: https://kestra.io

workflow workflow-engine orchestration scheduler data-pipeline elt etl data data-engineering data-orchestration

lk-geimfari / mimesis

data,Mimesis is a robust data generator for Python that can produce a wide range of fake data in multiple languages.

User: lk-geimfari

Home Page: https://mimesis.name

mimesis fake data generator fixtures dummy schema testing python json-generator mock synthetic-data datascience dataframe pandas syntetic polars pytest-plugin factory factory-boy

mage-ai / mage-ai

data,🧙 Build, run, and manage data pipelines for integrating and transforming data.

Organization: mage-ai

Home Page: https://www.mage.ai/

machine-learning artificial-intelligence data data-engineering data-science python elt etl pipelines data-pipelines

mdn / browser-compat-data

data,This repository contains compatibility data for Web technologies as displayed on MDN

Organization: mdn

Home Page: https://developer.mozilla.org

compat compatibility data dataset json

mendableai / firecrawl

data,🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

Organization: mendableai

Home Page: https://firecrawl.dev

ai ai-scraping crawler data html-to-markdown llm markdown rag scraper scraping web-crawler

metabase / metabase

data,The simplest, fastest way to get business intelligence and analytics to everyone in your company :yum:

Organization: metabase

Home Page: https://metabase.com

analytics businessintelligence dashboard reporting slack clojure database metabase postgres postgresql

mrdbourke / machine-learning-roadmap

data,A roadmap connecting many of the most important concepts in machine learning, how to learn them and what tools to use to perform them.

User: mrdbourke

machine-learning deep-learning data data-science

ngneat / falso

data,All the Fake Data for All Your Real Needs 🙂

Organization: ngneat

Home Page: https://ngneat.github.io/falso/

fake data mock mockdata fakedata random

olifolkerd / tabulator

data,Interactive Tables and Data Grids for JavaScript

User: olifolkerd

Home Page: http://tabulator.info

tabulator javascript table grid grid-layout grid-system data widget cdnjs json

oxnr / awesome-bigdata

data,A curated list of awesome big data frameworks, ressources and other awesomeness.

User: oxnr

Home Page: https://github.com/onurakpolat/awesome-bigdata

awesome bigdata data-warehouse data-analytics data-visualization data-stream database data-science data awesome-list

prefecthq / prefect

data,Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

Organization: prefecthq

Home Page: https://prefect.io

python workflow data-engineering data-science workflow-engine prefect infrastructure ml-ops data-ops automation orchestration data observability pipeline

prestodb / presto

data,The official home of the Presto distributed SQL query engine for big data

Organization: prestodb

Home Page: http://prestodb.io

java presto hive hadoop big-data sql data lakehouse query

prql / prql

data,PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement

Organization: prql

Home Page: https://prql-lang.org

data pipeline sql

pwxcoo / chinese-xinhua

data,:orange_book: 中华新华字典数据库。包括歇后语，成语，词语，汉字。

User: pwxcoo

data scraper chinese-traditional python3 chinese chinese-characters chinese-nlp chinese-language chinese-simplified json-dataset

quartz / bad-data-guide

data,An exhaustive reference to problems seen in real-world data along with suggestions on how to resolve them.

Organization: quartz

qz-things data guide documentation

rawgraphs / rawgraphs-app

data,A web interface to create custom vector-based visualizations on top of RAWGraphs core

Organization: rawgraphs

Home Page: https://rawgraphs.io

d3js data data-visualization ddj design rawgraphs svg vector-graphics visualization

run-llama / llama_index

data,LlamaIndex is a data framework for your LLM applications

Organization: run-llama

Home Page: https://docs.llamaindex.ai

agents application data fine-tuning framework llamaindex llm rag vector-database

sheetjs / sheetjs

data,📗 SheetJS Spreadsheet Data Toolkit -- New home https://git.sheetjs.com/SheetJS/sheetjs

Organization: sheetjs

Home Page: https://sheetjs.com/

angular bun csv data database deno excel grid html html5 ios javascript json nodejs react spreadsheet table vue xlsx xml

sinaptik-ai / pandas-ai

data,Chat with your database (SQL, CSV, pandas, polars, mongodb, noSQL, etc). PandasAI makes data analysis conversational using LLMs (GPT 3.5 / 4, Anthropic, VertexAI) and RAG.

Organization: sinaptik-ai

Home Page: https://pandas-ai.com

llm pandas ai data-analysis data-science gpt-3 gpt-4 csv data sql database datalake

snowplow / snowplow

data,The leader in Next-Generation Customer Data Infrastructure

Organization: snowplow

Home Page: http://snowplowanalytics.com

snowplow analytics data data-pipeline data-collection product-analytics marketing-analytics snowplow-pipeline snowplow-events

superduper-io / superduper

data,Superduper: Bring AI to your database! Integrate AI models and workflows with your database to implement custom AI applications, without moving your data. Including streaming inference, scalable model hosting, training and vector search.

Organization: superduper-io

Home Page: https://superduper.io

ai chatbot data database distributed-ml inference llm-inference llm-serving llmops ml mlops mongodb pretrained-models python pytorch rag semantic-search torch transformers vector-search

superstreamlabs / memphis

data,Memphis.dev is a highly scalable and effortless data streaming platform

Organization: superstreamlabs

Home Page: https://docs.memphis.dev

data data-stream-processing data-streaming kubernetes messaging-queue data-engineering data-pipeline golang enrichment message-broker

tanstack / query

data,🤖 Powerful asynchronous state management, server-state utilities and data fetching for the web. TS/JS, React Query, Solid Query, Svelte Query and Vue Query.

Organization: tanstack

Home Page: https://tanstack.com/query