Repositories list

• duck_lineage

  Public
  A extension for DuckDB, which captures lineage events for executed queries

  data-managementdata-lineageduckdb+ 1

  data-managementdata-lineageduckdbduckdb-extension

  Python

  •

  MIT License

  •22 forks•5353 stars•00 issues•00 pull requests•Updated Apr 15, 2026Apr 15, 2026

• OpenLineage

  Public
  An Open Standard for lineage metadata collection

  Java

  •

  Apache License 2.0

  •459459 forks•00 stars•00 issues•00 pull requests•Updated Apr 11, 2026Apr 11, 2026

• spark

  Public
  Apache Spark - A unified analytics engine for large-scale data processing

  Scala

  •

  Apache License 2.0

  •29k29k forks•22 stars•00 issues•00 pull requests•Updated Apr 11, 2026Apr 11, 2026

• hadoop

  Public
  Apache Hadoop

  Java

  •

  Apache License 2.0

  •9.2k9.2k forks•00 stars•00 issues•00 pull requests•Updated Apr 11, 2026Apr 11, 2026

• ClickHouse

  Public
  ClickHouse

  C++

  •

  Apache License 2.0

  •8.3k8.3k forks•00 stars•00 issues•00 pull requests•Updated Apr 11, 2026Apr 11, 2026

• hive

  Public
  Apache Hive

  Java

  •

  Apache License 2.0

  •4.8k4.8k forks•00 stars•00 issues•00 pull requests•Updated Apr 11, 2026Apr 11, 2026

• duckdb-hive-metastore

  Public
  DuckDB extension allowing to connect to Apache Hive Metastore and query the data inside, like a native DuckDB catalog.

  C++

  •

  MIT License

  •00 forks•11 star•00 issues•00 pull requests•Updated Apr 9, 2026Apr 9, 2026

• marquez

  Public

  ilum-cloud/marquez’s past year of commit activity
  Collect, aggregate, and visualize a data ecosystem's metadata

  metadatadata-sciencedata-catalog+ 9

  metadatadata-sciencedata-catalogdata-discoverydata-dictionarydata-governancedata-lineagedata-opsdata-provenancemetadata-service+ 2

  Java

  •

  Apache License 2.0

  •394394 forks•1515 stars•22 issues•11 pull request•Updated Apr 1, 2026Apr 1, 2026

• ilum-tilt

  Public
  Tilt-based local development setup for the Ilum data lakehouse platform

  Starlark

  •00 forks•11 star•22 issues•00 pull requests•Updated Mar 31, 2026Mar 31, 2026

• bigtop-manager

  Public
  Bigtop Manager is a modern, AI-driven web application designed to simplify the complexity of bigdata cluster management.

  Java

  •

  Apache License 2.0

  •4747 forks•00 stars•00 issues•00 pull requests•Updated Mar 30, 2026Mar 30, 2026

• duckdb-community-extensions

  Public
  Python

  •166166 forks•00 stars•00 issues•00 pull requests•Updated Mar 18, 2026Mar 18, 2026

• ilum-cli

  Public
  00 forks•11 star•00 issues•00 pull requests•Updated Mar 12, 2026Mar 12, 2026

• doc

  Public
  Ilum - Apache Spark cluster on Kubernetes

  kubernetessparkmanager+ 2

  kubernetessparkmanagerolapobject-storage

  11 fork•77 stars•11 issue•00 pull requests•Updated Feb 13, 2026Feb 13, 2026

• duckdb-java

  Public
  DuckDB JDBC Driver

  C++

  •

  MIT License

  •7070 forks•00 stars•00 issues•00 pull requests•Updated Feb 13, 2026Feb 13, 2026

• bigtop

  Public
  Bigtop is an Apache Foundation project for Infrastructure Engineers and Data Scientists looking for comprehensive packaging, testing, and configuration of the l…

  Groovy

  •

  Apache License 2.0

  •526526 forks•00 stars•00 issues•00 pull requests•Updated Jan 30, 2026Jan 30, 2026

• jupyterlab-bucket-explorer

  Public
  A modern, multi-cloud object storage browser for JupyterLab 4. Unified interface to browse, manage, and edit files across AWS S3, MinIO, and S3-compatible stora…

  pythonproductivitydata-science+ 8

  pythonproductivitydata-sciencejupyters3cloud-storageminiofile-browserjupyterlabobject-storage+ 1

  TypeScript

  •

  Apache License 2.0

  •00 forks•22 stars•00 issues•00 pull requests•Updated Jan 22, 2026Jan 22, 2026

• airflow

  Public
  Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

  Python

  •

  Apache License 2.0

  •17k17k forks•00 stars•00 issues•00 pull requests•Updated Jan 2, 2026Jan 2, 2026

• gravitino

  Public
  World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.

  Java

  •

  Apache License 2.0

  •807807 forks•00 stars•00 issues•00 pull requests•Updated Jan 1, 2026Jan 1, 2026

• unitycatalog

  Public
  Open, Multi-modal Catalog for Data & AI

  Java

  •

  Apache License 2.0

  •609609 forks•00 stars•00 issues•00 pull requests•Updated Dec 24, 2025Dec 24, 2025

• delta

  Public
  An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

  Scala

  •

  Apache License 2.0

  •2.1k2.1k forks•00 stars•00 issues•00 pull requests•Updated Dec 24, 2025Dec 24, 2025

• minio

  Public
  High Performance, Kubernetes Native Object Storage

  Go

  •

  GNU Affero General Public License v3.0

  •7.4k7.4k forks•00 stars•00 issues•00 pull requests•Updated Dec 24, 2025Dec 24, 2025

• druid

  Public
  Apache Druid: a high performance real-time analytics database.

  Java

  •

  Apache License 2.0

  •3.8k3.8k forks•00 stars•00 issues•00 pull requests•Updated Dec 24, 2025Dec 24, 2025

• sparkmagic

  Public
  Jupyter magics and kernels for working with remote Spark clusters

  Python

  •

  Other

  •449449 forks•00 stars•00 issues•00 pull requests•Updated Dec 24, 2025Dec 24, 2025

• bitnami-charts

  Public
  Bitnami Helm Charts

  Smarty

  •

  Other

  •10k10k forks•00 stars•00 issues•00 pull requests•Updated Dec 24, 2025Dec 24, 2025

• bitnami-containers

  Public
  Bitnami container images

  Shell

  •

  Other

  •6.8k6.8k forks•00 stars•00 issues•00 pull requests•Updated Dec 24, 2025Dec 24, 2025

• sdp-ui

  Public
  Spark Declarative Pipelines UI - Standalone app for running sdp

  sparkapache-sparkspark-streaming+ 5

  sparkapache-sparkspark-streamingsdpdatabricksspark-sqlilumspark-declarative-pipelines

  Apache License 2.0

  •00 forks•11 star•00 issues•00 pull requests•Updated Oct 15, 2025Oct 15, 2025

• ilum-python-examples

  Public
  Jupyter Notebook

  •

  Apache License 2.0

  •66 forks•33 stars•00 issues•00 pull requests•Updated Jun 12, 2025Jun 12, 2025

• incubator-pinot

  Public
  Apache Pinot (Incubating) - A realtime distributed OLAP datastore

  Java

  •

  Apache License 2.0

  •1.5k1.5k forks•00 stars•00 issues•2525 pull requests•Updated Mar 27, 2025Mar 27, 2025

• iceberg

  Public
  Apache Iceberg

  Java

  •

  Apache License 2.0

  •3.2k3.2k forks•00 stars•00 issues•00 pull requests•Updated Dec 24, 2024Dec 24, 2024

• spark-jobserver

  Public
  REST job server for Apache Spark

  Scala

  •

  Other

  •974974 forks•11 star•00 issues•00 pull requests•Updated Dec 24, 2024Dec 24, 2024