phailin791 / xtreme1

Xtreme1 - The Next GEN Platform for Multimodal Training Data. #3D annotation, 3D segmentation, lidar-camera fusion annotation, image annotation and rlhf tools are supported!

Intro

Xtreme1 is the world's first open-source platform for Multimodal training data.

Xtreme1 unlocks deep insights into data annotation, curation and ontology management for tackling machine learning challenges in computer vision and LLM. The platform's AI-fueled tools elevate your annotation game to the next level of efficiency, powering your projects in 2D/3D Object Detection, 3D Instance Segmentation and LiDAR-Camera Fusion like never before.

Today, building upon this initiative, we're delighted to present our AI-powered Cloud platform — completely FREE of charge! This groundbreaking decision marks another important step towards AI democracy, making AI solutions more accessible to everyone.

Join community

Website | Slack | Twitter | Medium | Issues

Join the Xtreme1 community on Slack to share your suggestions, advice, and questions with us.

👉 Join us on Slack today!

Key features

Image Annotation (B-box, Segmentation) - YOLOR & RITM	Lidar-camera Fusion Annotation - OpenPCDet & AB3DMOT

1️⃣ Supports data labeling for images, 3D LiDAR and 2D/3D Sensor Fusion datasets

2️⃣ Built-in pre-labeling and interactive models support 2D/3D object detection, segmentation and classification

3️⃣ Configurable Ontology Center for general classes (with hierarchies) and attributes for use in your model training

4️⃣ Data management and quality monitoring

5️⃣ Find labeling errors and fix them

6️⃣ Model results visualization to help you evaluate your model

7️⃣ RLHF for Large Language Models 🆕 (beta version)

Image Data Curation (Visualizing & Debug) - MobileNetV3 & openTSNE	RLHF Annotation tool for LLM (beta version)

Quick start

• Get access to Xtreme1 online version without any installation 🚀

• Install and Quick start 💿

• Install with Docker 🐋

• Build Xtreme1 from source code 🔧

Download package

Download the latest release package and unzip it.

wget https://github.com/xtreme1-io/xtreme1/releases/download/v0.7.1/xtreme1-v0.7.1.zip
unzip -d xtreme1-v0.7.1 xtreme1-v0.7.1.zip

Start all services

docker compose up

Visit http://localhost:8190 in the browser (Google Chrome is recommended) to try out Xtreme1!

⚠️ Install built-in models

You need to explicitly specify a model profile to enable model services.

docker compose --profile model up

Enable model services

Make sure you have installed NVIDIA Driver and NVIDIA Container Toolkit. But you do not need to install the CUDA Toolkit, as it already contained in the model image.

# You need set "default-runtime" as "nvidia" in /etc/docker/daemon.json and restart docker to enable NVIDIA Container Toolkit
{
  "runtimes": {
    "nvidia": {
      "path": "nvidia-container-runtime",
      "runtimeArgs": []
    }
  },
  "default-runtime": "nvidia"
}

For more installation, development and deployment, check out Xtreme1 Docs.

License

This software is licensed under the Apache 2.0 LICENSE. Xtreme1 is a trademark of LF AI & Data Foundation.

Xtreme1 is now hosted in LF AI & Data Foundation as the 1st open source data labeling annotation and visualization project.

If Xtreme1 is part of your development process / project / publication, please cite us ❤️ :

@misc{Xtreme1,
title = {Xtreme1 - The Next GEN Platform For Multisensory Training Data},
year = {2023},
note = {Software available from https://github.com/xtreme1-io/xtreme1/},
url={https://xtreme1.io/},
author = {LF AI & Data Foundation},
}