AakashKhatu/AccesiBot-HackCOMS

โ˜… 1Forks 0TypeScriptGitHub โ†—Compare

README

๐ŸŽจ AccessiBot

An AI-Powered Adobe Express Add-On for Inclusive Design

๐Ÿ”— Devpost

๐Ÿ† Awards

  • [MLH] Most Creative Adobe Express Add-On - HackCOMS @ RIT - Nov 2024

๐ŸŒŸ Overview

AccessiBot is an Adobe Express Add-On that revolutionizes the way creators approach accessible design. With just a single click, our tool analyzes your design and provides actionable insights to make your content more accessible to everyone.

โœจ Features

  • ๐Ÿ” Font Analysis: Evaluates clarity and visibility of text elements
  • ๐Ÿ–ผ๏ธ Image Assessment: Checks image visibility and contrast
  • ๐ŸŽจ Color Contrast: Ensures WCAG compliance
  • ๐Ÿ“– Text Readability: Analyzes and suggests improvements
  • ๐Ÿ”ค Font Style Optimization: Recommends better font choices
  • โ™ฟ Accessibility Enhancements: Provides content modification suggestions

๐Ÿ› ๏ธ Technology Stack

Backend Server

  • FastAPI for high-performance API endpoints
  • LangChain for AI workflow orchestration
  • TogetherAI integration

AI Models

  • LLama 3.2 90B Vision Instruct
  • LLama 3.2 11B Vision
  • Qwen 2.5 72B Instruct

Frontend

  • Adobe Express Add-On SDK
  • JavaScript

๐Ÿš€ Getting Started

Prerequisites

  • Python 3.8+
  • Adobe Express Developer Account
  • TogetherAI API key
  • ngrok authtoken

Backend Setup

  1. Clone the repository
git clone https://github.com/AakashKhatu/AccesiBot-HackCOMS
cd AccesiBot-HackCOMS/API
  1. Install dependencies
pip install -r requirements.txt
  1. Set up environment variables
cp .env.example .env
# Edit .env with your API keys and configuration
  1. Run the server
python fastApiServer.py

Build your own Adobe Express Add-On

  1. Navigate to the add-on directory
cd frontend
  1. Install dependencies
npm install
  1. Build the project
npm build

and follow steps 5 and 6 from below.

OR

Use pre-built release and Test AccessiBot:

  1. Download dist.zip from releases

  2. Go to Adobe Express
    Open Adobe Express in your browser.

  3. Enable Add-On Development

    • Navigate to Profile -> Settings.
    • Enable Add-On development.
  4. Create a New Add-On

    • In the Nav bar, click Add-Ons -> Your Add-Ons -> Manage Add-Ons -> Create new add-on.
    • Type the name AccessiBot.
    • Create a private link.
  5. Upload Add-On Package

    • Add dist.zip as the add-on package.
    • Copy the generated link and open it in a new tab.
  6. Test AccessiBot

    • Click Add.
    • Select Create/import your design.
    • Test and play with AccessiBot.

๐Ÿ’ก How It Works

  1. User clicks the "Analyze" button in Adobe Express
  2. Add-on captures the current page content
  3. Content is processed by our AI model pipeline:
    • Vision analysis for image and layout assessment
    • Text analysis for readability and accessibility
    • Color analysis for contrast and visibility
  4. Results are presented with actionable improvements

๐Ÿ‘ฅ Meet the Team

Aakash Khatu Gayatri Khandagale
Aakash Khatu Gayatri Khandagale
AI & API Development AI & Add on Development

๐Ÿ™ Acknowledgments

  • Adobe Express team for their excellent developer tools
  • The open-source AI community & Meta Llama for their absolutely stunning multimodal LLM Models
  • Major League Hacking (MLH) for recognizing our innovation!

Made with โค๏ธ for accessible design

Report Bug ยท Request Feature

Contributors

AakashKhatuGayatri-K

Issues