C-Loftus/Remora

A companion to the Orca screen reader

★ 2Forks 0TypeScriptGitHub ↗Compare
gnomelinuxocrorcascreenreader

README

Remora

Remora is an application that runs in parallel with the Orca screen reader on Linux and extends Orca's functionality. It provides the ability to:

  • Summarize text and visual content with private offline ollama vision models
  • OCR the screen
  • Provide hotkeys for helpful actions not in Orca by default (for example, a screen curtain)

Quickstart Overview Video

A video demonstrating how to use Remora can be found here

The thumbnail of a youtube video demonstrating a quick start of Remora

Installation

Limitations:

  • You must use a recent version of Orca (at least v49.0 beta or above)
  • This app only works on X11; Wayland does not support global hotkeys or coordinates and thus is impossible to support across compositors
  • To use hotkeys you cannot have numlock or another modifier key enabled
  • Currently supports only amd64
  • You must tab into the GUI window to read its contents with Orca due to a bug in webkit gtk

Building

You must have wails installed to build this program. Then follow the commands in the makefile

Screenshot

A screenshot of the remora application, showing the logo, the title page, an enumeration of keyboard shortcuts, ollama output, and ocr

Contributors

C-Loftus

Issues