GithubHelp home page GithubHelp logo

igor-lirussi / capabot-sanbot-robot Goto Github PK

View Code? Open in Web Editor NEW
11.0 2.0 2.0 33.19 MB

it gives SanBot Robot social capabilities: recognize people, interact on open dialog with SpeechRecognition+DialogEngine+SpeechSynthesis, Present itself, Project a Story, Shake Hands, Tell weather. An activity sends the robot back to the charging station if low on battery.

License: Apache License 2.0

Java 100.00%
sanbot humanoid-robot hri human-robot-interaction sanbot-robot

capabot-sanbot-robot's Introduction

CapaBot, A Sanbot Robot Project for Interaction

The code aims to give Sanbot robot basic interaction abilities. It wanders around avoiding obstacles, going back to the charging station when needed. The robot turns towards sources of noise, or voices, so its attention can be called. During the movement. a face detection module is used to trigger a voice interaction. (it includes a speech recognition module, a conversational engine to formulate the answers and the speech synthesis). The dialogue can be purpose-less, this means that no task is pursued except a normal and pleasant interaction. It is capable also of a task-oriented interaction, implemented in many example modules. Some allow Sanbot to present itself, project a story (of the organization) show the events in a synced calendar, shake hands, tell the weather, give directions, save suggestions from the customers, display web pages for info.

You can find a more in deep discussion here

Pipeline Implemented

Alt text

Installation and Run

Clone the repository.
Android studio is strongly suggested to open the project, the tablet in the robot runs with Android.
Connect the robot to the computer with the cable, press the green play button ▶️ this allows Android Studio, once compiled the project, to upload it in the robot.

Run from the Robot

After the first installation, the app will be available in the section “APP Market”->”Come into my life” -> “Purchased APP”

Built With

  • Java
  • Sanbot OpenSDK
  • icalendar 4 java 3.0.0
  • Ab AIML engine

Changelog


Version 1.0.0 - Initial release
Version 2.4.0 - added calendar and autonomously charge
Version 2.6.9 - added web activity
Version 3.0.3 - added AIML conversational engine
Version 3.0.8 - final Thesis version
Version 4.0.0 - fixed AIML and AIML conversational engine
Version 5.0.0 - passed at the new SDK 2.0.1.10

Authors

  • Igor Lirussi @ ISR Institute for System and Robotics - University of Lisbon (PT)

License

This project is licensed under the MIT License - see the LICENSE.md file for details

Acknowledgments

  • ALICE AI Foundation and Dr. Richard S. Wallace. - for the AIML engine

capabot-sanbot-robot's People

Contributors

igor-lirussi avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

Forkers

8d8d wildgenie

capabot-sanbot-robot's Issues

SanBot Robot USB connection not deteced from computer

Bonjour, je ai essayé de cloner votre programme et l installer sur le robot via l USB mais le problème est que mon pc et le logiciel Android studio ne reconnaissent pas le robot. Avez vous utilisé un driver en particulier?
Merci par avance J ai hâte de pouvoir le tester sur le robot.
Sebastian

dialogflow

bonjour,
aviez vous utilisé dialogflow pour avoir une interaction vocale avec le robot autre que l'appli interne Zhi Yin
j'essaye d'intégrer un fichier dialogflow en français mais le robot ne le prends pas.
merci par avance
sebastian

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.