GithubHelp home page GithubHelp logo

cloud-cv / cloudcv-old Goto Github PK

View Code? Open in Web Editor NEW
50.0 50.0 37.0 166.49 MB

CloudCV - Large-Scale Distributed Computer Vision As A Cloud Service

Home Page: http://cloudcv.org

License: MIT License

Python 50.21% CSS 1.48% JavaScript 12.71% HTML 32.90% Shell 2.71%

cloudcv-old's People

Contributors

anant-dev avatar deshraj avatar dexter1691 avatar nightfury13 avatar prashantjalan avatar rishabhjain2018 avatar shivammg avatar souravsingh avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

cloudcv-old's Issues

Shifting from Celery to RabbitMQ

Since we want to load the model in another process and then do prediction so as the model don't get loaded every time a request has been sent from the user. Celery loads the model in the main process and do prediction in its sub-process(i.e the worker) and this leads to a race condition since the process is not fork-safe.
So, we are shifting to RabbitMQ and it works well with that.

For more details, see this celery/celery#3402

Internal Server Error

I built the code using the given instructions but used conda environment.
I get Internal Server Error when loading the site.

Node server log:

[STREAMING] Now streaming realtime logs for [all] processes
[PM2] Spawning PM2 daemon with pm2_home=/root/.pm2
[PM2] PM2 Successfully daemonized
[PM2] Starting /home/user/chat.js in fork_mode (1 instance)
[PM2] Done.
┌──────────┬────┬──────┬─────┬────────┬─────────┬────────┬─────┬──────────┬──────────┐
│ App name │ id │ mode │ pid │ status │ restart │ uptime │ cpu │ mem │ watching │
├──────────┼────┼──────┼─────┼────────┼─────────┼────────┼─────┼──────────┼──────────┤
│ chat │ 0 │ fork │ 21 │ online │ 0 │ 0s │ 25% │ 5.7 MB │ disabled │
└──────────┴────┴──────┴─────┴────────┴─────────┴────────┴─────┴──────────┴──────────┘
 Use `pm2 show <id|name>` to get more details about an app
[TAILING] Tailing last 15 lines for [all] processes (change the value with --lines option)
/root/.pm2/pm2.log last 15 lines:
PM2 | 2017-03-05 09:22:32: Time : Sun Mar 05 2017 09:22:32 GMT+0000 (UTC)
PM2 | 2017-03-05 09:22:32: PM2 version : 2.4.2
PM2 | 2017-03-05 09:22:32: Node.js version : 0.12.5
PM2 | 2017-03-05 09:22:32: Current arch : x64
PM2 | 2017-03-05 09:22:32: PM2 home : /root/.pm2
PM2 | 2017-03-05 09:22:32: PM2 PID file : /root/.pm2/pm2.pid
PM2 | 2017-03-05 09:22:32: RPC socket file : /root/.pm2/rpc.sock
PM2 | 2017-03-05 09:22:32: BUS socket file : /root/.pm2/pub.sock
PM2 | 2017-03-05 09:22:32: Application log path : /root/.pm2/logs
PM2 | 2017-03-05 09:22:32: Process dump file : /root/.pm2/dump.pm2
PM2 | 2017-03-05 09:22:32: Concurrent actions : 1
PM2 | 2017-03-05 09:22:32: SIGTERM timeout : 1600
PM2 | 2017-03-05 09:22:32: ===============================================================================
PM2 | 2017-03-05 09:22:32: Starting execution sequence in -fork mode- for app name:chat id:0
PM2 | 2017-03-05 09:22:32: App name:chat id:0 online

/root/.pm2/logs/chat-error-0.log last 15 lines:
0|chat | Error: Redis connection to redis:6379 failed - connect ECONNREFUSED
0|chat | at RedisClient.on_error (/node_modules/redis/index.js:196:24)
0|chat | at Socket.<anonymous> (/node_modules/redis/index.js:106:14)
0|chat | at Socket.emit (events.js:107:17)
0|chat | at net.js:459:14
0|chat | at process._tickDomainCallback [as _tickCallback] (node.js:381:11)

/root/.pm2/logs/chat-out-0.log last 15 lines:
0|chat | info: socket.io started
0|chat | info: socket.io started
0|chat | info: socket.io started
0|chat | info: socket.io started
0|chat | info: socket.io started
0|chat | info: socket.io started
0|chat | info: socket.io started
0|chat | info: socket.io started
0|chat | info: socket.io started
0|chat | info: socket.io started
0|chat | info: socket.io started
0|chat | info: socket.io started

Redis server log:

1:M 05 Mar 09:22:18.857 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.
1:M 05 Mar 09:22:18.858 # Server started, Redis version 3.2.8
1:M 05 Mar 09:22:18.858 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
1:M 05 Mar 09:22:18.858 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo never > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled.
1:M 05 Mar 09:22:18.858 * DB loaded from disk: 0.000 seconds
1:M 05 Mar 09:22:18.858 * The server is now ready to accept connections on port 6379

Django server logs:

[uWSGI] getting YAML configuration from .travis.yml
*** Starting uWSGI 2.0.13.1 (64bit) on [Sun Mar 5 09:33:03 2017] ***
compiled with version: 4.8.4 on 05 March 2017 06:21:02
os: Linux-3.13.0-77-generic #121-Ubuntu SMP Wed Jan 20 10:50:42 UTC 2016
nodename: 130927e3cc85
machine: x86_64
clock source: unix
detected number of CPU cores: 4
current working directory: /CloudCV_Server
detected binary path: /usr/local/bin/uwsgi
!!! no internal routing support, rebuild with pcre support !!!
uWSGI running as root, you can use --uid/--gid/--chroot options
*** WARNING: you are running uWSGI as root !!! (use the --uid flag) *** 
your processes number limit is 524288
your memory page size is 4096 bytes
detected max file descriptor number: 524288
lock engine: pthread robust mutexes
thunder lock: disabled (you can enable it with --thunder-lock)
Python version: 2.7.6 (default, Oct 26 2016, 20:33:43) [GCC 4.8.4]
*** Python threads support is disabled. You can enable it with --enable-threads ***
Python main interpreter initialized at 0x1a3fa80
The -s/--socket option is missing and stdin is not a socket.
Sun Mar 5 09:33:03 2017 - [emperor] curse the uwsgi instance .travis.yml (pid: 69)
Sun Mar 5 09:33:06 2017 - [emperor] removed uwsgi instance .travis.yml

RabbitMQ logs:

=INFO REPORT==== 5-Mar-2017::09:22:27 ===
accepting AMQP connection <0.391.0> (172.17.0.7:51137 -> 172.17.0.3:5672)

Nginx had nothing to display.

Cloud CV setup on Local machine

Hello,
I was able to successfully install and run all the modules in docker.
Now when i am trying to run Classification task I am getting this error

Traceback (most recent call last): File "./app/classify_views.py", line 99, in form_valid self.object = form.save() File "/usr/local/lib/python2.7/dist-packages/django/forms/models.py", line 453, in save self.instance.save() File "./app/models.py", line 133, in save super(Classify, self).save(*args, **kwargs) File "/usr/local/lib/python2.7/dist-packages/django/db/models/base.py", line 796, in save force_update=force_update, update_fields=update_fields) File "/usr/local/lib/python2.7/dist-packages/django/db/models/base.py", line 824, in save_base updated = self._save_table(raw, cls, force_insert, force_update, using, update_fields) File "/usr/local/lib/python2.7/dist-packages/django/db/models/base.py", line 908, in _save_table result = self._do_insert(cls._base_manager, using, fields, update_pk, raw) File "/usr/local/lib/python2.7/dist-packages/django/db/models/base.py", line 947, in _do_insert using=using, raw=raw) File "/usr/local/lib/python2.7/dist-packages/django/db/models/manager.py", line 85, in manager_method return getattr(self.get_queryset(), name)(*args, **kwargs) File "/usr/local/lib/python2.7/dist-packages/django/db/models/query.py", line 1045, in _insert return query.get_compiler(using=using).execute_sql(return_id) File "/usr/local/lib/python2.7/dist-packages/django/db/models/sql/compiler.py", line 1054, in execute_sql cursor.execute(sql, params) File "/usr/local/lib/python2.7/dist-packages/django/db/backends/utils.py", line 79, in execute return super(CursorDebugWrapper, self).execute(sql, params) File "/usr/local/lib/python2.7/dist-packages/django/db/backends/utils.py", line 64, in execute return self.cursor.execute(sql, params) File "/usr/local/lib/python2.7/dist-packages/django/db/utils.py", line 94, in exit six.reraise(dj_exc_type, dj_exc_value, traceback) File "/usr/local/lib/python2.7/dist-packages/django/db/backends/utils.py", line 64, in execute return self.cursor.execute(sql, params) File "/usr/local/lib/python2.7/dist-packages/django/db/backends/sqlite3/base.py", line 337, in execute return Database.Cursor.execute(self, query, params) OperationalError: no such table: app_classify

Am i missing something here. Can someone help please?

Issue with run_server on OSX

Running run_server.sh fails on OSX, for a couple of reasons:

  1. The -P flag needs to be passed to expose ports from the container to the localhost as explained here.
  2. With sudo applied, it fails with the error Cannot connect to the Docker daemon. Is the docker daemon running on this host? - not sure why this happens.

With both these fixed, it works fine (at the address of the default VM, not localhost).

If CloudCV is supported on OSX, we should add Mac specific instructions in the README. I can submit a PR for this, if required.

`BooleanField` does not have a default value

After I issue the migrate command I get the following warning:

System check identified some issues:

WARNINGS:
app.CloudCV_Users.is_active: (1_6.W002) BooleanField does not have a default value.
    HINT: Django 1.6 changed the default value of BooleanField from False to None. See https://docs.djangoproject.com/en/1.6/ref/models/fields/#booleanfield for more information.
app.RequestLog.isDropbox: (1_6.W002) BooleanField does not have a default value.
    HINT: Django 1.6 changed the default value of BooleanField from False to None. See https://docs.djangoproject.com/en/1.6/ref/models/fields/#booleanfield for more information.

A fix would be to provide default values to BooleanFields.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.