mapr / mapr-demos Goto Github PK

Great repo! Loved the video (https://youtu.be/wIWp8lnj7UE); however, at the 5:25 mark of the linked video, you said you made some views. Could you are your data scientist upload to the repo the .sql steps s/he used to create said views? Thanks! Andy

I am using spark 2.0.1 will these steps still work?
the following command fails, I can see out put of Stage 7 then it disappears and I have to kill the program:
/opt/mapr/spark/spark-2.0.1/bin/spark-submit ./rt_profile_dash.py

[mapr@ae0 spark_music_demo]$ /opt/mapr/spark/spark-2.0.1/bin/spark-submit ./rt_profile_dash.py
^CTraceback (most recent call last):
File "/mapr/my.cluster.com/user/mapr/spark_music_demo/./rt_profile_dash.py", line 95, in
clicked = 1 if sortedclicks.lookup(k)[0] > 0 else 0
File "/opt/mapr/spark/spark-2.0.1/python/lib/pyspark.zip/pyspark/rdd.py", line 2209, in lookup
File "/opt/mapr/spark/spark-2.0.1/python/lib/pyspark.zip/pyspark/context.py", line 933, in runJob
File "/opt/mapr/spark/spark-2.0.1/python/lib/py4j-0.10.3-src.zip/py4j/java_gateway.py", line 1131, in call
File "/opt/mapr/spark/spark-2.0.1/python/lib/py4j-0.10.3-src.zip/py4j/java_gateway.py", line 883, in send_command
File "/opt/mapr/spark/spark-2.0.1/python/lib/py4j-0.10.3-src.zip/py4j/java_gateway.py", line 1028, in send_command
File "/usr/lib64/python2.7/socket.py", line 447, in readline
data = self._sock.recv(self._rbufsize)
File "/opt/mapr/spark/spark-2.0.1/python/lib/pyspark.zip/pyspark/context.py", line 223, in signal_handler
KeyboardInterrupt

Hi,

I am getting below error when I am trying to run the rt_profile_dash.py, Please can you let me know what I am doing wrong here.

[user01@maprdemo spark_music_demo]$ /opt/mapr/spark/spark-1.3.1/bin/spark-submit ./rt_profile_dash.py
Traceback (most recent call last):
File "/user/user01/mapr/spark_music_demo/./rt_profile_dash.py", line 125, in
'adata:mobile_tracks': str(aggdata.mean()[5]) })
File "/usr/lib/python2.6/site-packages/happybase/table.py", line 439, in put
batch.put(row, data)
File "/usr/lib/python2.6/site-packages/happybase/batch.py", line 132, in exit
self.send()
File "/usr/lib/python2.6/site-packages/happybase/batch.py", line 55, in send
self._table.connection.client.mutateRows(self._table.name, bms, {})
File "/usr/lib/python2.6/site-packages/happybase/hbase/Hbase.py", line 1576, in mutateRows
self.recv_mutateRows()
File "/usr/lib/python2.6/site-packages/happybase/hbase/Hbase.py", line 1599, in recv_mutateRows
raise result.io
happybase.hbase.ttypes.IOError: IOError(_message=None)