mozilla / emr-bootstrap-presto

AWS bootstrap scripts for Mozilla's flavoured Presto setup.

emr-bootstrap-presto

This repo contains the CloudFormation templates and bootstrap scripts for setting up Mozilla's Presto cluster.

Prerequisites

• ansible >= 2.2.0.0
• boto
• boto3

Creating Stacks

Metastore

ansible-playbook \
  playbooks/metastore.yml \
  -e @envs/dev.yml \
  -e owner=<yourname>@mozilla.com

Presto

ansible-playbook \
  playbooks/presto.yml \
  -e @envs/dev.yml \
  -e owner=<yourname>@mozilla.com

Deploying Bootstrap Scripts

ansible-playbook \
  playbooks/bootstrap.yml \
  -e @envs/dev.yml

Modifying Variables

Besides the owner variable specified when creating the stack, everything lives in vars/default.yml and envs/<env>.yml. Any of these can be overridden at runtime by using the -e flag just as you did with owner.

emr-bootstrap-presto's Issues

Persto 0.157.1 in EMR is facing issues regarding client side encryption AWS KMS Master Key

I am getting NULL values in all the rows in result set in presto client in using s3 partitions.

1. Data is stored in the S3 in the encripted form(client side encription) using AWS KMS master key.
2. EMR Hive is able to decrypt the S3 data on select query.
3. We have done below listed settings in the Presto.hive.properties but it is returning null values(screenshot is attached) against all the rows on making select [query.]

Your help will be really appreciable.
Gaurav

Wiki changes

FYI: The following changes were made to this repository's wiki:

• defacing spam has been removed

• Restricting write access to contributors is strongly encouraged. Please make that change (documentation).

These were made as the result of a recent automated defacement of publically writeable wikis.

CODE_OF_CONDUCT.md file missing

As of January 1 2019, Mozilla requires that all GitHub projects include this CODE_OF_CONDUCT.md file in the project root. The file has two parts:

1. Required Text - All text under the headings Community Participation Guidelines and How to Report, are required, and should not be altered.
2. Optional Text - The Project Specific Etiquette heading provides a space to speak more specifically about ways people can work effectively and inclusively together. Some examples of those can be found on the Firefox Debugger project, and Common Voice. (The optional part is commented out in the raw template file, and will not be visible until you modify and uncomment that part.)

If you have any questions about this file, or Code of Conduct policies and procedures, please see Mozilla-GitHub-Standards or email [email protected].

(Message COC001)