kojiisd / aws-lambda-athena Goto Github PK

View Code? Open in Web Editor NEW

24.0 24.0 13.0 14.84 MB

Java 100.00%

aws-lambda-athena's People

Contributors

Stargazers

Watchers

Forkers

veronicamacovei greenmangaming chaosoldier expebdodla jonathanmv prashant81 adim codeat raja14 gauravlanjekar lamguy thomcost fujya

aws-lambda-athena's Issues

Failed to build project

Hello,

I'm trying to run Athena queries trough AWS Lambda and I found your project very interesting, but I'm having some trouble to generate the jar file.

When I run mvn clean package I get the following errors:

[INFO] Scanning for projects...
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for jp.gr.java_conf.kojiisd:lambda-athena:jar:1.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-install-plugin is missing. @ line 59, column 21
[WARNING] 
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING] 
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING] 
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building lambda-athena 1.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[WARNING] The POM for com.amazonaws:aws-lambda-athena:jar:1.0 is missing, no dependency information available
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 0.550 s
[INFO] Finished at: 2017-03-20T16:31:51+01:00
[INFO] Final Memory: 9M/240M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project lambda-athena: Could not resolve dependencies for project jp.gr.java_conf.kojiisd:lambda-athena:jar:1.0-SNAPSHOT: Failure to find com.amazonaws:aws-lambda-athena:jar:1.0 in https://repo.maven.apache.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException

I'm building the Jar file using Java 1.8.0_121 and Maven 3.3 under Ubuntu Linux.

Thanks,

Outdated options

When running "mvn clean package", the following error is generated.

[ERROR] COMPILATION ERROR :
[INFO] -------------------------------------------------------------
[ERROR] Source option 5 is no longer supported. Use 6 or later.
[ERROR] Target option 1.5 is no longer supported. Use 1.6 or later.
[INFO] 2 errors

java.lang.ClassNotFoundException: com.amazonaws.athena.jdbc.AthenaDriver

Hi Koji,

Thank you for sharing this code. I've created many lambda functions before but using the node runtime, so maybe I'm facing an obvious error for an experimented aws java lambda function developer.

I'm trying to query athena using the lambda code you shared. Here's what I've done:

Cloned your repo
Updated config/credentials file
Ran mvn clean package
Created a java 8 lambda function with 256mb of memory and 1 minute of timeout. The handler is jp.gr.java_conf.kojiisd.lambdaathena.LambdaAthenaOperator::handleRequest. The jar that I uploaded was the one named lambda-athena-1.0-SNAPSHOT-jar-with-dependencies.jar which was created in the target folder by the mvn clean package command.
Configured a test event in the lambda based on your input sample
Test the lambda.

I'm getting a java.lang.ClassNotFoundException: com.amazonaws.athena.jdbc.AthenaDriver error. I researched about how to include custom jars in the package deployed to the lambda. I tried using a different plugin (shade). I tried creating a zip file. And some others I can't recall right now. None of these methods worked.

Is there something I'm missing? maybe a configuration in the pom or a different way to create the jar?

Thanks again Koji

lambda use Athena

Hi，I want to use Lambda to create Athena partition through JDBC, so by using this project , could I realise the function what I have mentioned above.

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.

Jobs

Jooble