aws-big-data-projects / log-analytics-solution-with-aws

Collect, process, and analyze log data using Amazon Kinesis and Elasticsearch Service

Log-Analytics-Solution

Collect, process, and analyze log data using Amazon Kinesis and Elasticsearch Service

 Step 1: Set Up Prerequisites

 Create an AWS Account

 Start an EC2 Instance

 Prepare Your Log Files

To create a continuous stream of log file data on your EC2 instance, download, install, and run the Fake Apache Log Generator from Github.

 Step 2: Create an Amazon Kinesis Firehose Delivery Stream

 Step 3: Install and Configure the Amazon Kinesis Agent

To install the agent, see Download and Install the Agent.[http://docs.aws.amazon.com/firehose/latest/dev/writing-with-agents.html#download-install]

 Step 4: Create an Amazon Elasticsearch Service Domain

 Step 5: Create a Second Amazon Kinesis Firehose Delivery Stream

 Step 6: Create an Amazon Kinesis Analytics Application

 Step 7: View the Aggregated Streaming Data

 Step 8: Clean Up

link to access the tutorial[https://d1.awsstatic.com/Projects/P4113850/aws-projects_build-log-analytics-solution-on-aws.pdf]

log-analytics-solution-with-aws's Issues

create a continuous stream of log file data-revised

View the Aggregated Streaming Data-after updating new features