Setup a centralised logging solution

[bhavikkumar]

There is many ways to do this but the first way to try out is to make use of a stream solution such as described in the following links:

• https://aws.amazon.com/blogs/architecture/central-logging-in-multi-account-environments/
• https://www.accenture.com/us-en/blogs/blogs-kiran-gekkula-vpc-flow-logs-analysis-aws
• https://blend.com/blog/community/engineering/centralizing-logs-aws/

If the costs of the streaming solution is too expensive then we should look at a more traditional logging solution which might translate into us managing our own infrastructure.

Regardless of the solution all logs should be in SumoLogic and a S3 bucket with lifecycle policies

[bhavikkumar]

Part of this has been completed in commit 47e02d4.

The remaining item is to send it to SumoLogic from the Kinesis stream using a Lambda function.

[bhavikkumar]

In addition to sending logs to SumoLogic, we also need to store them in a S3 bucket since SumoLogic and Kinesis only hold the data for a limited time.