Setup for AWS centralised logging

What will be a better setup for centralised logging(application logs) for multiple instances(rails apps) running behind an AWS application load balancer?

- ELK (manual setup)
- AWS ElasticSearch
- APN (AWS Partner Networks) like datadog, spluk

Comments

[Samuel Abreu]

Why not cloudwatch?

[Dharshan Bharathuru]

I'm using cloudwatch for different system/app metric alarms now. Didn't know it can also be used for centralised logging. Any useful link/writeup you like to share?

[Samuel Abreu]

Never used but i think it's easy to integrate with third party logging services, for example (splunk.com/blog/2017/02/03/how-to-...)

[Shenril]

I would go with the official documentation
docs.aws.amazon.com/AmazonCloudWat...

You basically watch file and send them into streams

As good as it is for central logging, I still find the UI and search functionalities really poor compared to the other solutions you mentioned

[Belyn]

Full disclosure, I work for Elastic (we make Elasticsearch).

You could also try Elasticsearch Service with the Elastic Stack 6.6 (Logs UI, Hot/Warm + index curation + APM server).

Here's a link our users find helpful: elastic.co/cloud/elasticsearch-ser...