https://www.bencode.io/tags/etl/ Recent content in Etl on Benny Simmonds Hugo -- 0.149.1 en-us Fri, 07 Dec 2018 20:51:10 +0000 https://www.bencode.io/posts/2018-12-07-logstash/ Fri, 07 Dec 2018 20:51:10 +0000 https://www.bencode.io/posts/2018-12-07-logstash/ <p>A quick walkthrough of Logstash, the ETL engine offered by the Elastic Stack.</p> <blockquote> <p>Logstash is an open source, server-side data processing pipeline that ingests data from a multitude of sources simultaneously, transforms it, and then sends it to your favorite <strong>stash</strong></p></blockquote> <p>Logstash gained its initial popularity with log and metric collection, such as <code>log4j</code> logs, Apache web logs and <code>syslog</code>. Its application has broadened, to all kinds of data sources like large scale event streams, webhooks, database and message queue integration. Once data is transformed and cleaned up is routed to a final destination (i.e. the stash), Elasticsearch is one option, but lots of other choices are there (mongo, S3, Nagios, IRC, email).</p>