DevOps.com

  • Latest
    • Articles
    • Features
    • Most Read
    • News
    • News Releases
  • Topics
    • AI
    • Continuous Delivery
    • Continuous Testing
    • Cloud
    • Culture
    • DevSecOps
    • Enterprise DevOps
    • Leadership Suite
    • DevOps Practice
    • ROELBOB
    • DevOps Toolbox
    • IT as Code
  • Videos/Podcasts
    • DevOps Chats
    • DevOps Unbound
  • Webinars
    • Upcoming
    • On-Demand Webinars
  • Library
  • Events
    • Upcoming Events
    • On-Demand Events
  • Sponsored Communities
    • AWS Community Hub
    • CloudBees
    • IT as Code
    • Rocket on DevOps.com
    • Traceable on DevOps.com
    • Quali on DevOps.com
  • Related Sites
    • Techstrong Group
    • Container Journal
    • Security Boulevard
    • Techstrong Research
    • DevOps Chat
    • DevOps Dozen
    • DevOps TV
    • Digital Anarchist
  • Media Kit
  • About
  • AI
  • Cloud
  • Continuous Delivery
  • Continuous Testing
  • DevSecOps
  • Leadership Suite
  • Practices
  • ROELBOB
  • Low-Code/No-Code
  • IT as Code
  • More
    • Application Performance Management/Monitoring
    • Culture
    • Enterprise DevOps

Home » Blogs » Local DevOps » DevOpsQA NJ Meetup – ELK Stack

DevOpsQA NJ Meetup – ELK Stack

By: Tanya Kravtsov on May 15, 2015 Leave a Comment

Our guest speaker at the May DevOpsQA NJ Meetup was Peter Kim from Elastic.  Peter  is a Solutions Architect at Elastic with over 10 years of experience architecting and developing search applications with Endeca, MarkLogic and core Lucene.  He gave us a great overview of ELK Stack, which consists of ElasticSearch, LogStash and Kibana.

Recent Posts By Tanya Kravtsov
  • DevOpsQA NJ Meetup – Test Automation Tech Talk
  • DevOpsQA NJ Meetup: Jenkins with Gerrit and BDD Automation
  • DevOpsQA NJ Meetup: Pipeline Patterns with ThoughtWorks
More from Tanya Kravtsov
Related Posts
  • DevOpsQA NJ Meetup – ELK Stack
  • Best of 2018: Log Monitoring and Analysis: Comparing ELK, Splunk and Graylog
  • Top Six Open Source Tools for Monitoring Kubernetes and Docker
    Related Categories
  • Blogs
  • Local DevOps
    Related Topics
  • elasticsearch
  • logstash
Show more
Show less

In summary,  ELK Stack is an end-to-end stack that delivers real-time insights into data from almost any type of structured and unstructured data sources.  It was designed to address the issues of inconsistent log formats,  log distribution across servers as well as high level of expertise required to understand the log outputs.   ELK Stack provides open source integration with configuration management tools like Chef, Puppet and Ansible as well as a connector for Hadoop.

DevOps Connect:DevSecOps @ RSAC 2022

Peter then extensively discussed each component of ELK stack.  Logstash manages events logs,  by collecting, parsing and storing data.  It is fully open source with the Apache 2.0 license .  Grok is a tool that can be used to parse unstructured data into something structured and queryable. logstash_logo

ElasticSearch is schema-free, REST & JSON based document store.  It’s every function is exposed via REST APIs.  ElasticSearch is distributed and horizontally scalable, comes with a log of plugins for analysis,  localization support, etc and client API for various programming languages.

Kibana is a data visualization and analytics platform integrated with ElasticSearch .  Peter gave a live demo of Kibana with Apache weblog data.

The session  was followed by a lot of good questions ranging from security,  real-time data to the fuzzy search and complex aggregations.  At the end,  Peter told us about Elastic Roadmap including Watcher for alerting and new  features which are coming out as part of ElasticSearch 2.0.

If you are interested to learn more about Elastic,  you can reach out to Peter at [email protected]

Special thanks to IshiSystems  (http://www.ishisystems.com/)  for sponsoring the venue.

Join us at our next meetup by signing up at  http://www.meetup.com/DevOpsandAutomationNJ/  or follow on Twitter @DevOpsQA

logo-elastic

Filed Under: Blogs, Local DevOps Tagged With: elasticsearch, logstash

Sponsored Content
Featured eBook
The Automated Enterprise

The Automated Enterprise

“The Automated Enterprise” e-book shows the important role IT automation plays in business today. Optimize resources and speed development with Red Hat® management solutions, powered by Red Hat Ansible® Automation. IT automation helps your business better serve your customers, so you can be successful as you: Optimize resources by automating ... Read More
« Webinar: Using Jenkins & XebiaLabs Software to Ensure Quality in Continuous Delivery
Survey: Fed gov cloud success hinges on DevOps »

TechStrong TV – Live

Click full-screen to enable volume control
Watch latest episodes and shows

Upcoming Webinars

Continuous Deployment
Monday, July 11, 2022 - 1:00 pm EDT
Using External Tables to Store and Query Data on MinIO With SQL Server 2022
Tuesday, July 12, 2022 - 11:00 am EDT
Goldilocks and the 3 Levels of Cardinality: Getting it Just Right
Tuesday, July 12, 2022 - 1:00 pm EDT

Latest from DevOps.com

Rust in Linux 5.20 | Deepfake Hiring Fraud | IBM WFH ‘New Normal’
June 30, 2022 | Richi Jennings
Moving From Lift-and-Shift to Cloud-Native
June 30, 2022 | Alexander Gallagher
The Two Types of Code Vulnerabilities
June 30, 2022 | Casey Bisson
Common RDS Misconfigurations DevSecOps Teams Should Know
June 29, 2022 | Gad Rosenthal
Quick! Define DevSecOps: Let’s Call it Development Security
June 29, 2022 | Don Macvittie

Get The Top Stories of the Week

  • View DevOps.com Privacy Policy
  • This field is for validation purposes and should be left unchanged.

Download Free eBook

The Automated Enterprise
The Automated Enterprise

Most Read on DevOps.com

What Is User Acceptance Testing and Why Is it so Important?
June 27, 2022 | Ron Stefanski
Chip-to-Cloud IoT: A Step Toward Web3
June 28, 2022 | Nahla Davies
DevOps Connect: DevSecOps — Building a Modern Cybersecurity ...
June 27, 2022 | Veronica Haggar
Rust in Linux 5.20 | Deepfake Hiring Fraud | IBM WFH ‘New No...
June 30, 2022 | Richi Jennings
Common RDS Misconfigurations DevSecOps Teams Should Know
June 29, 2022 | Gad Rosenthal

On-Demand Webinars

DevOps.com Webinar ReplaysDevOps.com Webinar Replays
  • Home
  • About DevOps.com
  • Meet our Authors
  • Write for DevOps.com
  • Media Kit
  • Sponsor Info
  • Copyright
  • TOS
  • Privacy Policy

Powered by Techstrong Group, Inc.

© 2022 ·Techstrong Group, Inc.All rights reserved.