Data Engineer Job at Brooksource, Cincinnati, OH

aThtVllMWk9vQ29wTXM0Tk00Tng2OGtmbWc9PQ==
  • Brooksource
  • Cincinnati, OH

Job Description

Location: Cincinnati, OH or Blue Ash, OH (Must)

The Logging & Data Ingestion Engineer will play a pivotal role in optimizing log ingestion, parsing, and analytics using CRIBL and other observability tools. The ideal candidate will have extensive experience in managing logs across multiple cloud platforms, tuning ingestion pipelines, and working with APIs to ensure seamless data flow and analysis.

Key Responsibilities:

  • Design, implement, and optimize log ingestion pipelines utilizing CRIBL and other log management tools.
  • Develop and maintain log parsing strategies to improve searchability and analysis.
  • Work with APIs to ingest, transform, and route log data efficiently.
  • Optimize log formats and ingestion performance across AWS, Azure, and Google Cloud environments.
  • Ensure effective log retention, storage, and compliance with security standards.
  • Collaborate with DevOps, Security, and Application teams to enhance observability and troubleshooting capabilities.
  • Monitor logging infrastructure for performance issues and propose enhancements.
  • Provide expertise in log-based alerting and monitoring strategies.

Required Qualifications:

  • 3+ years of experience in log ingestion, parsing, and management.
  • Strong expertise in CRIBL , log formatting, and log tuning.
  • Experience working with logging and monitoring tools (e.g., Splunk, ELK, Datadog, New Relic).
  • Proficiency in working with APIs for log ingestion and transformation.
  • Hands-on experience with AWS, Azure, and Google Cloud logging services.
  • Understanding of data pipelines and streaming log architectures.
  • Knowledge of security and compliance requirements for log management.
  • Strong problem-solving and analytical skills with a focus on performance optimization.

Preferred Qualifications:

  • Experience with scripting languages (e.g., Python, Bash) for automation.
  • Familiarity with Kubernetes, containers, and microservices architecture.
  • Certification in cloud platforms (AWS, Azure, GCP) is a plus.

Job Tags

Similar Jobs

Baker Construction

Concrete Laborer Job at Baker Construction

Performs general labor work within the following areas: Supply Chain Logistics Tracks and escorts deliveries Inspects quality of materials and signs tickets Maintains barcode tags for inventory control Maintains dumpstersE,H&S Maintains hydration and sanitation...

Maverick FX

Remote FX Trader Job at Maverick FX

 ...Maverick Currencies is looking for people with an entrepreneurial spirit and a profit-driven mindset to trade cryptocurrency and stock options on behalf of the firm. Our traders keep 70% to 80% of their profits and get to learn how to profitably trade cryptocurrency.... 

SW North America, Inc.

Field Service Technician Job at SW North America, Inc.

 ...impressive range of 2- and 4-spindle horizontal machining centers. About the Role - The Service Technician is responsible for, among other things, the maintenance, repair, service, and installation of CNC milling machining centers as well as assisting our customers in... 

BHE Renewables, LLC

EMS Analyst 3 Job at BHE Renewables, LLC

 ...Job Description: The EMS Analyst 3 provides support for software and hardware development, implementation and maintenance for all...  ...software and computer operating system software Effective analytical, problem-solving and decision-making skills to recognize patterns... 

Royal Oak Health Group

Gastroenterology Physician Assistant Needed 30 Min from Phoenix AZ Job at Royal Oak Health Group

 ...employer located 30 minutes from Phoenix, AZ is looking to hire a Physician Assistant. This is a full-time opportunity for a Physician Assistant with a minimum of one year of experience in Gastroenterology post-PA training. Essential Functions of the Position:...