Data Operations Engineer Principal

We are seeking a Data Operations Engineer to design, build, and maintain real-time and near-realtime data ingestion pipelines supporting a mission-critical system and moves data across security domains using cross domain solutions (CDS) / guards.

You will be responsible for the reliable flow of streaming data from a wide range of sources into our data platform, ensuring data quality, observability, and scalability.

You'll partner closely with data engineers, platform engineers, analytics teams, and security/governance personnel to deliver trustworthy, low-latency data that supports operational decisions — while ensuring compliance with cross-domain and data classification requirements.

This position is on-site in Honolulu, HI.

• Aid the team in delivering continual data feeds to users and monitoring the health of data quality and overall data ingest.
• Design, build, and maintain resilient real-time/near-realtime ingestion pipelines using Apache NiFi and REST APIs, with appropriate backpressure, prioritization, retries, and error-handling strategies.
• Configure and monitor data flows moving across security domains via cross domain guards/solutions, ensuring data integrity and compliance with transfer policies.
• Parse, transform, validate, and route structured and unstructured data in a variety of formats, including Excel, CSV, JSON, and XML.
• Employ data manipulation and visualization tools (e.g., Grafana, Prometheus) to effectively convey pipeline status, data quality, and historical trends to leadership, users, and the data team.
• Collaborate with platform, software, and other data engineers to (re)configure and continuously improve data ingestion pipeline reliability.
• Develop and maintain software/scripts to automate monitoring of real-time feeds and alert on timeliness, volume, lineage, and distribution data issues.
• Translate learnings from historical pipeline data into actionable steps to improve data ingest reliability and performance.
• Partner with security and governance teams to enforce encryption, authentication, authorization, and data classification requirements across pipelines and cross-domain transfers.
• Write and maintain scripts (Python, Bash, or similar) to automate data processing, validation, and monitoring tasks.
• Document data flows, system configurations, and standard operating procedures.