Data Pipeline Engineer, Junior – Mid

This is a fully remote position, open to applicants in District of Columbia.

📋 Description

• Develop, configure, and manage data ingestion processes that extract information from Armis, Axonius, and various API sources into Elasticsearch, guided by senior engineers.

• Create and uphold ingestion and transformation scripts (e.g., Python) alongside Logstash and ingest-pipeline configurations.

• Oversee pipeline performance, troubleshoot failures, and examine issues related to data quality and freshness.

• Aid in the creation and modification of Elasticsearch mappings and Kibana dashboards and visualizations.

• Conduct data validation and reconciliation checks between source platforms and Elasticsearch, while assisting in the upkeep of data lineage documentation.

• Assist with routine maintenance tasks such as credential/token rotation, index cleaning, and retention activities.

• Contribute code and configuration updates via Git and CI/CD, adhering to team protocols.

⛳️ Requirements

• US citizenship with eligibility to obtain Public Trust Suitability.

• Bachelor's degree in Computer Science, Information Systems, or a relevant field.

• 1 to 3 years of experience in data engineering, software development, systems or data analysis, or a closely related position (strong internship, lab, or academic project experience will be considered).

• Proficiency in scripting with Python (or a similar language) for data manipulation and automation.

• Understanding of relational or NoSQL data concepts and fundamental data modeling.

• Experience with Elasticsearch/OpenSearch or any other search/analytics platform, or a proven capacity to learn quickly.

• Familiarity with REST APIs and handling JSON data.

• Knowledge of Git and the basics of version control.

🏝️ Benefits

• Highly competitive salary and top-tier benefits.

• SERVISS covers 100% of medical, vision, dental, and life insurance premiums.

• Opportunities for annual performance bonuses and growth incentives.

• 401(k) retirement plan with a 6% dollar-for-dollar match.