Data Engineer 5, Tech

This is a fully remote position, open to applicants in Virginia.

📋 Description

• Work in collaboration with Agile teams to design, develop, test, implement, and provide support for technical solutions.

• Influence developers, data analysts, and data scientists in areas including machine learning, distributed microservices, lakehouse architecture, and full-stack systems.

• Utilize Python and Spark, along with open-source relational and NoSQL databases, Databricks, and Snowflake.

• Stay abreast of data trends, experiment with emerging technologies, engage in technology communities, and mentor data professionals.

• Partner with product managers and software engineers to deliver cloud-first data solutions.

• Take ownership of designing, building, and delivering cloud data solutions and applications independently.

• Architect and enforce data engineering design patterns across various platforms and pipelines.

• Effectively communicate technical concepts and data outcomes to both internal and external stakeholders.

• Design and construct scalable, resilient, and operationally efficient data pipelines and platforms.

• Provide mentorship to peers and junior engineers while contributing hands-on technical expertise.

• Lead large-scale data initiatives from inception to completion, making architectural decisions and evaluating platforms such as Snowflake versus Databricks.

⛳️ Requirements

• A Bachelor’s Degree or higher in Computer Science or a related quantitative field.

• Minimum of 6 years of experience in application development; internship experience is not applicable.

• At least 4 years of experience working with distributed data.

• At least 4 years of experience with SQL.

• Minimum of 4 years of programming experience using Python, Java, or Scala.

• A minimum of 4 years of experience in designing and developing data pipelines.

• At least 2 years of experience in data modeling and creating end-to-end data solutions using both relational and non-relational database systems.

• Capital One is open to sponsoring a new qualified applicant for employment authorization.

• Preferred: A Master’s Degree in Computer Science or a related field.

• Preferred: Over 8 years of experience in data engineering.

• Preferred: More than 4 years of data modeling experience.

• Preferred: At least 9 years of application development experience with Python, SQL, Scala, or Java.

• Preferred: More than 5 years of experience with AWS, Microsoft Azure, or Google Cloud.

• Preferred: Over 5 years of experience with EMR, Spark, Glue, or Databricks.

• Preferred: More than 5 years of experience in designing, implementing, and operating real-time or streaming data pipelines.

• Preferred: At least 3 years of experience with data observability or orchestration tools such as Monte Carlo, Splunk, Airflow, or Dagster.

• Preferred: Over 5 years of experience with unstructured or semi-structured data using NoSQL databases like MongoDB, Cassandra, or DynamoDB.

• Preferred: More than 5 years of experience in designing and supporting data warehousing solutions such as Snowflake or Redshift.

• Preferred: At least 3 years of experience in an Agile development environment.

• Preferred: Over 3 years of experience in developing user-centric reusable data products.

🏝️ Benefits

• Performance-based incentive compensation, which may include cash bonuses and/or long-term incentives (LTI).

• A comprehensive and competitive health, financial, and other benefits package supporting overall well-being.

• Reasonable accommodations available for applicants who require them.