Data Engineer

This is a fully remote position, open to applicants in District of Columbia, +1 more state.

📋 Description

• Pipeline Architect: Create, develop, and sustain scalable end-to-end data pipelines utilizing Databricks, Spark, and related technologies.

• Transformation Titan: Construct efficient data processing and transformation workflows to cater to analytics and reporting requirements.

• Integration Hero: Consolidate various data sources, including APIs, databases, and cloud storage, into cohesive datasets.

• Collaboration Champion: Collaborate closely with cross-functional teams (data science, analytics, business units) to design and implement data solutions that align with organizational objectives.

• Quality Guardian: Establish comprehensive validation, monitoring, and observability processes to ensure the accuracy, completeness, and reliability of data.

• Automation Avenger: Engage in data governance, security, and automation initiatives within the data ecosystem.

• Cloud Commander: Utilize AWS services (e.g., S3, Glue, Lambda, Redshift) to build and implement data solutions in a cloud-native setting.

⛳️ Requirements

• Proficiency with cloud-based ETL services (e.g., AWS Glue, Google Cloud Dataflow, Azure Data Factory).

• Familiarity with cloud data warehousing technologies (e.g., Amazon Redshift, Google BigQuery, Snowflake).

• Experience in Python, SQL, Spark, and PySpark.

• Knowledge of data platforms such as Databricks, Palantir, and Snowflake.

• Understanding of data orchestration and data quality methodologies.

• Must be a US Citizen.

🏝️ Benefits

• Health insurance.

• 401(k) matching.

• Flexible work hours.

• Paid time off.

• Remote work options.