Databricks Consultant – Part-Time

This is a fully remote position, open to applicants in United States.

📋 Description

• Spearhead the design and creation of a prototype dashboard based on Databricks, converting requirements developed by economists, along with data models, KPIs, and analytical use cases, into actionable technical solutions.

• Design and execute scalable workflows for data ingestion, transformation, integration, and quality control, focusing on broadband, demographic, economic, labor, and geographic datasets.

• Create interactive dashboard features that enable map visualizations, geographic comparisons, trend analysis, filters, KPI summaries, socioeconomic indicators, and outputs that can be downloaded.

• Construct and sustain structured analytical datasets utilizing Python, SQL, Spark/PySpark, Delta Lake, and Databricks workflows.

• Ensure the maintenance of metadata, lineage, versioning, and reproducibility for analytical datasets.

• Convert program and policy inquiries into technically viable data products, visualizations, queries, and reusable analytical workflows.

• Design and evaluate AI-assisted natural-language querying or data discovery functionalities against curated public datasets and associated metadata.

• Prioritize source-grounded responses, transparency, and safeguards to prevent unsupported inferences.

• Document system architecture, data pipelines, schemas, transformation logic, data dictionaries, code/configuration artifacts, dependencies, and deployment processes.

• Fulfill Corner Alliance’s commitments to Deliver, Grow, and Thrive.

⛳️ Requirements

• A Bachelor's degree or higher in Computer Science, Data Engineering, Data Science, Information Systems, Software Engineering, Geographic Information Science, or a related technical discipline.

• Over 5 years of experience in data engineering, analytics engineering, software development, business intelligence, or similar technical roles.

• Proven hands-on experience in developing production or prototype solutions using Databricks.

• Strong expertise in Python and SQL.

• Experience with Spark/PySpark and large structured datasets.

• Background in designing and implementing ETL/ELT pipelines, data transformations, data-quality controls, and reusable analytical datasets.

• Demonstrated experience creating interactive analytical dashboards, data applications, or business intelligence solutions derived from integrated datasets.

• Familiarity with Git and modern software development practices, including code reviews, testing, documentation, and collaborative development.

• Capability to translate analyst, economist, program, and stakeholder requirements into functional technical designs and operational capabilities.

• Proficiency in communicating technical decisions, limitations, and dependencies effectively to both technical and non-technical stakeholders.

• Strong analytical, problem-solving, documentation, and cross-functional collaboration abilities.

• U.S. citizenship or permanent residency is required.

• Must be able to pass a public trust clearance or suitability determination.

🏝️ Benefits

• 401k matching (4%).

• PTO (3 weeks to start, 4 weeks after 2-5 years, and 5 weeks after 5 years+).

• Health insurance.

• Dental insurance.

• Vision insurance.

• Short-term disability coverage.

• Long-term disability coverage.

• FSA accounts.

• 4 weeks of paid parental leave.

• 11 paid holidays (including a day off for your birthday).

• Fitness reimbursements.

• Cell phone reimbursements.

• Monthly all-hands update meetings.

• Annual in-person all-hands team building day and evening outing.

• Regular check-ins to discuss professional growth goals.

• Semi-monthly one-on-one performance manager meetings.

• Monthly social team events.

• Technology such as Slack to enhance connectivity and collaboration.

• A company culture committed to fostering a highly engaged team.