Data Solutions Architect – Financial Services

This is a fully remote position, open to applicants in United States, +3 more countries.

📋 Description

• Act as a reliable advisor regarding clients' data engineering and architecture strategies, emphasizing Databricks solutions.

• Develop, construct, and implement comprehensive data solutions for AI, ML, and business intelligence projects.

• Collaborate with sales teams to showcase technical solutions and highlight SunnyData's offerings to potential clients.

• Oversee multiple customer accounts while providing updates on progress and results.

• Design solutions adhering to best practices in governance, security, and data quality.

• Assess data sources and suggest inclusion strategies to enhance analytics.

• Support internal teams, mentor project members, and educate end users about data products and analytic environments.

• Evaluate systems, identify data and system defects, and implement necessary fixes.

• Validate data movement, transformation code, and data components for accuracy and reliability.

• Direct technical execution and presales support, equally dividing time between both domains.

⛳️ Requirements

• Over 7 years of experience as a hands-on Solutions Architect and/or Senior Data Engineer.

• Recent experience in deploying data solutions on Databricks.

• Proficiency in Spark, Hadoop, Kafka, Databricks, pandas, and scikit-learn.

• Comprehensive knowledge of data modeling, ETL, data integration, and end-to-end data analytics workflows.

• Capability to conduct architecture discovery and solution design sessions, creating implementation blueprints.

• Proficient in Java, Python, and/or Scala.

• Familiarity with AWS, Azure, and/or GCP.

• Skilled in writing, debugging, and optimizing SQL queries.

• Excellent written and verbal communication skills, along with client-facing experience.

• Ability to create and present detailed presentations.

• Experience in producing solution documentation, including POCs, roadmaps, sequence diagrams, class hierarchies, and logical system views.

• Background in team management and mentoring engineers.

• Capability to implement technical solutions in production with considerations for performance, security, scalability, and robust data integration.

• Knowledge of distributed storage systems such as S3, ADLS, HDFS, GCS, Kudu, ElasticSearch/Solr, Cassandra, or other NoSQL systems.

• Experience with data integration technologies like Spark, Kafka, StreamSets, Matillion, Fivetran, NiFi, AWS Data Migration Services, Azure Data Factory, and IICS.

• Extensive SDLC experience encompassing design, documentation, implementation, testing, and deployment.

• Expertise in automated data transformation and curation using dbt, Spark, Spark Streaming, and automated pipelines.

• Experience with workflow management and orchestration tools such as Airflow, AWS Managed Airflow, Luigi, and NiFi.

• Background in Financial Services, preferably in banking.

• Familiarity with banking IT compliance requirements and standards.

• At least two of the following certifications: Associate Developer for Apache Spark, Data Engineer Associate, Professional Data Engineer, Machine Learning Associate, or Professional ML Engineer.

• Bachelor's degree in Computer Science or a related field (4-year program).

🏝️ Benefits

• Health insurance coverage for employees and eligible family members starting from the first day of employment.

• A minimum of 15 days of Paid Time Off each year.

• Nine paid company holidays.

• Opportunities to enhance both technical and interpersonal skills.

• Chance to lead teams on complex and innovative customer projects.

• Career advancement opportunities.

• Performance-based cash incentive awards.

• An innovative environment utilizing cutting-edge technologies.

• A collaborative culture that encourages knowledge sharing.