Senior Software Engineer, Data Platform

This is a fully remote position, open to applicants in India.

📋 Description

• Develop and manage data ingestion and transformation pipelines for both real-time and batch processing tasks.

• Create scalable solutions for integrating new data sources and enhancing existing connections.

• Assist in the architecture of various components of the data platform, including storage, computing, and pipeline layers.

• Build tools for monitoring, alerting, and measuring data quality, emphasizing automation and user self-service.

• Identify and resolve production issues, prioritizing systemic solutions over temporary fixes.

• Engage in an on-call rotation to triage incidents, manage resolutions comprehensively, and implement post-incident enhancements.

• Develop and utilize AI-powered agents to automate repetitive engineering and operational tasks such as triage, monitoring, pipeline debugging, and support workflows.

⛳️ Requirements

• Over 7 years of experience in software or data engineering roles within high-traffic production environments.

• Practical experience in constructing batch and real-time data pipelines.

• Solid understanding of distributed systems principles, including reliability, scalability, and fault tolerance.

• A strong sense of ownership — you take responsibility for what you build and ensure its successful operation.

• Familiarity with Kafka or similar streaming platforms.

• Experience with Spark Structured Streaming and open table formats like Apache Iceberg or similar (Delta Lake, Hudi).

• Experience with cloud data warehouses, with a preference for Snowflake.

• Knowledge of workflow orchestration tools such as Airflow or similar.

• Proficient in Python and SQL.

• Capable of developing and utilizing AI agents for engineering and operational tasks, including automating runbooks and creating support triage tools.

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

• Nice to Have: Familiarity with CDC patterns and tools (Debezium or similar).

• Knowledge of DBT or other transformation frameworks.

• Experience with Big Data technologies (Spark, Flink, Pinot, etc.).

• Previous use of AI coding tools (Cursor, Copilot, etc.) or LLM-based agent frameworks (LangChain, Claude, etc.).

🏝️ Benefits

• Being human isn’t about fulfilling every requirement on a checklist. It’s about the experiences we share, the people we meet, and the varied perspectives we bring. If you possess the skills but hesitate to apply due to your background, we encourage you to apply anyway. We need exceptional individuals like you to help us challenge the norm and think differently about the problems we tackle. We are in this together. Come be human with us.

• We leverage technology, including automated and AI-assisted tools, to enhance certain elements of our recruitment process. These tools aim to increase efficiency and improve the candidate experience. However, AI tools are not responsible for hiring decisions; all decisions are made by our hiring teams.

• At ServiceTitan, we celebrate individuality and uniqueness. We believe that the blend of fresh perspectives and experiences from diverse backgrounds enriches our product and culture. We are committed to ensuring that we do not discriminate against employees based on race, color, religion, sex, national origin, gender identity or expression, age, disability, sexual orientation, or any other characteristic protected by applicable laws.