
IT Software Engineer – Data
Posted 5 days ago

Posted 5 days ago
This is a fully remote position, open to applicants in United States.
• Take ownership of the data infrastructure supporting Nelnet’s GenAI offerings for higher education and SLED clients.
• Design, construct, and oversee BigQuery and Dataflow or Cloud Composer/Apache Airflow data pipelines.
• Develop and maintain ELT/ETL processes for the batch ingestion of SIS, ERP, and casework-system data into Google Cloud analytics and RAG data repositories.
• Monitor the reliability, performance, and cost of pipelines, optimizing the use of BigQuery and Dataflow jobs.
• Classify and tag client data utilizing Dataplex and Cloud DLP.
• Define and implement data access controls and governance policies.
• Evaluate and document data readiness for AI applications.
• Create data models and schemas for current use cases and reusable patterns.
• Collaborate with client technical teams regarding source-system constraints, data access, and extraction methodologies.
• Keep documentation updated regarding data flows, schemas, and classification decisions.
• Execute the delivery backlog, provide technical estimates, and identify data-related risks.
• Ensure that pipelines deliver agentic solutions with the necessary structure and freshness.
• Conduct reviews and testing for data quality.
• Work in partnership with GCP/Gemini Enterprise Engineering, AgentOps, the Forward Deployed Engineer, and the Engagement Manager.
• Bachelor’s degree in a related field or equivalent professional experience.
• Proven experience in building data pipelines and ELT/ETL processes for analytics or GenAI applications on a major cloud data platform — required.
• Strong preference for direct experience with BigQuery and Dataflow or Cloud Composer/Apache Airflow.
• Familiarity with data governance and classification tools for sensitive or regulated data.
• Working knowledge of cloud storage, messaging, and access control concepts.
• Google Cloud certification is preferred.
• Proficient SQL skills.
• Experience with Python for developing pipelines and transforming data.
• Understanding of data privacy and compliance issues related to education or public sector data, such as FERPA.
• Experience collaborating with client or partner technical teams to extract and integrate data from legacy or third-party systems.
• Capability to work from a defined backlog and convert technical requirements into functional data pipelines.
• Skilled in SQL development and performance optimization.
• Strong understanding of the software development lifecycle with exposure to agile or iterative delivery methodologies.
• Proficient in ETL design and development using at least one tool, such as SSIS.
• Basic knowledge of C#.NET for SSIS scripting.
• Understanding of RDBMS principles.
• Familiarity with Agile methodologies.
• Preferred experience in database design and modeling.
• Experience with JIRA/TFS is preferred.
• Helpful experience with Netezza and PostgreSQL.
• Ability to maintain confidentiality.
• Ability to work effectively within a distributed virtual team.
• Strong verbal and written communication skills.
• Ability to obtain a security clearance.
• Medical insurance.
• Dental insurance.
• Vision insurance.
• HSA and FSA options.
• Generous earned time off.
• 401K/student loan repayment assistance.
• Life insurance and AD&D insurance.
• Employee assistance program.
• Employee stock purchase program.
• Tuition reimbursement.
• Performance-based incentive pay.
• Short- and long-term disability coverage.
• Wellness program.
• Reasonable accommodations for qualified individuals with disabilities.
Magna Legal Services
Huron
Strategic Systems International
Get handpicked remote jobs straight to your inbox weekly.