Senior Software Engineer (Senior Data Infrastructure Engineer)
Puneonsitesenior
Posted 6 days ago · via Smartrecruiters
About this role
Senior Data Infrastructure Engineer Job Description Manage and optimize Databricks infrastructure, including cluster lifecycle management, job scheduling, Unity Catalog administration, user permissions, and cost monitoring. Manage Airflow clusters deployed on Kubernetes via Helm charts, including upgrades, configuration management, and integration with ArgoCD and Vault. Write and maintain Terraform modules to provision and manage cloud infrastructure in a scalable, reliable, and secure manner. Develop and maintain data pipelines and workflows using Python, PySpark, and dbt to support data processing and analytics use cases. Use GitHub Copilot with custom skills and agents to improve team productivity, automate repetitive development tasks, and accelerate code reviews and documentation.…
What we'd score you on
reqspace match rubricFive dimensions, recruiter-grade. Upload your resume and we'll generate a written explanation of where you fit and where the gaps are.
1
Skills match
For this role: python, r, databricks, aws, kubernetes…
2
Level fit
This role is senior-level. We check your trajectory against it.
3
Domain experience
Your work in the role's domain matters more than your years total. We weight recent and direct experience.
4
Recency
A skill you used last quarter weighs more than one from five years ago. We grade on recency, not lifetime.
5
Location fit
This role is based in Pune. We weight your proximity and willingness to relocate.
Score yourself on this role.
Free · no card · written explanation included
Skills in this role
Pulled from the job description. These are the keywords we'll weight when scoring your fit.
pythonrdatabricksawskuberneteshelmvaultterraformpysparkairflowdbtgithubteams
More at Nielsen IQ
- View →AUDITOR DE CAMPOTAMAULIPAS, CD VICTORIA, Mexico
- View →Senior Employee Experience Financial AnalystBogota, DC, Colombia
- View →Manager, Line and Price SolutionsChicago, IL, United States
- View →Associate Sales DirectorIllinois, IL, United States
- View →Analista de Operaciones SrCiudad de México, DIF, Mexico
- View →Facilities CoordinatorLondon, , United Kingdom