N
Nielsen IQGeneral Business

Senior Software Engineer (Senior Data Infrastructure Engineer)

Puneonsitesenior

Posted 6 days ago · via Smartrecruiters

About this role

Senior Data Infrastructure Engineer Job Description Manage and optimize Databricks infrastructure, including cluster lifecycle management, job scheduling, Unity Catalog administration, user permissions, and cost monitoring. Manage Airflow clusters deployed on Kubernetes via Helm charts, including upgrades, configuration management, and integration with ArgoCD and Vault. Write and maintain Terraform modules to provision and manage cloud infrastructure in a scalable, reliable, and secure manner. Develop and maintain data pipelines and workflows using Python, PySpark, and dbt to support data processing and analytics use cases. Use GitHub Copilot with custom skills and agents to improve team productivity, automate repetitive development tasks, and accelerate code reviews and documentation.…

Read the full description on Nielsen IQ's site →

What we'd score you on

reqspace match rubric

Five dimensions, recruiter-grade. Upload your resume and we'll generate a written explanation of where you fit and where the gaps are.

1

Skills match

For this role: python, r, databricks, aws, kubernetes…

2

Level fit

This role is senior-level. We check your trajectory against it.

3

Domain experience

Your work in the role's domain matters more than your years total. We weight recent and direct experience.

4

Recency

A skill you used last quarter weighs more than one from five years ago. We grade on recency, not lifetime.

5

Location fit

This role is based in Pune. We weight your proximity and willingness to relocate.

Score yourself on this role.
Free · no card · written explanation included
See if I'm a fit →

Skills in this role

Pulled from the job description. These are the keywords we'll weight when scoring your fit.

pythonrdatabricksawskuberneteshelmvaultterraformpysparkairflowdbtgithubteams

More at Nielsen IQ

See all open jobs at Nielsen IQ