Senior Data Engineer
Chennai- Ascendas IT Parkonsitesenior
Posted 3mo ago · via Workday
About this role
Job Description: Responsibilities: Develop & Optimize Data Pipelines Build, test, and maintain ETL/ELT data pipelines using Azure Databricks & Apache Spark (PySpark) . Optimize performance and cost-efficiency of Spark jobs. Ensure data quality through validation, monitoring, and alerting mechanisms. Understand cluster types, configuration, and use-case for serverless Implement Unity Catalog for Data Governance Design and enforce access control policies using Unity Catalog. Manage data lineage, auditing, and metadata governance . Enable secure data sharing across teams and external stakeholders. Integrate with Cloud Data Platforms Work with Azure Data Lake Storage / Azure Blob Storage/ Azure Event Hub to integrate Databricks with cloud-based data lakes, data warehouses, and event streams .…
What we'd score you on
reqspace match rubricFive dimensions, recruiter-grade. Upload your resume and we'll generate a written explanation of where you fit and where the gaps are.
1
Skills match
For this role: python, sql, databricks, azure, iam…
2
Level fit
This role is senior-level. We check your trajectory against it.
3
Domain experience
Your work in the role's domain matters more than your years total. We weight recent and direct experience.
4
Recency
A skill you used last quarter weighs more than one from five years ago. We grade on recency, not lifetime.
5
Location fit
This role is based in Chennai- Ascendas IT Park. We weight your proximity and willingness to relocate.
Score yourself on this role.
Free · no card · written explanation included
Skills in this role
Pulled from the job description. These are the keywords we'll weight when scoring your fit.
pythonsqldatabricksazureiamserverlesssparkpysparkkafkadbtmlflowteamssalesforce
More at Toppanmerrill
- View →Document SpecialistSt. Paul, MN (USA)
- View →Accounts Payable & Receivable SpecialistSt. Paul, MN (USA)
- View →Senior Client Services Project Manager – 2nd shiftPalo Alto, CA (USA)
- View →Field Marketing ManagerSt. Paul, MN (USA)
- View →Senior Java Developer (Full-Stack)Chennai- Ascendas IT Park
- View →Sales ExecutiveWork From Home, CAN-AB