Job Opportunity Posted 10 days ago

Senior Data Engineer

Mastech Digital
Tamil Nadu

Job Description

POSITION: Reltio MDM Developer

LOCATION: Chennai/Hyderabad/Bangalore- Hybrid.

DURATION: Full Time.

Notice Period: Immediate joiner/ Serving notice less than 45 days


Must have skills (Hand's on)

Azure Synapse Analytics- 3 years

Pyspark- 4+ years

Python- 1+ years

Fabric- 6+ months


This is a migration project from Azure Synapse Analytics to Fabric


Experience: 8+ Years


Job Summary

We are seeking a highly skilled Senior Data Engineer to join the Data Cloud team supporting client. The ideal candidate should possess strong data engineering expertise with hands-on experience in Python, Azure Synapse Analytics, Microsoft Fabric, Databricks, and modern cloud-based data platforms.

The candidate should be capable of independently designing, developing, optimizing, and supporting scalable data solutions while working closely with business and technical stakeholders.


Key Responsibilities

  • Analyze business requirements and design scalable data engineering solutions.
  • Design, develop, and maintain robust data pipelines and ETL/ELT frameworks.
  • Build and optimize data ingestion, transformation, and processing workflows using Python and PySpark.
  • Develop data solutions using Azure Synapse Analytics, Microsoft Fabric, and Databricks.
  • Implement scalable data lake and data warehouse architectures.
  • Develop reusable, metadata-driven, and parameterized data pipelines.
  • Perform complex data transformations, aggregations, joins, and data quality validations.
  • Optimize pipeline performance and troubleshoot data processing issues.
  • Implement monitoring, logging, and error-handling frameworks.
  • Work with structured and semi-structured data sources across cloud and on-premise platforms.
  • Support production incidents, root cause analysis, and performance tuning activities.
  • Collaborate with cross-functional teams to deliver high-quality data solutions.
  • Participate in code reviews and follow engineering best practices.


Required Skills

  • Strong Python programming experience
  • PySpark
  • Azure Synapse Analytics
  • Microsoft Fabric
  • Databricks
  • SQL
  • Azure Data Factory (ADF)
  • Azure Data Lake Storage (ADLS)
  • Delta Lake
  • Data Warehousing Concepts
  • ETL / ELT Development
  • Data Modeling
  • CI/CD and DevOps practices
  • Performance Optimization and Troubleshooting


Preferred Experience

  • Banking or Financial Services domain experience
  • Regulatory reporting and analytics platforms
  • Medallion Architecture (Bronze, Silver, Gold)
  • Large-scale cloud data migration and modernization projects


Key Expectations

  • Strong engineering and problem-solving capabilities
  • Ability to work independently with minimal supervision
  • Experience handling complex data transformation and integration scenarios
  • Strong debugging, troubleshooting, and optimization skills
  • Excellent communication and stakeholder management skills


About this job listing
This job opportunity is provided through our external job listing network. MyJobAlerts helps you discover job opportunities and redirects you to the original listing to apply.