Data Engineer

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL workflows.
• Build and optimize data integration processes using tools such as SSIS and Apache Airflow.
• Develop and maintain data workflows using Azure Data Factory (ADF).
• Write optimized and complex SQL queries for data extraction, transformation, and analysis.
• Use Python for data processing, automation, and pipeline development.
• Design and maintain data warehouse solutions and data models.
• Develop efficient data models to support BI, reporting, and analytics requirements.
• Integrate data pipelines with Power BI and other business intelligence platforms.
• Monitor, troubleshoot, and optimize data pipelines to ensure reliability and performance.
• Automate repetitive data engineering processes and improve overall pipeline efficiency.
• Work with cloud-based data infrastructure across Microsoft Azure and/or AWS.
• Ensure data quality, consistency, security, and availability across different systems.
• Collaborate with data analysts, BI developers, software engineers, and business stakeholders.