Senior Data Engineer

Position: Senior Data Engineer

Location: REMOTE

Experience: 5+ years

About the Role:

We are looking for a Senior Data Engineer with strong hands-on experience in Apache Spark, Scala, and Java, coupled with a solid understanding of microservices architecture. The ideal candidate will be a self-starter, able to design and implement scalable data pipelines and services in a distributed environment.

Key Responsibilities:

• Design, build, and optimize scalable data pipelines using Apache Spark.
• Develop and maintain microservices in Scala/Java.
• Collaborate with cross-functional teams to define data requirements and delivery strategies.
• Ensure high availability, performance, and security of data infrastructure.
• Implement caching strategies using Redis or similar distributed caching tools.

Requirements:

• 5+ years of hands-on experience in data engineering.
• Deep expertise in Apache Spark, Scala, and Java.
• Experience designing and developing microservices-based architectures.
• Strong understanding of distributed systems and parallel processing.
• Working knowledge of Redis or equivalent distributed caching systems.
• Familiarity with CI/CD practices and cloud platforms is a plus.

Nice to Have:

• Experience with Kubernetes, Docker, or cloud-native environments.
• Exposure to data governance and quality frameworks.