Our client is seeking a Senior Data Engineer to design, build, and optimize scalable data platforms and pipelines that enable reliable, high-performance, data-driven decision-making across the organization.
- 5+ years of experience in data engineering and building scalable data solutions.
- Strong hands-on experience with Scala and large-scale data processing.
- Expertise in Apache Spark for distributed data processing.
- Advanced proficiency in SQL and complex data transformations.
- Experience designing and developing scalable data pipelines.
- Strong knowledge of Data Lakes and modern data platform architecture.
- Solid understanding of data structures and data engineering best practices.
- Experience with data intelligence concepts and technologies.
- Experience with distributed systems and cloud platforms (AWS, Azure, or GCP).
- Strong understanding of data modeling, data warehousing, and data governance.
- Ability to work effectively in a collaborative Agile environment.
- Experience with Python (PySpark).
- Exposure to Machine Learning workflows.
- Experience with ML pipelines or MLOps.
- Familiarity with data intelligence and data cataloging tools.
- Experience using Python for scripting and analytics.
- Design and build scalable data pipelines using Scala, Spark, and SQL.
- Develop core components of modern data platforms.
- Collaborate with data analysts, data scientists, and product teams to understand business and data requirements.
- Ensure data quality, consistency, and availability for analytics and reporting.
- Monitor, troubleshoot, and optimize data workflows for performance and reliability.
- Contribute to data platform architecture and cloud-native solution design.
- Evaluate and implement modern data intelligence tools and engineering practices.
#LI-KS1
#D480
