About this role
The team is seeking an experienced Data Engineer (Spark/Scala) to join their dynamic team. The ideal candidate will have strong hands-on expertise in Apache Spark, Databricks, Scala, PySpark, Python, and SQL. This role involves designing and developing large-scale data pipelines across both on-premises and cloud environments, while also working with multiple file systems and data formats.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using Apache Spark and Databricks.
- Modernize legacy workflows to enhance performance and efficiency.
- Support hybrid data architectures to ensure seamless data integration.
- Collaborate with cross-functional teams to gather requirements and implement data solutions.
- Optimize data processing and storage strategies for improved performance.
Required Skills & Qualifications:
- Proficiency in Apache Spark, Scala, PySpark, and Python.
- Strong experience with SQL and data modeling.
- Familiarity with cloud platforms and data storage solutions.
- Ability to work with various file systems and data formats.
- Excellent problem-solving skills and attention to detail.
Experience:
- Minimum of 5 years of relevant experience in data engineering roles.
What we offer:
- Opportunity to work on cutting-edge technologies in a collaborative environment.
- Professional development and career growth opportunities.
- A supportive team culture that values innovation and creativity.
Applications are read by our talent team, usually within two working days.
If you look like a fit we will call you, and you will hear from us either way.