About this role
The team is seeking a skilled PySpark Developer / Senior Data Engineer who is passionate about leveraging data to drive business decisions. In this role, you will be responsible for designing, developing, and maintaining data processing systems using PySpark. You will work closely with cross-functional teams to ensure data integrity and optimize data flows.
Key Responsibilities:
- Design and implement data pipelines using PySpark and other big data technologies.
- Collaborate with data scientists and analysts to understand data requirements and provide solutions.
- Optimize existing data processing workflows for performance and scalability.
- Monitor and troubleshoot data processing jobs to ensure timely delivery of data.
- Document data processes and maintain data quality standards.
Required Skills & Qualifications:
- Strong experience with PySpark and big data technologies.
- Proficiency in SQL and experience with relational databases.
- Familiarity with cloud platforms such as AWS or Azure.
- Knowledge of data warehousing concepts and ETL processes.
- Excellent problem-solving skills and attention to detail.
Experience:
- Minimum of 5-8 years of experience in data engineering or a related field.
What we offer:
- A dynamic work environment where you can grow and contribute.
- Opportunities for professional development and career advancement.
- A supportive team culture that values innovation and collaboration.
Applications are read by our talent team, usually within two working days.
If you look like a fit we will call you, and you will hear from us either way.