About this role
The team is seeking a skilled PySpark Developer with expertise in data ingestion, ETL processing, and big data cloud-based solutions. The ideal candidate will have hands-on experience in building scalable data pipelines and optimizing data processing performance.
Key Responsibilities:
- Develop and implement data ingestion pipelines from various sources such as databases, S3, and files.
- Build and optimize ETL and Data Warehouse transformation processes.
- Develop enterprise-level Big Data solutions using PySpark and related technologies.
- Collaborate with data engineers and analysts to ensure data quality and integrity.
- Monitor and troubleshoot data pipeline performance issues.
Required Skills & Qualifications:
- Proficiency in PySpark and experience with big data frameworks.
- Strong understanding of ETL processes and data warehousing concepts.
- Experience with cloud platforms such as AWS or Azure.
- Familiarity with SQL and NoSQL databases.
- Excellent problem-solving skills and attention to detail.
Experience:
- 3-5 years of relevant experience in data engineering or a similar role.
What we offer:
- An opportunity to work on cutting-edge big data projects.
- A collaborative and innovative work environment.
- Opportunities for professional growth and development.
Applications are read by our talent team, usually within two working days.
If you look like a fit we will call you, and you will hear from us either way.