About this role
The team is seeking a skilled Data Engineer with 5-8 years of experience to join their team for a heavy data analytics project. The ideal candidate will have strong hands-on experience in building high-performance data pipelines and will be well-versed in various data technologies.
Key Responsibilities:
- Design, develop, and maintain robust data pipelines for large-scale data processing.
- Utilize Spark, PySpark, and Scala to process and analyze data efficiently.
- Implement data ingestion and transformation processes using Python and SQL.
- Work with Azure technologies, including ADF, Synapse, and ADLS, to manage data workflows.
- Collaborate with data scientists and analysts to ensure data availability and quality.
- Optimize data storage solutions using Data Lake and Data Warehouse architectures.
- Develop and manage Delta Tables and integrate with Snowflake for data warehousing.
Required Skills & Qualifications:
- Proficiency in Spark, PySpark, Scala, Python, and SQL.
- Experience with Azure Databricks and Snowflake.
- Strong understanding of data ingestion and transformation techniques.
- Familiarity with Data Lake and Data Warehouse concepts.
- Excellent problem-solving skills and attention to detail.
What we offer:
- Opportunity to work on cutting-edge data analytics projects.
- Collaborative and innovative work environment.
- Professional development and growth opportunities.
Applications are read by our talent team, usually within two working days.
If you look like a fit we will call you, and you will hear from us either way.