About this role
The team is seeking a Senior Software Engineer with a strong background in creating and managing data ingestion pipelines based on the ELT (Extract, Load & Transform) model. The ideal candidate will have experience working at scale and will be proficient in coding for Data Models, Transformation Logic, and Data Flow.
Key Responsibilities:
- Design, develop, and maintain robust data ingestion pipelines.
- Implement and manage transformation logic and data flow processes.
- Utilize tools such as Logstash, Apache BEAM, and Dataflow to optimize data handling.
- Collaborate with cross-functional teams to ensure data integrity and accessibility.
- Monitor and troubleshoot data pipeline performance using Grafana, InfluxDB/VictoriaMetrics, and BigQuery.
- Participate in Agile product development methodologies to deliver high-quality software solutions.
Required Skills & Qualifications:
- 4-6 years of hands-on experience in software engineering with a focus on data ingestion and processing.
- Strong knowledge of ELT processes and data modeling.
- Proficiency in Apache Airflow for workflow management.
- Familiarity with ClickHouse for analytical database management.
- Understanding of Agile methodologies and experience working in Agile teams.
What we offer:
- Opportunity to work on cutting-edge technology in a dynamic environment.
- Collaborative team culture that values innovation and creativity.
- Professional growth and development opportunities.
Applications are read by our talent team, usually within two working days.
If you look like a fit we will call you, and you will hear from us either way.