About this role
The team is seeking a Senior Software Engineer with a strong background in Python to develop scalable and high-performance backend applications. The ideal candidate will have experience in building distributed data pipelines and working with complex data processing frameworks.
Key Responsibilities:
- Develop scalable, high-performance backend applications and distributed data pipelines using Python and PySpark.
- Design and optimize complex SQL queries, stored procedures, and data models on MS SQL Server.
- Leverage the Hadoop ecosystem, including Hive, Hue, Impala, and HBase, for high-volume data processing and search.
- Implement real-time event processing using Apache Kafka.
- Automate environment management and infrastructure tasks using PowerShell scripting.
- Collaborate with cross-functional teams to define and implement solutions that meet business requirements.
Required Skills & Qualifications:
- Strong proficiency in Python and experience with PySpark.
- Solid understanding of SQL and experience with MS SQL Server.
- Familiarity with the Hadoop ecosystem and tools such as Hive, Hue, Impala, and HBase.
- Experience with Elasticsearch for data processing and search functionalities.
- Knowledge of real-time event processing frameworks, particularly Apache Kafka.
- Proficiency in PowerShell scripting for automation tasks.
- Excellent problem-solving skills and ability to work in a team-oriented environment.
Experience:
- Minimum of 5 years of relevant experience in software engineering and data processing.
What we offer:
- A dynamic work environment with opportunities for professional growth.
- The chance to work on cutting-edge technologies and impactful projects.
- A collaborative team culture that values innovation and creativity.
Applications are read by our talent team, usually within two working days.
If you look like a fit we will call you, and you will hear from us either way.