Data Engineer

Role: Senior Data Engineer

Location: London (2x per week)

Calling all data engineers with experience in Apache Spark, Scala and ideally commercial and enterprise applications!

We are currently supporting a leading SaaS provider, based in London, who are on an exciting journey of transformational growth. As a business, they are a product focused company, offering a cutting-edge hybrid observability platform powered by AI.

Their innovative platform integrates AI and Machine Learning into every layer, empowering modern enterprises to achieve unparalleled operational visibility and predictability across their IT environments. This supports in enhancing IT team efficiency, reducing alert fatigue, and proactively identifying trends.

They are looking for a Senior Data Engineer with the following skillset:

• Over 6 years of experience in software development, focusing on commercial or enterprise applications.
• More than 4 years of dedicated Scala development, with a commitment to writing clean, maintainable, and well-tested code while embracing modern software engineering practices.
• Extensive knowledge of scalable data systems, including NoSQL databases like HBase, distributed object stores, message queues such as Kafka, distributed filesystems like S3 and HDFS, and data platforms such as Spark.
• Proven expertise in building, deploying, and optimising jobs with Apache Spark.
• Strong ability to write maintainable, production-ready code with comprehensive testing.
• Familiarity with container technologies like Docker and Kubernetes.
• Experience collaborating with Data Scientists to transform prototypes into scalable applications.
• Ability to work effectively within a development team, fostering strong and reliable relationships with team members.
• Excellent communication skills, both written and verbal, and the ability to collaborate with various functional teams, including Support Engineering, Tools, and Product.
• Bachelor's degree or higher in Computer Science or a related field.

The team consists of 10 high performing individuals which is in the early stages of its growth phase. They have a brilliant culture of collaboration, peer reviewing and development.

If this seems like a strong fit for you, please apply with your up-to-date cv.