Data Engineer

Mar 14, 2025
Leeds
Full Time
SPG Resourcing
Not Disclosed
Skills
Apache Hive • S3 • Hadoop • Redshift • Spark • AWS • Apache Pig • NoSQL • Big Data • Data Warehouse • Kafka • Scala
The Role
Apache Hive • S3 • Hadoop • Redshift • Spark • AWS • Apache Pig • NoSQL • Big Data • Data Warehouse • Kafka • Scala
SPG Resourcing has partnered withinnovative tech consultancy and we are helping them resource Data Engineers of all levels to their already established teams. Their Data Engineers are specialist software engineersthat build, optimise and maintain data applications, systems and services.

In this role you will work in a fast moving agile environment, so you will need to be able to not only be able to work as part of a team but also on your own. The role will combine the discipline of software engineering with the knowledge and experience of Data solutions in order to deliver business value.

In this role you can expect to work on projects that will include working within the Cloud (AWS, Azure, GCP). Also along side this you will get the chance to learn about Data Service such as Databricks, Synapse, Kafka, Redshift, Cloud Data Fusion and also Data Factory etc.

Requirements

  • A strong understanding of coding best practices and design patterns and experience with code and data versioning, dependency management, code quality and optimisation, error handling, logging, monitoring, validation and alerting.
  • Experience/ Exposure to Cloud Technologies ( GCP, Azure, AWS)
  • Experience in writing well tested object-oriented python.
  • Experience with using CI/CD tooling to analyse, build, test and deploy your code.
  • Strong understanding of design choices for data storage and data processing, with a particular focus on cloud data services.
  • Experience with one or more of these: Python, Java, Scala


Benefits

  • Group Pension Scheme (3% - 5%)
  • Private Healthcare (Eye care, Dental care, Smart Health and more)
  • Life Insurance
  • Hybrid Working
  • Certifications and Training
  • 25 days Holiday + Bank Holidays + (Holiday Buying and Selling)


A strong understanding of coding best practices and design patterns and experience with code and data versioning, dependency management, code quality and optimisation, error handling, logging, monitoring, validation and alerting. Experience/ Exposure to Cloud Technologies ( GCP, Azure, AWS) Experience in writing well tested object-oriented python. Experience with using CI/CD tooling to analyse, build, test and deploy your code. Strong understanding of design choices for data storage and data processing, with a particular focus on cloud data services. Experience with one or more of these: Python, Java, Scala