Role:Data Engineer
Location:London, England
Job type: Full time

Essential Skills:

Bachelor’s degree in Computer Science, Engineering, or a related field.
Proven experience as a Data Engineer, Software Engineer, or similar role in large scale data platform implementation (project team size of >= 10 FTEs and/or project duration 6 months or more).
Strong experience in SQL and relational database systems (e.g., MySQL, PostgreSQL, Oracle).
Proficiency in programming languages such as Python, Java, or Scala for data manipulation and ETL tasks.
Minimum 5 years of hands-on experience with ETL tools like Apache Nifi, Talend, Informatica, or equivalent.
Familiarity with big data technologies such as Hadoop, Spark, Kafka, and HBase.
Minimum 3 years of hands-on experience with cloud-based data services (e.g., AWS S3, Azure Data Lake, Google BigQuery, Redshift).
Knowledge of data modelling, database design, and data architecture best practices.
Experience with version control (e.g., Git) and agile development practices.

Preferred Skills:

Experience with NoSQL databases like MongoDB, Cassandra, or DynamoDB.
Experience with Databricks and Dataiku.
Familiarity with machine learning pipelines and integration with data systems.
Knowledge of CI/CD pipelines and automation tools like Jenkins, Docker, or Kubernetes.
Exposure to real-time data processing tools such as Apache Flink or Storm.
Understanding of data privacy regulations (GDPR, CCPA, HIPAA) and how they impact data storage and processing.