Data Platform Engineer
£575 Per Day (Umbrella)
Stevenage
6 Months
Inside IR35
Responsibilities:
• Given a well-specified data framework problem, implement end-to-end solutions using appropriate programming languages (e.g. python, scala, or go), open-source tools (e.g. Spark, elasticsearch, ...), and cloud vendor-provided tools (e.g. Amazon S3)
• Leverage tools provided by Tech (e.g. infrastructure as code, cloud ops, devops, logging / alerting, ...) in delivery of solutions
• Write proper documentation in code as well as in wikis/other documentation systems
• Write fantastic code along with proper unit, functional, and integration tests for code and services to ensure quality
• Stay up-to-date with developments in the open-source community around data engineering, data science, and similar tooling
Requirements:
• Master's degree in Computer Science with a focus in Data Engineering or Software Engineering, etc. plus 2 years job experience, or Bachelor’s degree in Computer Science plus 4 years' job experience
• Experience with common distributed data tools (Spark, Kafka, Hive, Presto, etc.)
• Experience with basic data architecture (e.g. optimizing physical layout for access patterns)
• Experience with basic search engines / indexing (e.g. Elasticsearch, Lucene)
• Experience in writing Python, Java, Scala, Go, and/or C++
Desireable Requirements:
• Comfortable with basics of data architecture (e.g. optimizing physical layout for access patterns)
• Comfortable with basics of search engines / indexing (e.g. Elasticsearch, Lucene)
• Experience with agile software development
• Experience building and designing a DevOps-first way of working
• Demonstrated experience building reusable components on Kubernetes or similar ecosystem
• Experience with agile software development
• Experience with public cloud provider like AWS, Azure and GCP
For more information please click APPLY NOW.
Fahad McCann
Recruitment Consultant