Azure Data Engineer

Job description

Azure Data Engineer

Perm

Cheltenham / Hybrid working (2 / 3 days per week onsite)

Up to 65,000pa

Candidates must be eligible for SC Clearance

We're in search of an exceptional Azure Data Engineer to join our Engineering Team. As a member of our dynamic and forward-thinking group, you'll have the chance to actively participate in a broad spectrum of digital projects, spanning cultural awareness, business continuity, and beyond.

QUALIFICATIONS

Due to the nature of client work for this role, you will need to be a sole British national, eligible to work on secure client sites.

We're seeking a Data Engineer with a focus on Azure, showcasing proficiency in:

Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement.

Utilizing Azure data and analytics services, including but not limited to Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Stream Analytics, and Azure Synapse Analytics.

A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing.

Designing and deploying production data pipelines, utilizing languages such as Java, Python, Scala, Spark, and SQL.

In addition, you should have proficiency or familiarity with:

Scripting and data extraction via APIs, along with composing SQL queries.

Integrating data engineering components into production systems and expertise in data cleaning, data wrangling, data visualization, and reporting.

Handling substantial volumes of structured and unstructured data, including integration of data through Azure cloud-based ingestion and curation processes.

Knowledge of data mining, machine learning, and natural language processing is considered advantageous.

Familiarity with Agile methodologies and participation in Scrum ceremonies.

Competence in designing and constructing solutions tailored for the Azure cloud environment, which may involve expertise in Platform-as-a-Service components, serverless architecture, and container technologies.