Skip to main content

Your browser is out of date, and unable to use many of the features of this website

Please upgrade your browser.


This website requires cookies. Your browser currently has cookies disabled.

Lead Azure Data Engineer

Reporting to: Principal Product Owner
Team: Strategy and Risk
Contract type: Permanent
Salary: From £52,831 - £70,130 per annum with access to performance related pay and civil service pension scheme
Location: Brighton
Closing date: Sunday 18 April 2021

Job ref: 61621

TPR grade: 7 

About us

The Pensions Regulator (TPR) is responsible for protecting workplace pensions in the UK. We work with employers and those running pensions to help people save safely for their retirement.

We have a fantastic office located in the heart of Brighton that is a short distance from the train station, shops and the sea.

We put our 700+ employees first by supporting flexible working and offering a diverse, lively and inclusive environment. This includes LGBT+ Network (PROUD), Women’s Network, BAME Network (ME) and a Disability Network, which offer supportive spaces to connect with like-minded individuals.

We are committed to making TPR a great place to work. We do all we can to support our people reach their full potential with training, secondment and development opportunities.


TPR in Brighton requires a Lead Data Engineer to be the technical lead on a new Azure data platform. The platform is one of the outputs of a new programme of work resulting from a recent investment working alongside a Microsoft Gold partner to modernise existing technology and invest in state of the art data and analytical capabilities.

This is a fantastic opportunity for a dynamic and skilled Data Engineer who is interested in standing up a state of the art function for a data platform on a purely cloud first basis. This role is the first technical recruitment to the team and requires someone with the skills and experience to shape and lead the development of this area working alongside the Product Owner and the programme of change already underway.

The Lead Data Engineer will have the opportunity to work closely with our partner data experts over the next 12 months and is expected to be proactive in upskilling in any areas needed across all aspects of the new technology. They will establish themselves as TPR’s technical lead on the platform supporting the hand off between the programme and the newly formed Data Platform Team.

The primary technologies that will be used are SQL Server, Azure Data Lake, Azure Data Factory, Data Bricks, Azure Analysis Services and Power BI.


  • Provide the technical expertise on activities that consume data from a selection of source systems and move through Azure pipelines into BI dashboards and analytical products.
  • Be a hands-on Data Engineer across the full stack as well a team leader who will be able to train and mentor others joining and developing into the team.
  • Lead on Azure data technologies and data engineering, establishing best practices and creating new agile processes with the highest standards for coding and development.
  • Be accountable to TPR’s Technical Design authority, Data Panel, the Product Owner and ultimately TPR’s analytical community who rely heavily on this data to be managed appropriately to inform risk-based decision making.
  • Stay up to date on evolving technologies in this field and ensure TPR’s Data Platform and the team running it remain current and in adherence to TPR’s data governance and compliance regulations.
  • Support the Product Owner in developing a new team to manage and continuously develop the Data Platform.

Essential and desirable criteria


  • Proven hands-on Data Engineering experience and Business Intelligence development.
  • Demonstrable experience of Azure Analysis Services.
  • Expert on the Azure data platform especially Azure Data Factory (ADF); Azure Storage (including Data Lake Store); Azure CosmosDB and Azure SQL Data Warehouse (Synapse).
  • Excellent SQL, Python and DAX programming skills (Other languages considered).
  • Expert in Data modelling, data warehouse design and data lake concepts and practices.


  • Comfortable with Power BI management and integration with other analytical tools.
  • Experience of developing a data engineering team.
  • Experience working within data governance and compliance frameworks.
  • Previous experience of building, maintaining and influencing relationships with a range of stakeholders.
  • Previous experience of developing pragmatic, data led solutions to solve critical business challenges.
  • Familiarity with DevOps (or similar).

Person specification

  • Proactive and flexible.
  • Problem solving and analytical skills.
  • Communication skills at all levels.
  • Attention to detail and accuracy.
  • Personable and a team player.

Salary and benefits

As well as a starting salary from £52,831 - £70,130 per annum, we offer:

  • Civil Service Pension arrangements, which are recognised as some of the best in the pensions world
  • discretionary bonus arrangements
  • access to performance related pay progression
  • 25 days annual leave provision
  • flexible working arrangements
  • development opportunities
  • enhanced parental leave arrangements
  • a free employee assistance programme
  • an excellent office location in Brighton

How to apply

Please send your CV and a written statement to quoting ref 61621 with details of how your experience and skills meet our essential criteria and details of your notice period.

We are an inclusive employer and offer equal opportunities to all regardless of an individual’s age, disability, gender identity, marriage or civil partnership status, pregnancy or maternity, race, religion or belief, sex and sexual orientation.

Candidates who declare that they have a disability and who meet the essential criteria for the job will be offered an interview.

Applications will be considered on a part time and job share basis.

Please be aware we are currently holding interviews through Skype due to COVID-19.

If you have any queries about this role, or if you have a disability and wish to request a reasonable adjustment at any stage of the recruitment process, please email