Data Engineer - #146871

This role may be located in one of the following locations; Birmingham, Blackpool, Leeds, Manchester, Newcastle or Sheffield. Please find further information on the Corporate hub locations here.

Job Summary

As a Data Engineer, you will be responsible for the development, construction, and maintenance of data products and services to meet customer needs within agreed timescales, testing architectures such as databases and large-scale systems.

Your role will involve creating and maintaining analytics infrastructure, which forms the foundation for all data requirements.

Additionally, you will implement data flows to connect operational systems and write and execute ETL scripts and codes to ensure seamless data integration and processing.

Our team works within the overall product development Lifecycle Process within Data Engineering; learning about the agreed Data Architecture and Data Engineering principles and standards to ensure the systems are fit for purpose.

Please note this role requires you to pass Security Check clearance. For further information, please see 'Selection process details'.

Job Description

As a Data Engineer you will;

• Be required to review business requirements to ensure they are clear and robust and transform requirements into reusable production ready code and / or effective data models.
• Engage with data owners, suppliers, operations and end data users for data modelling.
• Implement ETL and ETL processes, data loading strategy, data archiving, data reconciliation, data manipulation, data integration, error handling and error logging mechanisms in own role and day-to-day outputs.
• Advise, guide, negotiate, persuade, discuss and gain understanding of issues.
• Support queries from end users on data quality issues affecting data productions; communicate issues and blockers to develop solutions.
• Undertake basic data analysis to enable data profiling, QA, and problem resolution.
• Responsible for contact and communication with a range of people to undertake data profiling investigations to support design work. Integrate a variety of source data, using judgement and guidance to determine the appropriate approach.
• Conduct proof of concept and discovery work to provide information and advice and recommend a course of action responsible for all day-to-day decisions relating to their own work and that of those they manage.
• Support the growth of the team, by keeping abreast of market and industry trends and sharing knowledge and experience with them.
  
  

As a Data Engineer you will;

• Be required to review business requirements to ensure they are clear and robust and transform requirements into reusable production ready code and / or effective data models.
• Engage with data owners, suppliers, operations and end data users for data modelling.
• Implement ETL and ETL processes, data loading strategy, data archiving, data reconciliation, data manipulation, data integration, error handling and error logging mechanisms in own role and day-to-day outputs.
• Advise, guide, negotiate, persuade, discuss and gain understanding of issues.
• Support queries from end users on data quality issues affecting data productions; communicate issues and blockers to develop solutions.
• Undertake basic data analysis to enable data profiling, QA, and problem resolution.
• Responsible for contact and communication with a range of people to undertake data profiling investigations to support design work. Integrate a variety of source data, using judgement and guidance to determine the appropriate approach.
• Conduct proof of concept and discovery work to provide information and advice and recommend a course of action responsible for all day-to-day decisions relating to their own work and that of those they manage.
• Support the growth of the team, by keeping abreast of market and industry trends and sharing knowledge and experience with them.
  
  

Person specification

When Giving Details In Your Employment History And Personal Statement You Should Highlight Your Experience In Line With Essential Criteria Below

• Experience of code development activities to deliver data transformation products.
• Ability to write clean, efficient, reusable and well documented code for data processing tasks to a specification.
• Intermediate or better experience of Python, SQL and PySpark.
• Ability to develop automated and reuseable data ingest routines, workflows and mappings for structured and unstructured data using automation via code.
• Experience of transforming data models into production ready code.
  
  

If you would like to learn more about the role, please contact [email protected].

Behaviours

We'll assess you against these behaviours during the selection process:

• Managing a Quality Service
• Developing Self and Others
  
  

Technical skills

We'll assess you against these technical skills during the selection process:

• Programming and Build
• Test Analysis
• Technical Breadth
  
  

Alongside your salary of £37,497, Department for Work and Pensions contributes £10,862 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.

We also have a broad benefits package built around your work-life balance which includes:

• Working patterns to support work/life balance such as job sharing, term-time working, flexi-time and compressed hours.
• Generous annual leave – at least 23 days on entry, increasing up to 30 days over time (pro–rata for part time employees), plus 9 days public and privilege leave.
• Support for financial wellbeing, including interest-free season ticket loans for travel, a cycle to work scheme and an employee discount scheme.
• Health and wellbeing support including our Employee Assistance Programme for specialist advice and counselling and the opportunity to join HASSRA a first-class programme of competitions, activities and benefits for its members (subscription payable monthly).
• Family friendly policies including enhanced maternity and shared parental leave pay after 1 year’s continuous service.
• Funded learning and development to support progress in your role and career. This includes industry recognised qualifications and accreditations, coaching, mentoring and talent development programmes.
• An inclusive and diverse environment with opportunities to join professional and interpersonal networks including Women’s Network, National Race Network, National Disability Network (THRIVE) and many more.
  
  

This job role may be suitable for hybrid working, which is where an employee works part of the week in their DWP office and part of the week from home. This is a voluntary, non-contractual arrangement and your office will be your contractual place of work. The number of days that anyone will be able to work at home will be determined primarily by business need but personal circumstances and other relevant circumstances will also be taken into account. If you are successful, any opportunities for hybrid working, including whether a hybrid working arrangement is suitable for you, will be discussed with you prior to you taking up your post.

Salary Information

New entrants to the Civil Service will join on band minimum.

Existing Civil Servants who secure a new role on lateral transfer should maintain their current salary.

Existing Civil Servants who gain promotion may move to the bottom of the grade pay scale or 10% increase in salary whichever would be the greater.

Selection process details

This vacancy is using Success Profiles (opens in a new window), and will assess your Behaviours, Experience and Technical skills.

Stage 1: Application

Your Application Will Consist Of Three Parts

• A Personal Details application form.
• Employment history - this should contain your work experience and any skills, qualifications and accomplishments relevant to the jobs you have completed based on the essential criteria.
• Personal statement - up to 1000 words. This statement should be used to provide examples of how you meet the essential criteria listed in the Person specification.
  
  

Further details around what this will entail are listed on the application form.

The sift panel will use the information in your employment history and personal statement to assess your experience, skills and knowledge against the essential criteria.

You will be provided with one combined overall assessment score for both your CV and Personal Statement.

For Hints and Tips on completing your application visit Applying for jobs at DWP Digital.

Important Information

• You will be asked to complete your employment history any information that you would customarily share on a CV should therefore be entered onto the application form.
• Personal details that could be used to identify you including your name, contact details and address must be removed for your application to be considered.
• If your employment history/personal statement contains any personal details your application will be withdrawn.
• We recognise that AI may be helpful when applying for this role, but it is important to use it in the right way. Read the DWP AI Candidate Guide to understand how you can make the best use of GenAI while ensuring your application remains authentic and effective.
  
  

Stage 2: Interview

Skills

If you’re successful at sift stage you will be invited to a video interview via Microsoft Teams. There, you will be assessed against the following Behaviours and Technical Skills:

• Managing a Quality Service
• Developing Self and Others
• Programming and Build- Designs, develops. codes, tests, corrects and documents simple programs or scripts under the direction of others.
• Test Analysis- Able to identify simple patterns and trends. Investigates problems and opportunities in existing processes and contributes to recommending solutions to these. Works with stakeholders to identify objectives and potential benefits available.
• Technical Breadth- Understands core technical concepts related to their role and can apply them.
  
  

Interviews will take place from Early to Mid-July.

Further information

Find out more about Working for DWP

If high application volumes are received, the benchmark for candidates to proceed to the next stage may be raised. In line with our commitment to the Disability Confident Scheme (DCS), we aim to advance all candidates applying under the DCS who meet the minimum standard. However, we may only progress those candidates who best meet the required standards.

A reserve list may be held for a period of 6 months from which further appointments can be made.

All successful candidates and those placed on reserve will be posted in merit list order by location.

The Civil Service values honesty and integrity and expects all candidates to abide by these principles. Please ensure that all examples provided in your application are taken directly from your own experience and that you describe the examples in your own words. Applications will be screened and if evidence of plagiarism or copying examples/answers from other sources is found, your application will be withdrawn. Internal DWP candidates may also face disciplinary action.

Security Clearance Requirement

You must meet the security requirements before you can be appointed. The level of security needed is security check.

For meaningful checks to be carried out, you will need to have lived in the UK for a sufficient period of time, to enable appropriate checks to be carried out and produce a result which provides the required level of assurance. Whilst a lack of UK residency in itself is not necessarily a bar to a security clearance, and expectation of UK residency may range from 3 to 5 years. Failure to meet the residency requirements needed for the role may result in the withdrawal of provisional offer.

NSV

For further information on National Security Vetting please visit the Demystifying Vetting website.

Reasonable Adjustment

At DWP we value diversity and inclusion and actively encourage and welcome applications from everyone, including those that are underrepresented in our workforce.

We consider visible and non-visible disabilities, neurodiversity or learning differences, chronic medical conditions, or mental ill health. Examples include dyslexia, epilepsy, autism, chronic fatigue, or schizophrenia.

If you need a change to be made so that you can make your application, you should: Contact Government Recruitment Service via [email protected] as soon as possible before the closing date to discuss your needs.

Complete the “Reasonable Adjustments” section in the “Additional requirements” page of your application form to tell us what changes or help you might need further on in the recruitment process. For instance, you may need wheelchair access at interview, or if you’re deaf, a Language Service Professional.

For further information on reasonable adjustments, terms and conditions and how we recruit visit the How we recruit page.

Feedback

Feedback will only be provided if you attend an interview or assessment.

This vacancy is using Success Profiles (opens in a new window), and will assess your Behaviours, Experience and Technical skills.

Security

Successful candidates must undergo a criminal record check.

Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check (opens in a new window).See our vetting charter (opens in a new window).

People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Successful candidates must undergo a criminal record check.

Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check (opens in a new window).See our vetting charter (opens in a new window).

People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Nationality requirements

This Job Is Broadly Open To The Following Groups

• UK nationals
• nationals of the Republic of Ireland
• nationals of Commonwealth countries who have the right to work in the UK
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) (opens in a new window)
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
• individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
• Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service
  
  

Further information on nationality requirements (opens in a new window)

Working for the Civil Service

The Civil Service Code (opens in a new window) sets out the standards of behaviour expected of civil servants.

We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles (opens in a new window).

The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.

The Civil Service also offers a Redeployment Interview Scheme to civil servants who are at risk of redundancy, and who meet the minimum requirements for the advertised vacancy.

The Civil Service Code (opens in a new window) sets out the standards of behaviour expected of civil servants.

We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles (opens in a new window).

The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.

The Civil Service also offers a Redeployment Interview Scheme to civil servants who are at risk of redundancy, and who meet the minimum requirements for the advertised vacancy.

Diversity and Inclusion

The Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see the Civil Service People Plan (opens in a new window) and the Civil Service Diversity and Inclusion Strategy (opens in a new window).

This vacancy is part of the Great Place to Work for Veterans (opens in a new window) initiative.

The Civil Service welcomes applications from people who have recently left prison or have an unspent conviction. Read more about prison leaver recruitment (opens in new window).

Once this job has closed, the job advert will no longer be available. You may want to save a copy for your records.

Contact point for applicants

Job Contact

• Name : Caicy Sandford
• Email : [email protected]
  
  

Recruitment team

• Email : [email protected]
  
  

Further information

Appointment to the Civil Service is governed by the Civil Service Commission Recruitment Principles. If you wish to make a complaint, please find further details here: https://careers.dwp.gov.uk/how-we-recruit/.