ETL (Big Data) Developer

Company
Advertiser Confidential
Date Posted
30th July 2017
Reference
AXAI812
Job Type
Permanent
Location
Ipswich
Salary
£38,000 to £42,000 Per Annum

This is a very hands-on specialist technical role to support and improve AXA Insurance UK data warehousing systems under the guidance of team leads and the data solution architects.  As a member of Data Services you will be supporting and enhancing the current Big data and Data Warehouse environment.  You will be collaborating with other Data Services teams and other business as well as IT teams. As a Big data developer with ETL skills, should be able to ingest and process data on Hadoop as well as provide data feeds where required.  You will be the go-to person within the team for Python development, Spark, Hadoop ecosystem, Cloudera specific tools like Cloudera Navigator and Cloudera Manager, T-SQL and SSIS. 

What you will be doing

Your main duties & responsibilities: . Develop and support the Cloudera Hadoop implementations in Data Services.. Good knowledge of testing in a Big data environment.. Developing, testing and implementing components for the existing data warehousing solutions using industry best practice techniques.. Daily process and job checks and fixes on SQL Servers and other reporting systems.. To work as part of a team assisting and supporting other team members.. To provide support and assistance to other members and departments of the business as needed. This includes, but is not limited to software developers, underwriting, software testing, marketing and management.. Troubleshooting, debugging and improving existing processes.. Produce technical and user documentation for processes and procedures. General . To comply with Axa Insurance UK aims and objectives.. To assist in the day-to-day duties as appropriate and to produce written reports and financial records as requested.. To undertake other reasonable duties at the request of the line manager.

What we can offer you

As you’d expect from a global leader, our reward package is a world-beater – here’s a small selection of our current benefits.

Bonus Scheme linked to yours and the company’s performance
Pension scheme with employer contributions as well as your own
25 days holiday increasing with service plus Bank Holidays
Interest free season ticket loan scheme
Share Plan Scheme
Discount on all AXA Insurance products, including insurance, breakdown cover & healthcare

Who are we looking for?

Essential knowledge, skills and experience required - Knowledge -• Well experienced in Python and SPARK development. • Experience working on Hadoop environments with various suite of services [Oozie, HIVE, Impala, ELK, Kafka, Storm, Sqoop etc] • Experience working with various formats – XML, JSON,AVRO, PARQUET etc • Strong experience in Data Ingestion and processing on Big Data. • ETL and Data Warehousing (Kimball methodology) • Strong self-sufficiency and initiative working on Business Intelligence projects. • Performance tuning and best practices on Big Data projects. Skills -• Python [REST API], Pyspark • SPARK and MapReduce • oozie, HIVE, Impala, ELK. • MS SQL Server 2008 r2/2012/2014 product stack • SPs, functions and data manipulation with SSIS • RDBMS theory and practice. • Relevant industry qualifications (CCA/CCP/MCSA/MCSD) Experience -• Working on Big Data projects handling development, deployment and security. • Report and Dashboard Development using Big Data tools and SQL Server stack.• Developing ETL processes• Data Modelling• SQL Server performance tuning• Version / source control [TFS desirable] • Understanding the principles of Agile methodology 

About us

Proud to be part of the AXA Group, the number one global insurance brand and a worldwide leader in financial services, AXA Insurance businesses employ over 5,500 in a network of offices across the UK. Our expert teams care for a huge range of customers, helping them protect their cars, homes and businesses against life’s uncertainties. Whether bought directly, through brokers or through a number of corporate partners, our market-leading products are trusted by millions.

We are an Equal Opportunities Employer 


First Name* Last Name*
Password* Confirm Password*
Email*  
 
By submitting this form you agree to our terms of use

Copyright © 2017 Daylight Resources Ltd

Site design by Zero One Design Ltd