Databricks Lead Engineer | Senior Manager | Data & AI | Advisory, Dublin

Description

& SummaryAt PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals.

In data analysis at PwC, you will focus on utilising advanced analytical techniques to extract insights from large datasets and drive data-driven decision-making. You will leverage skills in data manipulation, visualisation, and statistical modelling to support clients in solving complex business problems.

PwC Ireland- Bring Your Talent, Grow Your Skills, Unlock Your Potential

Do you want to be a part of a team of technology and digital leaders, experienced in scoping, and delivering large transformation programmes in complex matrix environments?

Our Data &AIConsulting team is dedicated toleveragingtechnologyin order tosolve complex business problems for our clients. We work with Ireland’s largest organisations across a wide range of industries including financial services, government, healthcare, technology,mediaand telecoms.

Do you want to be a part of a community of problem solvers combining human ingenuity,experienceand technology innovation to deliver sustained outcomes and build trust?

At PwC, we believe real transformation is Human Led and Tech Powered. Key to delivering this capability and driving our continued growth is our ability to guide clients in their consideration and implementation of leading Data, Analytics & AI Technologies. As we embark on further building on our deep technical and commercial teams, we are hiring for talent with skills in data strategy, governance, and transformation. By joining our Data& AI team you will have the opportunity to help shape the future of our company and help clients deliver bigger, more impactful transformation that lasts.

Purpose-led workyou’llbe part of

As the Lead Developer on our Data & AI team, you will spearhead the development and delivery of analytics projects that significantly enhance healthcare outcomes. Your role will be pivotal in developing, leading, reviewing, and managing code with a focus on Databricks technology for complex healthcare systems. Ensuring the highest standards of code development, delivery, data quality, compliance, and reliability will be a core part of your responsibilities. Collaborating with experienced architects, engineers, and junior developers, you will contribute to building a robust data solution. Your efforts will directly support improved decision-making for healthcare providers, patients, and policymakers. Byleveragingyourexpertisein healthcare data standards and best practices, you will be instrumental in advancing projects that positivelyimpactthe sector.

Role & Responsibilities:

Architecture & Design: Developing scalable data solutions, defining data models, designing data lakes/lakehouses, and creating high-level design documents.

Development & Optimization: Building andoptimizingcomplex data pipelines (both batch and streaming) usingPySpark/Scala, Delta Lake, and SQL, as well as automating workflows.

Leadership & Mentoring: Guiding development teams, sharing best practices, mentoring engineers, and leading technical initiatives.

Data Governance & Quality: Implementing data quality checks, security measures (RBAC, UnityCatalog), and ensuring data lineage.

Cloud & DevOps: Working with cloud services (Azure/AWS), implementing CI/CD pipelines (Git, ADO), and managing Databricks clusters.

Collaboration: Partnering with data scientists, analysts, and business stakeholders to translate requirements into technical solutions.

Your Profile: 

Technical Skills:Expertisein Deep Spark (PySpark/Scala), Delta Lake, UnityCatalog, SQL, Databricks Notebooks/Workflows, Cloud Platforms (Azure/AWS), and CI/CD tools, along withproficiencyin datamodeling.

Leadership Abilities:Demonstratedexperience in leading projects, mentoring teams, architectural design, managing stakeholders, and resolving complex problems.

Professional Experience: Over 5 years of experience in data engineering and software engineering, with substantial exposure to Databricks.

Unlock your potential with PwC Ireland

We believe that challenges are better solved together!We’reinspiring and empowering our people to change the world. Powered by the latest technology,you’llbe a part of amazing teams encouraged to collaborate and innovate in a way that creates powerful solutions and makes a positive impact. This purpose-led work, and our continuous development and encouragement, will help unlock your potential and take your career to the next level.

Enjoy PwC’sperks

We reward your impact, and support your wellbeing, through a competitive compensation package, inclusive employee benefits and flexibility programs that will help you thrive in work and life. Learn more about us at<. ().

Being appreciated for being you

Our mostvaluable assetis ourpeopleand we grow stronger as we learn from one another. We are an equal opportunity employer and we value diversity. We do not discriminateon the basis ofrace, religion, colour, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We believe this so much that we have signed up for the. ()

You can learn more about our culture of belonging and explore our range of inclusive programmes, initiatives, employee resource groups and more at.

Avoid the confidence gap; you do not have to match all the listed requirements exactly to apply,we’dlove to hear from you!

We will ensure that individuals with disabilities are provided reasonable accommodation toparticipatein the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Pleaseemail usfor more information.

Education

Degrees/Field of Study required:Degrees/Field of Study preferred:

Certifications

Required Skills

Optional Skills

Accepting Feedback, Accepting Feedback, Active Listening, Algorithm Development, Alteryx (Automation Platform), Analytical Thinking, Analytic Research, Big Data, Business Data Analytics, Coaching and Feedback, Communication, Complex Data Analysis, Conducting Research, Creativity, Customer Analysis, Customer Needs Analysis, Dashboard Creation, Data Analysis, Data Analysis Software, Data Collection, Data-Driven Insights, Data Integration, Data Integrity, Data Mining, Data Modeling {+ 46 more}

Desired Languages

Travel Requirements

Not Specified

Available for Work Visa Sponsorship?

Yes

Government Clearance Required?

No

Job Posting End Date