Senior Data Engineer
What you will be doing:
* Data Platform: Creation of a Databricks Data Warehouse(s) and Lakehouse solutions for a healthcare data focused enterprise. o Data Governance: Configuring and maintaining unity catalog to enable enterprise data lineage and data quality o Data Security: Building out Data Security protocols and best practices including the management of identified and de-identified (PHI/PII) solutions o External Data Products: Building data solutions for clients while upholding the best standards for reliability, quality, and performance o ETL: Building solutions within Delta Live Tables and automation of transformations o Medallion Architecture: Building out performant enterprise-level medallion architecture(s) o Streaming and Batch Processing: Building fit-for-purpose near real-time streaming and batch solutions o Large Data Management: Building out performant and efficient enterprise solutions for internal and external users for both structured and unstructured healthcare data o Platform Engineering: Building out Infrastructure as Code using Terraform and Asset Bundles o Costs: Working with the business to build cost effective and cost transparent Data solutions
* Pipeline/ETL Management: You will help architect, build, and maintain robust and scalable data pipelines, monitoring, and optimizing performance o Experience working with Migration tools i.e., AWS DMS, AWS Glue, Fivetran, integrate.io www.selbyjennings.com | Terms and conditions apply o Identify and implement improvements to enhance data processing efficiency o Experience with building out effective pipeline monitoring solutions o Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Delta Live Tables, Python, Scala, and cloud-based 'big data' technologies.
* Data Modeling: Lead design, implementation, and maintenance of standards based (FHIR, OMOP, etc.) and efficient data models for both structured and unstructured data o Assemble large, complex data sets that meet functional and non-functional business requirements o Develop and maintain data models, ensuring they align with business objectives and data privacy regulations
* Collaboration: Partner internally and externally with key stakeholders to ensure we are providing meaningful, functional, and valuable data o Effectively work with Data, Development, Analysts, Data Science, and Business team members to gather requirements, propose, and build solutions. o Communicate complex technical concepts to non-technical stakeholders and provide guidance on best practices. o Ensure that technology execution aligns with business strategy and provides efficient, secure solutions and systems
* Processes and Tools: Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. o Build analytics tools that utilize the data pipeline to provide actionable insights into operational efficiency and other key business performance metrics. o Create data tools for clinical, analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader
FAQs
Congratulations, we understand that taking the time to apply is a big step. When you apply, your details go directly to the consultant who is sourcing talent. Due to demand, we may not get back to all applicants that have applied. However, we always keep your CV and details on file so when we see similar roles or see skillsets that drive growth in organisations, we will always reach out to discuss opportunities.
Yes. Even if this role isn’t a perfect match, applying allows us to understand your expertise and ambitions, ensuring you're on our radar for the right opportunity when it arises.
We also work in several ways, firstly we advertise our roles available on our site, however, often due to confidentiality we may not post all. We also work with clients who are more focused on skills and understanding what is required to future-proof their business.
That's why we recommend registering your CV so you can be considered for roles that have yet to be created.
Yes, we help with CV and interview preparation. From customised support on how to optimise your CV to interview preparation and compensation negotiations, we advocate for you throughout your next career move.