Job Description
Job Description: Client is looking for a Data Engineer to join our Advanced Analytics team under the Wholesale organization. This engineer will design and deliver data solutions for the analytics and data science teams in the consumer organization. The engineer will be able to work with all types of interesting data: fiber network and outage data billing digital behavior customer interactions and customer demographic data. In this role you will design and build out the modern data infrastructure to streamline the data science workflows for the data science and overarching advanced analytics teams in the consumer organization. These teams are primarily responsible for building predictive models and driving retention and sales strategy for our consumer base.
Responsibilities:
- Develop and implement ETL pipelines to efficiently transfer data from SQL Server to Databricks ensuring accuracy scalability and optimal performance.
- Validate and transform data within Databricks including testing for data integrity consistency and quality across ingestion and processing stages.
- Collaborate with cross-functional teams to design build and optimize curated tables in Databricks for analytics and reporting purposes.
- Monitor and troubleshoot data workflows addressing any issues related to performance reliability or data anomalies.
- Document data engineering processes and provide technical support for ongoing maintenance and enhancements to the Databricks environment.
Required Qualifications:- 2 years of experience as a Data Engineer in a similar role - Experience with data modeling warehousing and building pipelines
- Proven experience in designing and implementing comprehensive data pipelines for a variety of flows data integration across systems ETL processes machine learning infrastructures
- Proficient in SQL and Python - Experience in Databricks ETL
#LI-AS1
Pay Range: $48 - $51
The specific compensation for this position will be determined by a number of factors, including the scope, complexity and location of the role as well as the cost of labor in the market; the skills, education, training, credentials and experience of the candidate; and other conditions of employment. Our full-time consultants have access to benefits including medical, dental, vision and 401K contributions as well as any other PTO, sick leave, and other benefits mandated by appliable state or localities where you reside or work.
Job Tags
Full time, Contract work,