Spark ELT Python Development SQL Microsoft CICD Pipelines Data Engineering Written A   Requirement id 138686 Job title Engineer Job location in Milwaukee, WI Skills required Azure Data Factory, Spark, ELT, Python Development SQL Microsoft CICD Pi Open Date 23-Jan-2023 Close Date Job type Contract Duration 6 Months Compensation DOE Status requirement --- Job interview type ---    Email Recruiter: coolsoft Job Description Engineer: Azure Data Factory, Spark, ELT, Python Development SQL Microsoft CICD Pi start date : 02/27/2023 End date : 6 Months from projected start date submission deadline : January 30th, at 4:00PM CST. client info : Milwaukee County Note : * Interview Process: Microsoft Teams 60 minutes. One round * Duration of the Contract: 6 month contract. * Onsite or Remote? 100% Remote Description : • Implement technologies that supports the data strategy (30%) - Develop, implement the Data Lake/Lakehouse architecture while providing guidance on best practices. • Define and implement data pipelines that enable analytics and operational dashboards (30%) - Design and develop high quality batch and real time data pipelines at a senior level. • Define and Implement Data Engineering standards and best practices that improve quality and efficiency (20%) - Define and promote data engineer standards, best practices, and design patterns. • Define and Implement Data Engineering workflows that improve quality and reduce the time to release new features (10%) - Design and implement CI/CD workflows and pipelines. • Ensure the team can support ongoing development and operations of new technology (10%) - Mentor other members of the team in new technology and skills. Experience/Skills Needed: • Azure Data Factory • Spark Notebook • Creating ELT Pipelines in Azure Synapse Analytics and Data Bricks • Languages including Python, SQL • Lakehouse Architecture using medallion design (bronze, silver, gold) • CICD pipelines in Azure • Implementing an environment from ground up • Setting best practices for data engineering • Mentorship of team of data engineers • Clear and proactive communication - verbal/written • Taking initiative and working autonomously with some direction • Addressing data quality and profiling   Call 502-379-4456 Ext 100 for more details. Please provide Requirement id: 138686 while calling.   Other jobs in WI: De Pere (2), Green Bay (8), Kenosha (2), Madidson (1), Madison (36), Menomonee Falls (19), Milwaukee (59), Sun Prarie (1), Unknown (2), Waukesha (2),    Azure Data Factory job openings in other states Jobs List Chesterfield County Data Warehouse Architect 4 (730461) Create date: 29-Feb-2024 Hybrid Start date :03/18/2024 End Date : 10/14/2025 Submission deadline : 3/5/2024 Client Info : Chesterfield County Description : ------------------------------------------------------ *Local Richmond area candidates or those willing to relocate to the Richmond area during this engag.... (This job is for - SSIS Sql Server 2000 Jobs in VA Chesterfield Architect - (in Chesterfield, VA)) Chesterfield County Data Warehouse Arch 2 (728556) Create date: 31-Jan-2024 Hybrid start date :02/15/2024 End date :06/18/2025 submission deadline :2/5/2024 client info :Chesterfield County Description : *local Richmond, VA candidates required for onsite work *only submit candidates able to interview onsi.... (This job is for - Mapping Jobs in VA Chesterfield Consultant - (in Chesterfield, VA)) Data Base Programmer/Analyst - 57000 Create date: 13-May-2022 start date:6/1/2022 End date:02/28/2023 submission deadline:05/20/2022 client info : CO CDE Description: The Department of Education (“CDE” or “the Department”) has been awarded a grant which includes the Implementation of Common Education Data Sta.... (This job is for - SSIS Azure Jobs in CO Denver Analyst - (in Denver, CO))     (Engineer: Azure Data Factory, Spark, ELT, Python Development SQL Microsoft CICD Pi in Milwaukee, WI)

Featured Jobs Help Desk Software TechLead (Jobs in Jackson, Mississippi) EPIC Implementation Consultant (Jobs in Nashville, Tennessee) SSRS ASP.Net&C# JavaScript Xml Developer (Jobs in Jackson, Mississippi) DHCP LANWAN Analyst (Jobs in Atlanta, Georgia) JavaScript Communication Analyst (Jobs in Richmond, Virginia) Agile SCRUM Manager (Jobs in Madison, Wisconsin) Cisco LAN Manager (Jobs in Stafford, Virginia) Dataverse SQL Developer (Jobs in Raleigh, North Carolina) Data Developer (Jobs in Durham, North Carolina) SOAP JavaScript JSON SQL Administrator (Jobs in Salem, Oregon)