Python Data Lake Configuration AWS Environment EMR Project Pyspark Consultant (J   Requirement id 137122 Job title Consultant Job location in Trenton, NJ Skills required Debugging Tools, Python, Data Platform, Data Lake Configuration AWS Environment Open Date 24-Oct-2022 Close Date Job type Contract Duration 4 Months Compensation DOE Status requirement --- Job interview type ---    Email Recruiter: coolsoft Job Description Consultant: Debugging Tools, Python, Data Platform, Data Lake Configuration AWS Environment Start date :11/21/2022 End Date :03/01/2023 Submission deadline :10/26/2022 Client Info :DOH Description : The State of NJ is seeking an Cloud Data Engineer that will assist in maintaining, and monitoring infrastructure as well as build or assist in building data transformation pipelines. Candidate must have prior experience with AWS or Azure and extensive knowledge of python for ETL development. Additional Cloud-based tools experience is important (see skills section) Required skills include experience with the following: • Extensive experience leveraging Python to build data transformation pipelines (ETL) and experience with libraries such as pandas and numpy. • Extensive experience with Spark framework (PySpark) for writing complex data transformation logic using AWS EMR Jupyter notebooks. • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. • Experience using AWS Glue and AWS EMR to construct data pipelines • Experience with AWS cloud services: EC2, EMR, Athena, StepFunctions, CloudWatch, EventBridge, Lambda The candidate should have a demonstrable track record of the following: • Experience building and optimizing big data data pipelines, architectures, and datasets. • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. • Strong analytic skills related to working with unstructured datasets. • Building processes supporting data transformation, data visualization, data structures, metadata, dependency, and workload management. • A successful history of manipulating, processing and extracting value from large disconnected datasets. • Working knowledge of message queuing, stream processing, and highly scalable big data data stores. • Strong project management and organizational skills. • Experience supporting and working with cross-functional teams in a dynamic environment. • We are looking for a candidate with 5+ years of experience in a Data Engineer role Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field preferred They should also have experience using the following software/tools: • Experience with relational SQL and NoSQL databases, including Postgres. • Experience with data pipeline and workflow management tools: AWS Glue, Airflow,etc. • Experience with stream-processing systems: Storm, Spark-Streaming, etc. • Experience with object-oriented/object function scripting languages: Python, Java, etc. It is a strong possibility for extension beyond the stated date above. This will be onsite in Trenton NJ immediately with up 2 days remote. Please do not submit any candidates that are unable to relocate prior to start of the assignment. The manager prefers Green Card and US Citizens at this point, based on a long term desire to consider this position for employment directly with the State. It is not inevitable, just a possibility a few years in the future. few years in the future.   Call 502-379-4456 Ext 100 for more details. Please provide Requirement id: 137122 while calling.   Other jobs in NJ: Edison (2), Englewood Cliffs (1), Ewing (2), Franklin Lakes (7), Hamilton (3), Hightstown (7), Hopewell (2), Jersey City (3), Little Falls (1), Maplewood (1), Mercer County (3), Mount Laurel (11), Mt Laurel (4), New Brunswick (1), Newark (1), Princeton (4), Somerset (9), Trenton (123), Unknown (2), Warren (7), Wayne (1),    Debugging Tools job openings in other states Jobs List Mainframe Programmer Analyst - LIHEAP - 53689 Create date: 24-Jul-2018 Start Date : 08/27/2018 # End Date : 06/30/2019 Submission Dead Line : 08/17/2018 Client Info : GaDHS Description : It is seeking a qualified candidate for the position of Mainframe Programmer Analyst-LIHEAP (L.... (This job is for - CobolIBM Jobs in GA Atlanta Analyst - (in Atlanta, GA)) .Net Developer - J-10-661-307 Create date: 02-Apr-2012 [Note: Dead line: 4-05-2012] [Note : Start Date : 04-09-2012 End Date : 12-31-2012] Description: .Net Developer - MUST BE AVAILABLE IN COLUMBUS FOR A FACE TO FACE INTERVIEW The .Net Developer will participate in a team environment and be responsible for developing, debugging, and unit test.... (This job is for - job Jobs in OH COLUMBUS Developer - (in Columbus, OH))     (Consultant: Debugging Tools, Python, Data Platform, Data Lake Configuration AWS Environment in Trenton, NJ)

Featured Jobs DHCP LANWAN Analyst (Jobs in Atlanta, Georgia) JavaScript Communication Analyst (Jobs in Richmond, Virginia) Agile SCRUM Manager (Jobs in Madison, Wisconsin) Cisco LAN Manager (Jobs in Stafford, Virginia) Dataverse SQL Developer (Jobs in Raleigh, North Carolina) Data Developer (Jobs in Durham, North Carolina) SOAP JavaScript JSON SQL Administrator (Jobs in Salem, Oregon) MicrosoftOffice Consultant (Jobs in Golden, Colorado) GIT Automation Ansible Engineer (Jobs in Raleigh, North Carolina) SCRUM Azure Analyst (Jobs in Lansing, Michigan)