Hadoop ETL ELT Hive Pyspark Developer (Jobs in Columbus, OH)   Requirement id 119587 Job title Developer Job location in Columbus, OH Skills required Hadoop, ETL, ELT, Hive Pyspark Open Date 05-Oct-2021 Close Date Job type Contract Duration 8 Months Compensation DOE Status requirement --- Job interview type ---    Email Recruiter: coolsoft Job Description Developer: Hadoop, ETL, ELT, Hive Pyspark Description: Responsibilities Our Client in Columbus, Ohio is seeking an experienced Data Warehouse Designer / Developer for a contract role. CANDIDATES MUST BE LOCAL TO CENTRAL OHIO OR RELOCATED BY DAY ONE FOR CONSIDERATION. The Data Warehouse Designer/Developer will be responsible for Enterprise data warehouse design, development, implementation, migration, maintenance and operation activities. Candidate will work closely with the Data Governance and Analytics team. Candidate will be one of the key technical resources for data warehouse projects for various Enterprise data warehouse projects and building critical data marts, data ingestion to Big Data platform for data analytics and exchange with State and Medicaid partners. This position is a member of Department ITS and works closely with the Business Intelligence & Data Analytics team. Day-To-Day Job Duties to be performed: • Participate in Team activities, Design discussions, Stand up meetings and planning review with team. • Perform data analysis, data profiling, data quality and data ingestion in various layers using big data/Hadoop/Hive/Impala queries, PySpark programs and UNIX shell scripts. • Follow the organization coding standard document, Create mappings, sessions and workflows as per the mapping specification document. • Perform Gap and impact analysis of ETL and IOP jobs for the new requirement and enhancements. • Create jobs in Hadoop using SQOOP, PYSPARK and Stream Sets to meet the business user needs. • Create mockup data, perform Unit testing and capture the result sets against the jobs developed in lower environment. • Updating the production support Run book, Control M schedule document as per the production release. • Create and update design documents, provide detail description about workflows after every production release. • Continuously monitor the production data loads, fix the issues, update the tracker document with the issues, Identify the performance issues. • Performance tuning long running ETL/ELT jobs by creating partitions, enabling full load and other standard approaches. • Perform Quality assurance check, Reconciliation post data loads and communicate to vendor for receiving fixed data. • Participate in ETL/ELT code review and design re-usable frameworks. • Create Remedy/Service Now tickets to fix production issues, create Support Requests to deploy Database, Hadoop, Hive, Impala, UNIX, ETL/ELT and SAS code to UAT environment. • Create Remedy/Service Now tickets and/or incidents to trigger Control M jobs for FTP and ETL/ELT jobs on ADHOC, daily, weekly, Monthly and quarterly basis as needed. • Model and create STAGE / ODS / Data warehouse Hive and Impala tables as and when needed. • Create Change requests, workplan, Test results, BCAB checklist documents for the code deployment to production environment and perform the code validation post deployment. • Work with Hadoop Admin, ETL and SAS admin teams for code deployments and health checks. • Create re-usable UNIX shell scripts for file archival, file validations and Hadoop workflow looping. • Create re-usable framework for Audit Balance Control to capture Reconciliation, mapping parameters and variables, serves as single point of reference for workflows. • Create PySpark programs to ingest historical and incremental data. • Create SQOOP scripts to ingest historical data from EDW oracle database to Hadoop IOP, created HIVE tables and Impala views creation scripts for Dimension tables. • Participate in meetings to continuously upgrade the functional and technical expertise. Languages Must have English Native or bilingual proficiency Experience required REQUIRED Skill Sets: • 8+ years of experience with Big Data, Hadoop on Data Warehousing or Data Integration projects. • Analysis, Design, development, support and Enhancements of ETL/ELT in data warehouse environmen   Call 502-379-4456 Ext 100 for more details. Please provide Requirement id: 119587 while calling.   Other jobs in OH: Cincinnati (1), Cleveland (1), Columbus (233), Dublin (8), Solon (2), Hadoop job openings in Columbus, OH Jobs List Technical Specialist - 58686 Create date: 30-Sep-2021 Description: Responsibilities Our client in Columbus Ohio is seeking an Enterprise Data Warehouse / ETL Developer. Local candidates are highly preferred. Candidates are required to report onsite on Day 1 of the assignment. The Technical Specialist will be responsible for the clients Enterprise data wareho.... (This job is for - Hadoop ETL Jobs in OH Columbus Specialist - (in Columbus, OH)) Data Warehouse Designer / Developer - 58526 Create date: 20-Aug-2021 Description: Our Client in Columbus, Ohio is seeking an experienced Data Warehouse Designer / Developer for a contract role CANDIDATES MUST BE LOCAL TO CENTRAL OHIO OR RELOCATED BY DAY ONE FOR CONSIDERATION The Data Warehouse Designer/Developer will be responsible for Enterprise data warehouse design, development, i.... (This job is for - Hadoop Hive Jobs in OH Columbus Developer - (in Columbus, OH)) Technical Specialist 3/TS3 - 83945 - SP Create date: 07-Apr-2021 start date:5/3/2021 End date:06/30/2021 submission deadline:4/12/2021 client info : MCD Note: * Interviews: TEAMS * The selected candidate does not have to be local to Columbus, OH and can work remotely * REPOST OF 82361 AND 83069 - DO NOT RESUBMIT CANDIDATES Hadoop Jobs in OH Columbus Specialist - (in Columbus, OH)) Technical Specialist 3/TS3 - 82361 - SP Create date: 22-Feb-2021 start date:03/15/2021 End date:06/30/2021 submission deadline:Wednesday 2/24 @ 10 am EST client info : MCD Note: * Interviews: TEAMS Description: • Participate in Team activities, Design discussions, Stand .... (This job is for - Hadoop Data Warehousing Jobs in OH Columbus Specialist - (in Columbus, OH)) Hadoop Admin - 68341 Create date: 07-Oct-2020 Note :3 month contract helping with an upgrade. Job Description : Brief Description: Huntington Bank is looking for a Hadoop Administrator in our Data Technology organization. You will lead the administration and maintenance of Hadoop and open source tools. You will also play an important role in setup, capacity planning, moni.... (This job is for - Hadoop Jobs in OH Columbus Administrator - (in Columbus, OH))    Hadoop job openings in other states Jobs List Back End Java Developer - 85842 Create date: 03-Jun-2022 Description: General skills Nice to have Databricks Hadoop is preferred but any big Data warehousing experience IT skills Must have Backend data experience Data Warehousing Java/springboot API knowledge AWS Datalayer knowledge (This job is for - Hadoop Jobs in NY NewYork Developer - (in New York, NY)) Senior Software Development Engineer Create date: 26-Apr-2021 Description: Top 3 required technical skills: Automation Dev Ops Engineering [Hadoop, Spark] Operational experience in real-time, streaming and data pipelines relevant frameworks [NiFi or Airflow] Java/ Scala and Python programming PCF or Cloud experience in general. Role .... (This job is for - Hadoop Spark Scala Jobs in CA SanFrancisco Engineer - (in San Francisco, CA)) Hadoop Developer - 73367 Create date: 26-Mar-2021 Job Description: Candidate must be our W2 Employee. Hands on hadoop ecosystem and its components - HBase, Pig, Hive, Sqoop, Flume, Oozie, etc. Know-how on the Java essentials for hadoop Analytical and problem solving skills business acumen and domain knowledge Knowledge of scripting .... (This job is for - Hadoop HBase Pig Jobs in NY NewYork Developer - (in New York, NY)) Senior Data Engineer - 73197 Create date: 23-Mar-2021 Note: Please only send candidates that are local to the area. They are only considering local candidates at this time. The previous retail experience is a big plus. Candidate must be our W2 Employee. Candidate must be local: Yes Job Description: Position Summary * Very Strong engineering skill.... (This job is for - Hadoop Teradata Jobs in CA SanBruno Engineer - (in San Bruno, CA)) Data Engineer - 72884 Create date: 12-Mar-2021 Candidate must be our W2 Employee. Job Description: Data Engineer We are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. .... (This job is for - Hadoop Spark Kafka Jobs in CA SouthSanFrancisco Engineer - (in South San Francisco, CA))    Hadoop job openings in OH Jobs List Hadoop Developer - 53750 Create date: 07-Oct-2019 Description: Good knowledge in Hadoop Framework ETL/ELT framework Working experience in HDFS (fundamental operations) Sqoop => Example importing/exporting data from/to relational databases like Oracle/DB2/MS SQL Server Hive => Basic concept, tables/views, different stora.... (This job is for - Hadoop Hive ETL Jobs in OH Gahanna Developer - (in Gahanna, OH)) .NET Developer Create date: 25-Jun-2019 Description: .NET Developer role with a leading client in Cleveland, OH. This assignment is to support the continued growth of the clients platform for small business products. In this assignment, this individual will work with vendor tools for rating, data support needs for Hadoop, and continuing to build out a more robust solution. In .... (This job is for - Hadoop Jobs in OH Cleavland Developer - (in Cleavland, OH)) Sr CRM .Net C Sharp Developer - J-11-419-736 Create date: 21-Jun-2019 start date:7/8/2019 End date:07/03/2020 submission deadline:6/27/2019 Description: Position: Sr. CRM .Net/C# Developer PROJECT: CRM Platform - this project is to support the continued growth of the clients platform for small business products. ROLE: Wi.... (This job is for - Hadoop Jobs in OH HighlandHeights Developer - (in Highland Heights, OH)) Sr. Hadoop Developer - J-11-419-739 Create date: 20-Jun-2019 start date:7/8/2019 End date:07/03/2020 submission deadline:6/26/2019 Description: Position: Sr. Hadoop/Java Developer PROJECT: CRM Platform - Working on Data Flow and Data Management team, this project is to support the continued growth of the clients platform f.... (This job is for - HadoopIntegration Jobs in OH HighlandHeights Developer - (in Highland Heights, OH)) Lead Data Developer - 43712 Create date: 20-Feb-2019 Candidate must be your W2 Employee. We should submitt only GC, GC EAD, L2 EAD, H4 EAD and Citizen. Job Description : Lead Data Developer Description As a data developer, we develop strategies and solutions to ingest, store and distribute our big data. Our developers use Big Data tools such as,.... (This job is for - Hadoop Spark Jobs in OH Cincinnati Developer - (in Cincinnati, OH)) (Developer: Hadoop, ETL, ELT, Hive Pyspark in Columbus, OH)

Featured Jobs DHCP LANWAN Analyst (Jobs in Atlanta, Georgia) JavaScript Communication Analyst (Jobs in Richmond, Virginia) Agile SCRUM Manager (Jobs in Madison, Wisconsin) Cisco LAN Manager (Jobs in Stafford, Virginia) Dataverse SQL Developer (Jobs in Raleigh, North Carolina) Data Developer (Jobs in Durham, North Carolina) SOAP JavaScript JSON SQL Administrator (Jobs in Salem, Oregon) MicrosoftOffice Consultant (Jobs in Golden, Colorado) GIT Automation Ansible Engineer (Jobs in Raleigh, North Carolina) SCRUM Azure Analyst (Jobs in Lansing, Michigan)