Home       |     Overview      |     Candidate Login      |     Post Resume       |     Contact us
 
  
     
     
Search Jobs
     
Keywords,Title,Skills,Company  Location,City,State,Zip  
  Advanced Search
     
Hadoop ETL PERL Python SQL Experience Big Data Engineer
(Jobs in St Louis Park, M
 
Requirement id 99238
Job title Engineer
Job location in ST LOUIS PARK, MN
Skills required Hadoop, ETL, Scripting, PERL Python SQL Experience Big Data
Open Date 21-Oct-2019
Close Date
Job type Contract
Duration 11 Months
Compensation DOE
Status requirement ---
Job interview type ---
   Email Recruiter: coolsoft
Job Description Engineer: Hadoop, ETL, Scripting, PERL Python SQL Experience Big Data

Candidate must be our W2 Employee

Description:

Responsibilities

· Data modeling, coding, analytical modeling, root cause analysis, investigation, debugging, testing and collaboration with the business partners, product managers, architects & other engineering teams.
· Extract business data from multiple data sources and store in MapR DB HDFS location.
· Work with Data Scientists and build scripts to meet their data needs
· Work with Enterprise Data Lake team to maintain data and information security for all use cases
· Build automation script using AUTOSYS to automate the load
· Design and develop scripts and configurations to successfully load data using Data Ingestion Frameworks or Ab initio
· Coordinate user access requests for data loaded in Data Lake
· Post-production support of the AIES Open Source Data Science (OSDS) Platform
· Supporting end-to-end Platform application delivery, including Infrastructure provisioning & automation and integration with Continuous
· Integration/Continuous Development (CI/CD) platforms, using existing and emerging technologies



Required Qualifications

· Demonstrated ability to transform business requirements to code, metadata specifications, specific analytical reports and tools
· Strong Hadoop scripting skills to process petabytes of data
· 5+ years of ETL (Extract, Transform, Load) Programming with tools including Informatica
· 2+ years of Unix or Linux systems with scripting experience in Shell, Perl or Python
· Experience with Advanced SQL (preferably Teradata)
· Experience working with large data sets, experience working with distributed computing (MapReduce, Hadoop, Hive, HBase, Pig, Apache Spark, etc.).


Desired Qualifications

· Experience with Java and Scala
· Experience with Ab Initio
· Experience with analytic databases, including Hive, Presto, and Impala
· Experience with multiple data modeling concepts, including XML and JSON
· Experience with loading and managing data using technologies such as Spark, Scala, NoSQL (MongoDB, Cassandra) and columnar MPP SQL stores (Redshift, Vertica)
· Experience with Change and Release Management Processes
· Experience with stream frameworks including Kafka, Spark Streaming, Storm or RabbitMQ
· Experience working with one or more of the following Amazon Web Services (AWS) Cloud services: EC2, EMR, ECS, S3, SNS, SQS, Cloud Formation, Cloud watch
 
Call 502-379-4456 Ext 100 for more details. Please provide Requirement id: 99238 while calling.
 
Other jobs in MN: Coon Rapids (2), Duluth (6), Eagan (1), Edina (3), Little Falls (1), Maplewood (4), Mineapolis (1), Minneapolis (69), Minnesota (1), North Saint Paul (1), Plymouth (1), Roseville (2), Saint Cloud (3), Saint Paul (41), St Cloud (1), St Paul (5), Unknown (1),
 
 Hadoop job openings in other states
Jobs List

Back End Java Developer - 85842
Create date: 03-Jun-2022
Description:

General skills
Nice to have

Databricks
Hadoop is preferred but any big Data warehousing experience

IT skills
Must have

Backend data experience
Data Warehousing
Java/springboot API knowledge
AWS
Datalayer knowledge (This job is for - Hadoop Jobs in NY NewYork Developer - (in New York, NY))

Data Warehouse Designer/Developer - 58707
Create date: 05-Oct-2021
Description:

Responsibilities

Our Client in Columbus, Ohio is seeking an experienced Data Warehouse Designer / Developer for a contract role.

CANDIDATES MUST BE LOCAL TO CENTRAL OHIO OR RELOCATED BY DAY ONE FOR CONSIDERATION.

The Data Warehouse Designer/Developer will be responsible for Enterprise data wa.... (This job is for - Hadoop ETL ELT Jobs in OH Columbus Developer - (in Columbus, OH))

Technical Specialist - 58686
Create date: 30-Sep-2021
Description:

Responsibilities

Our client in Columbus Ohio is seeking an Enterprise Data Warehouse / ETL Developer.

Local candidates are highly preferred. Candidates are required to report onsite on Day 1 of the assignment.

The Technical Specialist will be responsible for the clients Enterprise data wareho.... (This job is for - Hadoop ETL Jobs in OH Columbus Specialist - (in Columbus, OH))

Data Warehouse Designer / Developer - 58526
Create date: 20-Aug-2021
Description:

Our Client in Columbus, Ohio is seeking an experienced Data Warehouse Designer / Developer for a contract role

CANDIDATES MUST BE LOCAL TO CENTRAL OHIO OR RELOCATED BY DAY ONE FOR CONSIDERATION

The Data Warehouse Designer/Developer will be responsible for Enterprise data warehouse design, development, i.... (This job is for - Hadoop Hive Jobs in OH Columbus Developer - (in Columbus, OH))

Senior Software Development Engineer
Create date: 26-Apr-2021
Description:

Top 3 required technical skills:

Automation Dev Ops Engineering [Hadoop, Spark]
Operational experience in real-time, streaming and data pipelines relevant frameworks [NiFi or Airflow]
Java/ Scala and Python programming
PCF or Cloud experience in general.

Role

.... (This job is for - Hadoop Spark Scala Jobs in CA SanFrancisco Engineer - (in San Francisco, CA))
 
 Hadoop job openings in MN
Jobs List

Data Architect - 61434
Create date: 23-Mar-2020
Job Description :

Project Title: Data Technical Architect
Dept: Global IT
Contract Position: 6 months
Project Type: This is a contract position.
Location: Remote to Start. Then will report to Hopkins, MN – 9320 Building after the Ok to return to work,

Apex Systems is in need of a Data Architect for a global.... (This job is for - Hadoop Jobs in MN Minneapolis Architect - (in Minneapolis, MN))

Data Modeler - 60935
Create date: 11-Mar-2020
Candidate must be our W2 Employee.

Job Description :

Hello,

We are looking for Data Modeler. Non-local candidates are fine if they can come to our local Apex office for interview. We are open to H1B. Interview and feedback within a week from Wells Fargo.


Project: Standing up new data analytics envi.... (This job is for - Hadoop ETL Jobs in MN Minneapolis Consultant - (in Minneapolis, MN))

Data Architect - 60648
Create date: 05-Mar-2020
Candidate must be our W2 Employee.

Job Description :



Project: Standing up new data analytics environment that will be out of an existing Hadoop environment

Responsibility is to provide curated views of data to support reporting and analytics to end users

Requirements:

Must.... (This job is for - Hadoop Jobs in MN Minneapolis Architect - (in Minneapolis, MN))

Talend Developer - 60451
Create date: 03-Mar-2020
Job Description :

Optum – Talend Developer

Eden Prairie MN

6 Month contract +


Day to Day:

· Talend 6.0 Developer to write ETL code, with strong SQL, and Data mapping troubleshooting skills.

· DW methodologies and concepts - star schemas, snowflakes, ETL processe.... (This job is for - Hadoop Java Jobs in MN Minnetonka Developer - (in Minnetonka, MN))

Data Modeler - 59377
Create date: 12-Feb-2020
Candidate must be our W2 Employee.

Job Description :

It is looking for 2 Data Modelers for an immediate opportunity in the Minneapolis area.

Responsibilities:

Acts as a lead in providing application design guidance and consultation, utilizing a thorough understanding of applicable technology, tools.... (This job is for - HadoopOracle Jobs in MN Minneappolis Modeler - (in Minneappolis, MN))
(Engineer: Hadoop, ETL, Scripting, PERL Python SQL Experience Big Data in ST LOUIS PARK, MN)
   
 
     
Search Jobs
     
Keywords,Title,Skills,Company  Location,City,State,Zip  
  Advanced Search
     
    About Us     Services    Privacy policy    Legal     Contact us     Copyright JobsInHand.com All Rights Reserved