Home       |     Overview      |     Candidate Login      |     Post Resume       |     Contact us
 
  
     
     
Search Jobs
     
Keywords,Title,Skills,Company  Location,City,State,Zip  
  Advanced Search
     
Hadoop Hive Python Shell Script Bachelors Degree Engineer
(Jobs in San Francisco,
 
Requirement id 100245
Job title Engineer
Job location in San Francisco, CA
Skills required Hadoop, Hive, SQL DBA, Python Shell Script Bachelors Degree
Open Date 13-Nov-2019
Close Date
Job type Contract to Hire
Duration 6 Months
Compensation DOE
Status requirement not found
Job interview type Face to Face interview
   Email Recruiter: coolsoft
Job Description Engineer: Hadoop, Hive, SQL DBA, Python Shell Script Bachelors Degree

Job Description :

The Analytics Platform and Solutions data pipeline delivers value to various business partners by providing tools and capabilities to analyze large data sets for research, analytics, campaign management, reporting and tactical/strategic decision making. Our systems development team is looking for a Developer who has passion to work with data and to build solutions that supports our Analytic Systems Solution stack, which includes Hortonworks Hadoop distribution, Google cloud platform (GCP), SAS (Linux environment) and Tableau Server/Desktop. The successful candidate would have extensive experience as a data engineer or ETL developer building and automating data transformation and loading procedures. Strong knowledge and experience using Hive, SQL, SAS and Hadoop to conduct data profiling/discovery, data modeling and process automation is required. The candidate must be comfortable working with data from multiple sources; Hadoop, DB2, Oracle, flat files. The projects are detail intensive, requiring the accurate capture and translation of data requirements (both tactical and analytical needs) and validation of the working solution. We work in a highly collaborative environment working closely with cross functional team members; Business Analysts, Product Managers, Data Analysts and Report Developers. Perform other duties as assigned.

Essential Functions

· Design, develop and implement end-to-end solutions on Hortonworks Hadoop distribution and google cloud platform; strong ability to translate business requirements into technical design plan.

· Automate, deploy and support solutions scheduled on Crontab or Control-M. Deployment includes proper error handling, dependency controls and necessary alerts. Triage and resolve production issues and identify preventive controls.

· Build rapid prototypes or proof of concepts for project feasibility.

· Document technical design specifications explaining how business and functional requirements are met. Document operations run book procedures with each solution deployment.

· Identify and propose improvements for analytics eco-system solution design and architecture.

· Participate in Hadoop and SAS product support such patches and release upgrades. Provide validation support for Hadoop and SAS products, including any changes to other infrastructure, systems, processes that impact Analytics infrastructure.

· Participate in full SDLC framework using Agile/Lean methodology.

· Support non-production environments with the Operations and IT teams.

· Regular, dependable attendance & punctuality.

Education/Experience

Qualifications:

· Bachelors degree in Computer Science/Engineering, Analytics, Statistics or equivalent work experience.

· 4+ years of work experience in Data Engineering, ETL Development and Data Analytics.

· 4+ years of hands-on experience using SQL and scripting language such as Unix Shell or Python

· 3+ years of hands-on experience developing on a Linux platform.

· 2+ years of hands-on experience working in traditional RDBMS such as Oracle, DB2.

· 1+ years of hands-on experience working in Hadoop using HIVE, HDFS, TEZ, MapReduce, Sqoop.

· 1+ years of hands-on experience working scripting language such as Python or SAS with BASE SAS, SAS MACRO, and SAS STAT.

· Experience with Spark, PySpark, Zeppelin and Jupyter Notebook is nice to have.

· Experience and knowledge of cloud technologies is preferred.

· Demonstrated experience implementing and automating ETL processes on large data sets.

· Experience with report development and supporting data requireme
 
Call 502-379-4456 Ext 100 for more details. Please provide Requirement id: 100245 while calling.
 
Other jobs in CA: Anaheim (4), Brea (3), Brisbane (2), Carlsbad (3), Concord (1), Culver City (1), Cupertino (5), Downtown Los Angeles (3), El Monte (3), El Segundo (1), Foothill Ranch (2), Irvine (1), La Jolla (2), Lake Forest (1), Larkspur Landing (1), Long Island (1), Los Angeles (27), Newport (1), Newport Beach (3), Orange (2), Orange County (7), Pasadena (1), Poway (5), Rancho Cordova (1), Redwood City (3), Sacrament (1), Sacramento (19), San Diego (87), San Francisco (24), San Jose (4), Simi Valley (1), South San Francisco (1), Westlake Village (2),
Hadoop job openings in San Francisco, CA
Jobs List

Senior Software Development Engineer
Create date: 26-Apr-2021
Description:

Top 3 required technical skills:

Automation Dev Ops Engineering [Hadoop, Spark]
Operational experience in real-time, streaming and data pipelines relevant frameworks [NiFi or Airflow]
Java/ Scala and Python programming
PCF or Cloud experience in general.

Role

.... (This job is for - Hadoop Spark Scala Jobs in CA SanFrancisco Engineer - (in San Francisco, CA))

Hadoop Admin - 68150
Create date: 30-Sep-2020
Candidate must be our W2 Employee.


Job Description :

Responsibilities

• Implementing, managing and administering the overall Hadoop infrastructure

• Adding and removing nodes using cluster monitoring tools like Ambari

• Support Hadoop cluster move to a different data center while ensuring.... (This job is for - Implementation Hadoop Python Jobs in CA SANFRANCISCO Administrator - (in San Francisco, CA))

Business Data Analyst - 64244
Create date: 18-Jun-2020
Candidate must be our W2 Employee.

Job Description :

Location:

· Can work Remote/Virtual - Will be supporting two regions LAC and NA, must be able to work core hours.

Contract:

· 1 year – strong chance of conversion

Interview Timeline:

· Phone, Skype Interviews: 2/3 .... (This job is for - Hadoop Hive Jobs in CA SanFrancisco Analyst - (in San Francisco, CA))

ML Infrastructure Consultant - 49833
Create date: 18-Jul-2019
Candidate must be our W2 Employee

We should submit only GC, GC EAD, L2 EAD, H4 EAD and Citizens.


Notes :
On-site interview Tuesday 7/16 for 30 minutes from 3-5pm. CANDIDATES MUST BE LOCAL.


Description:
our client has created a team to develop artificial intelligence-based technology and appoint.... (This job is for - Hadoop Jobs in CA SanFrancisco Consultant - (in San Francisco, CA))

Sr. Data Engineer - 16019
Create date: 12-Jul-2019
Description:

Our enterprise retail client in San Francisco is in need of Sr. Data Engineers to build out their next generation analytics platform. They want to add data science and deep learning to their supply chain and ecommerce analytics platform to allow them to leverage big data into actionable insights. With better forecasting accu.... (This job is for - Hadoop Spark Jobs in CA SanFrancisco Engineer - (in San Francisco, CA))
 
 Hadoop job openings in other states
Jobs List

Back End Java Developer - 85842
Create date: 03-Jun-2022
Description:

General skills
Nice to have

Databricks
Hadoop is preferred but any big Data warehousing experience

IT skills
Must have

Backend data experience
Data Warehousing
Java/springboot API knowledge
AWS
Datalayer knowledge (This job is for - Hadoop Jobs in NY NewYork Developer - (in New York, NY))

Data Warehouse Designer/Developer - 58707
Create date: 05-Oct-2021
Description:

Responsibilities

Our Client in Columbus, Ohio is seeking an experienced Data Warehouse Designer / Developer for a contract role.

CANDIDATES MUST BE LOCAL TO CENTRAL OHIO OR RELOCATED BY DAY ONE FOR CONSIDERATION.

The Data Warehouse Designer/Developer will be responsible for Enterprise data wa.... (This job is for - Hadoop ETL ELT Jobs in OH Columbus Developer - (in Columbus, OH))

Technical Specialist - 58686
Create date: 30-Sep-2021
Description:

Responsibilities

Our client in Columbus Ohio is seeking an Enterprise Data Warehouse / ETL Developer.

Local candidates are highly preferred. Candidates are required to report onsite on Day 1 of the assignment.

The Technical Specialist will be responsible for the clients Enterprise data wareho.... (This job is for - Hadoop ETL Jobs in OH Columbus Specialist - (in Columbus, OH))

Data Warehouse Designer / Developer - 58526
Create date: 20-Aug-2021
Description:

Our Client in Columbus, Ohio is seeking an experienced Data Warehouse Designer / Developer for a contract role

CANDIDATES MUST BE LOCAL TO CENTRAL OHIO OR RELOCATED BY DAY ONE FOR CONSIDERATION

The Data Warehouse Designer/Developer will be responsible for Enterprise data warehouse design, development, i.... (This job is for - Hadoop Hive Jobs in OH Columbus Developer - (in Columbus, OH))

Technical Specialist 3/TS3 - 83945 - SP
Create date: 07-Apr-2021
start date:5/3/2021

End date:06/30/2021

submission deadline:4/12/2021

client info : MCD


Note:

* Interviews: TEAMS

* The selected candidate does not have to be local to Columbus, OH and can work remotely

* REPOST OF 82361 AND 83069 - DO NOT RESUBMIT CANDIDATES Hadoop Jobs in OH Columbus Specialist - (in Columbus, OH))
 
 Hadoop job openings in CA
Jobs List

Senior Data Engineer - 73197
Create date: 23-Mar-2021
Note: Please only send candidates that are local to the area. They are only considering local candidates at this time. The previous retail experience is a big plus.

Candidate must be our W2 Employee.

Candidate must be local: Yes

Job Description:

Position Summary

* Very Strong engineering skill.... (This job is for - Hadoop Teradata Jobs in CA SanBruno Engineer - (in San Bruno, CA))

Data Engineer - 72884
Create date: 12-Mar-2021
Candidate must be our W2 Employee.

Job Description: Data Engineer

We are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. .... (This job is for - Hadoop Spark Kafka Jobs in CA SouthSanFrancisco Engineer - (in South San Francisco, CA))

Data Engineer - 68549
Create date: 15-Oct-2020
Job Description :

* Strong development skills around Hadoop, Hive, Pig Latin, Spark, Scalding, Map Reduce, Storm, Kafka

* Knowledge of Spark and NoSQL databases

* Have working experience in Google Cloud Platform

* Strong skills in object oriented design, Core Java, Scala, shell scripting/Python

Hadoop Hive Pig Jobs in CA Sunnyvale Engineer - (in Sunnyvale, CA))

Product Engineer - 64580
Create date: 01-Jul-2020
Note :Staff Aug

Candidate must be our W2 Employee.

Job Description :Essential Functions (Tasks and Responsibilities):

Partner closely with other Product Managers to understand new product offerings being built, and work with analysts to recommend the right metrics to measure performance of those features
<.... (This job is for - Hadoop Hive Spark Jobs in CA SanJose Engineer - (in San Jose, CA))

Data Engineer - 64436
Create date: 24-Jun-2020
Candidate must be our W2 Employee.

Candidate must be local : Yes

Job Description :

Day to Day Responsibilities:

1) Perform automation of test cases using pyspark/python

2) Perform manual query using SQL/Hive/pyspark/MongodB query

3) Perform data validation of different parameters fr.... (This job is for - AWS Hadoop MY SQL Jobs in CA SanJose Engineer - (in San Jose, CA))
(Engineer: Hadoop, Hive, SQL DBA, Python Shell Script Bachelors Degree in San Francisco, CA)
   
 
     
Search Jobs
     
Keywords,Title,Skills,Company  Location,City,State,Zip  
  Advanced Search
     
    About Us     Services    Privacy policy    Legal     Contact us     Copyright JobsInHand.com All Rights Reserved