Home       |     Overview      |     Candidate Login      |     Post Resume       |     Contact us
 
  
     
     
Search Jobs
     
Keywords,Title,Skills,Company  Location,City,State,Zip  
  Advanced Search
     
Executive Order 11246, Section 503 & VEVRAA EOE, including disability/vets
Python Pyspark Spark JSON Hadoop SQL Unix Environments. Excellent Communication Skill
 
Requirement id 115348
Job title Developer
Job location in DC Metro Commercial, DC
Skills required Python, Pyspark, Spark, JSON Hadoop SQL Unix Environments. Excel
Open Date 23-Mar-2021
Close Date
Job type Contract
Duration 7 Months
Compensation DOE
Status requirement ---
Job interview type ---
Apply
   Email Recruiter: coolsoft
Job Description Developer: Python, Pyspark, Spark, JSON Hadoop SQL Unix Environments. Excel

Note: Location: This position will be required to be onsite in Mclean, VA, following COVID. Interview Information: - 1st Round: Questionnaire (24-48 Hours to Complete) - 2nd Round: 60 Minute Final Interview.

Candidate must be our W2 Employee.

Job Description:

Senior Big Data Developer

Responsibilities include:

• Cleanse, manipulate and analyze large datasets (Structured and Unstructured data – XMLs, JSONs, PDFs) using Hadoop platform.

• Develop Python, PySpark, Spark scripts to filter/cleanse/map/aggregate data.

• Be able to build Dashboards in R/Shiny for end user consumption

• Manage and implement data processes (Data Quality reports)

• Develop data profiling, deduping logic, matching logic for analysis

• Programming Languages experience in Python, PySpark and Spark for data ingestion

• Programming experience in BigData platform using Hadoop platform

• Present ideas and recommendations on Hadoop and other technologies best use to management

Qualifications:

• 5+ years of experience in processing large volumes and variety of data (Structured and unstructured data, writing code for parallel processing, XMLS, JSONs, PDFs)

• 3+ years of programming experience in Hadoop, Spark, Python for data processing and analysis.

• Strong SQL experience is a must

• 3+ years of experience – using Hadoop platform and performing analysis. Familiarity with Hadoop cluster environment and configurations for resource management for analysis work

• Ability to work in a UNIX environment

• Detail oriented. Excellent communication skills (verbal and written)

• Must be able to manage multiple priorities and meet deadlines

• Degree in Computer Science, Statistics, Economics, Business, Mathematics or related field

Project Info / Reason for Opening: Supporting Risk Analysis project - they need to be comfortable with Python PySpark - This is really a development position. They get tons of data from the business, in a bunch of different formats (xml, json) they have to develop programs to parse all of these files into individual data elements and store in database.
 
Call 502-379-4456 Ext 100 for more details. Please provide Requirement id: 115348 while calling.
 
Other jobs in DC: Washington (6),
Python job openings in DC Metro Commercial, DC
Jobs List

Sr. Product Analyst - 73310
Create date: 25-Mar-2021
Note: *Please include answers to these question at the top of candidate resume. Submittals without answers will not be considered. Candidate responses will not be accepted via email. Additions or alterations to answers will not be accepted * 1) What challenge have you encountered in data projects? Interview Information: 2 Rounds 1st Round - 60 Minu.... (This job is for - Java Python Jobs in DC DCMetroCommercial Analyst - (in DC Metro Commercial, DC))

Python Developer - 72815
Create date: 10-Mar-2021
Note: Working on automating a solution for migration of FHFA project on the business resiliency/disaster recovery team.

Candidate must be our W2 Employee.

Job Description: Technology Infrastructure

• Strong knowledge of Unix, Database technologies, reading application logs, Autosys jobs.

• Perform automat.... (This job is for - Python Implementation Jobs in DC DCMetroCommercial Developer - (in DC Metro Commercial, DC))
 
 Python job openings in other states
Jobs List

QA Test Analyst Advanced - 65006
Create date: 21-Oct-2025
Start date :11/17/2025
End Date :09/30/2026

Submission deadline : 10/27/2025

Client Info : NeDHHS

Note:

* Remote Position

Description:

Position Title: BI QA Tester

Summary:

The State of Nebraska Department of Health and Human Services (DHHS) is seeking.... (This job is for - PythonTableau Jobs in NE Lincoln Analyst - (in Lincoln, NE))

PTC - Artificial Intelligence Developer (778008)
Create date: 29-Sep-2025
Start Date : 10/13/2025
End Date : 06/30/2026

Submission Deadline : 10/03/2025

Client Info: PTC

Note:

* Hybrid: Remote and on location work as needed along the Turnpike (Onsite work is usually 3-4 days per month)

Description :

We are looking for a Machine Lea.... (This job is for - Python OOP Jobs in PA DauphinCounty Developer - (in Dauphin County, PA))

Data Analyst Intern
Create date: 04-Sep-2025
Data Analyst Intern

. Assist Business Analysts in documenting current business procedures and processes
. Assist in the creation of documentation for business rules and data
. Create and validate data structures
. Assist in quality assurance and quality check of data
. Develop programs and applications for automated d.... (This job is for - Python Jobs in FL SpringHill Analyst - (in Spring Hill, FL))

Agentic Data Engineer(766844)
Create date: 08-Jul-2025
Start Date :7/21/2025
End Date :12/31/2025

Submission Deadline :7/11/2025

Client Info: VDOT

Note :

* Agency Interview Type : Both Phone and In Person


* Hybrid

Description :

The Virginia Department of Transportations Information T.... (This job is for - PythonSpark Jobs in VA Richmond Engineer - (in Richmond, VA))

Elect - Enterprise Architect 4 (765006)
Create date: 03-Jun-2025
Start date : 06/16/2025

End Date : 12/31/2025

Submission deadline : 06/09/2025

Client Info : ELECT

Note:

* Agency Interview Type : Web Cam Interview Only

* Hybrid

Description :

The position will act as the Technical Lead for an established development team that.... (This job is for - Azure Python JavaScript Jobs in VA Richmond Architect - (in Richmond, VA))
 
 
(Developer: Python, Pyspark, Spark, JSON Hadoop SQL Unix Environments. Excel in DC Metro Commercial, DC)
     
Search Jobs
     
Keywords,Title,Skills,Company  Location,City,State,Zip  
  Advanced Search
     

    About Us     Services    Privacy policy    Legal     Contact us