Python Pyspark Spark JSON Hadoop SQL Unix Environments. Excellent Communication Skill   Requirement id 115348 Job title Developer Job location in DC Metro Commercial, DC Skills required Python, Pyspark, Spark, JSON Hadoop SQL Unix Environments. Excel Open Date 23-Mar-2021 Close Date Job type Contract Duration 7 Months Compensation DOE Status requirement --- Job interview type --- Apply    Email Recruiter: coolsoft Job Description Developer: Python, Pyspark, Spark, JSON Hadoop SQL Unix Environments. Excel Note: Location: This position will be required to be onsite in Mclean, VA, following COVID. Interview Information: - 1st Round: Questionnaire (24-48 Hours to Complete) - 2nd Round: 60 Minute Final Interview. Candidate must be our W2 Employee. Job Description: Senior Big Data Developer Responsibilities include: • Cleanse, manipulate and analyze large datasets (Structured and Unstructured data – XMLs, JSONs, PDFs) using Hadoop platform. • Develop Python, PySpark, Spark scripts to filter/cleanse/map/aggregate data. • Be able to build Dashboards in R/Shiny for end user consumption • Manage and implement data processes (Data Quality reports) • Develop data profiling, deduping logic, matching logic for analysis • Programming Languages experience in Python, PySpark and Spark for data ingestion • Programming experience in BigData platform using Hadoop platform • Present ideas and recommendations on Hadoop and other technologies best use to management Qualifications: • 5+ years of experience in processing large volumes and variety of data (Structured and unstructured data, writing code for parallel processing, XMLS, JSONs, PDFs) • 3+ years of programming experience in Hadoop, Spark, Python for data processing and analysis. • Strong SQL experience is a must • 3+ years of experience – using Hadoop platform and performing analysis. Familiarity with Hadoop cluster environment and configurations for resource management for analysis work • Ability to work in a UNIX environment • Detail oriented. Excellent communication skills (verbal and written) • Must be able to manage multiple priorities and meet deadlines • Degree in Computer Science, Statistics, Economics, Business, Mathematics or related field Project Info / Reason for Opening: Supporting Risk Analysis project - they need to be comfortable with Python PySpark - This is really a development position. They get tons of data from the business, in a bunch of different formats (xml, json) they have to develop programs to parse all of these files into individual data elements and store in database.   Call 502-379-4456 Ext 100 for more details. Please provide Requirement id: 115348 while calling.   Other jobs in DC: Washington (6), Python job openings in DC Metro Commercial, DC Jobs List Sr. Product Analyst - 73310 Create date: 25-Mar-2021 Note: *Please include answers to these question at the top of candidate resume. Submittals without answers will not be considered. Candidate responses will not be accepted via email. Additions or alterations to answers will not be accepted * 1) What challenge have you encountered in data projects? Interview Information: 2 Rounds 1st Round - 60 Minu.... (This job is for - Java Python Jobs in DC DCMetroCommercial Analyst - (in DC Metro Commercial, DC)) Python Developer - 72815 Create date: 10-Mar-2021 Note: Working on automating a solution for migration of FHFA project on the business resiliency/disaster recovery team. Candidate must be our W2 Employee. Job Description: Technology Infrastructure • Strong knowledge of Unix, Database technologies, reading application logs, Autosys jobs. • Perform automat.... (This job is for - Python Implementation Jobs in DC DCMetroCommercial Developer - (in DC Metro Commercial, DC))    Python job openings in other states Jobs List Elect - Enterprise Architect 4 (765006) Create date: 03-Jun-2025 Start date : 06/16/2025 End Date : 12/31/2025 Submission deadline : 06/09/2025 Client Info : ELECT Note: * Agency Interview Type : Web Cam Interview Only * Hybrid Description : The position will act as the Technical Lead for an established development team that.... (This job is for - Azure Python JavaScript Jobs in VA Richmond Architect - (in Richmond, VA)) Elect - Cloud Developer 3 (761296) Create date: 07-Apr-2025 Remote Start date : 04/21/2025 End Date : 12/31/2025 Submission deadline : 04/14/2025 Client Info : ELECT Note: * Agency Interview Type: Web Cam Interview Only * The Virginia Department of Elections (ELECT) is seeking an Azure Developer with minimum 3 years experience to w.... (This job is for - Python CI CD Jobs in VA Richmond Developer - (in Richmond, VA)) System Administrator - 9216402 Create date: 21-Mar-2025 Start Date :4/1/2025 End Date :06/30/2025 Submission Deadline :3/26/2025 Client Info: CO OIT Note: * Remote Position * Candidate must be Local Description : A DMV check will also need to be completed with the standard background check by the.... (This job is for - Python DNS Jobs in CO Denver Administrator - (in Denver, CO)) VSP - IT Security Analyst 4 (760300) Create date: 20-Mar-2025 Start date : 03/31/2025 End Date : 09/30/2025 Submission deadline : 03/26/2025 Client Info : VSP Note: * Agency Interview Type : In Person Only * Hybrid Description : ·Analyze the securityimpact of application, configuration, and infrastructure changes to ensur.... (This job is for - PythonCJIS Jobs in VA Richmond Analyst - (in Richmond, VA)) Application Architect IV-140732 Create date: 07-Mar-2025 No of Submissions : 2 Start date : 03/17/2025 End Date : 4 Months from projected start date Submission deadline : 3/13/25 at 4:00PM CST. Client Info : UW - Madison Note: * PLEASE READ THE ADDITIONAL DETAILS SECTION. There is no predetermined candidate, but the manager is looking to.... (This job is for - Python Jobs in WI Madison Architect - (in Madison, WI))     (Developer: Python, Pyspark, Spark, JSON Hadoop SQL Unix Environments. Excel in DC Metro Commercial, DC)

Featured Jobs SharePoint Analyst (Jobs in Pontiac, Michigan) IIS Troubleshooting Architecting JAVA Architect (Jobs in Madison, Wisconsin DAX ETL Administrator (Jobs in Lansing, Michigan) IIS Architecting Business Architect (Jobs in Madison, Wisconsin) HCM SaaS IT Analyst (Jobs in Raleigh, North Carolina) ITSM Architect (Jobs in Madison, Wisconsin) Analytical Skills System Architect (Jobs in Madison, Wisconsin) OOAD C# Developer (Jobs in Richmond, Virginia) DHCP Firewall Written Engineer (Jobs in Richmond, Virginia) Business Consultant (Jobs in Richmond, Virginia)