Home       |     Overview      |     Candidate Login      |     Post Resume       |     Contact us
 
  
     
     
Search Jobs
     
Keywords,Title,Skills,Company  Location,City,State,Zip  
  Advanced Search
     
Executive Order 11246, Section 503 & VEVRAA EOE, including disability/vets
GIT CI/CD Pyspark Engineer
(Jobs in Boston, MA)
 
Requirement id 113711
Job title Engineer
Job location in Boston, MA
Skills required GIT, CI/CD, Azure DevOps, Pyspark
Open Date 04-Feb-2021
Close Date
Job type Contract
Duration 6 Months
Compensation DOE
Status requirement ---
Job interview type ---
Apply
   Email Recruiter: coolsoft
Job Description Engineer: GIT, CI/CD, Azure DevOps, Pyspark

Note: 100% Remote (working EST hours, EST preferred)

Candidate must be our W2 Employee.

Job Description:

Responsibility:

Implement scaleable and sustainable data engineering solutions using Azure Databricks, PySpark and PySQL. The data pipelines must be created, maintained, and optimized as workloads move from development to production for specified use cases.
Identify appropriate (and innovative) data ingestion, preparation, integration, and operationalization techniques in optimally addressing the data requirements.
Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained.
Working within an Agile delivery / DevOps methodology

Competency:

Direct experience of building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks).
Strong ability to design, build and manage data pipelines for data structures encompassing data transformation, data models, metadata, and workload management. The ability to work with IT in integrating analytics and data science output into business processes and workflows.
Deep hands-on development expertise in data architecture, batch, and real-time data integration, Azure Databricks, Apache Spark, relational databases (SQL Server).
Must be team oriented with strong collaboration, prioritization, and adaptability skills required.
Experience with Apache Kafka.

Required Skills/Technologies

Bachelors degree in Computer Science, Information Systems, Business Administration, or other related field.
Minimum of 10 years IT experience encompassing the following
Azure Databricks

o Delta

o Scala / Pyspark / Spark SQL

o PySQL (or SQL Plus)

o Azure DevOps

o Git for CI/DC

o Azure Data Factory

o Azure SQL Database

o Azure Data Lake experience

o Some Data Science exposure just from an analysis perspective
 
Call 502-379-4456 Ext 100 for more details. Please provide Requirement id: 113711 while calling.
 
Other jobs in MA: Boston (103), Burlington (1), Cambridge (1), Canton (3), Chelsea (9), Franklin (1), Lexington (2), Malden (10), Marlborough (2), Maynard (2), Newton (1), Quincy (6), Sharon (1), Waltham (1), Welesley (1), Wellesley (6), Westborough (1), Westbourough (1),
 
 GIT job openings in other states
Jobs List

INTERNET/WEB ENGINEER PROJECT LEAD - 8463
Create date: 21-Oct-2025
Start date :12/1/2025
End Date :12 Months from projected start date

Submission deadline :10/28 at 5:00 PM EST.

Client Info : SCDHHS

Note:

* Interview Process: 1 round, Virtual/Online

* Work Location: Remote

* Candidate Location: No SC residency required. Open to nationwide .... (This job is for - GIT JavaScript Jobs in SC Columbia Engineer - (in Columbia, SC))

Application Architect II - 142586
Create date: 08-May-2025
Start date : 06/02/2025

End Date : 06/30/2025

Submission deadline : 5/12/2025 4:00:00 PM

Client Info : ETF

Note:

* Interview Process: 1 Interview via MS Teams

* Duration: 6/30/2025, likely to extend

* Onsite or Remote? Must be a CURRENT WI resident. No relocation al.... (This job is for - GIT Jobs in WI Madison Architect - (in Madison, WI))

NCDOT - Specialist- Expert (737022)
Create date: 21-May-2024
Hybrid

No of Submissions : 2

start date :06/29/2024

End date :06/28/2025

submission deadline : 05/22/2024

client info : NCDOT

Description :

***The candidate will be allowed to work remotely until all staff return to site. At t.... (This job is for - GIT Jobs in NC Raleigh Specialist - (in Raleigh, NC))

NC FAST Senior Automation Engineer (734136)
Create date: 26-Apr-2024
No of Submissions : 1

Start date : 05/06/2024

End date : 05/02/2025

Submission deadline : 05/02/2024

Client info : NCDHHS-NCFAST

Note :

* Hybrid

Description :

The primary role is to lead Automation effort of infrast.... (This job is for - GITAutomation Jobs in NC Raleigh Engineer - (in Raleigh, NC))

Applications Developer Lead - SME Level - 128505
Create date: 21-Mar-2024
Start date : 4/22/2024

End date : 09/30/2024

Submission deadline : 3/28/2024 3:00:00 PM

Client info : MDEK12

Note :

* 100% remote

Description :

The Mississippi Department of Education is seeking an Application Developer to.... (This job is for - GIT Azure Jobs in MS Jackson Developer - (in Jackson, MS))
 
 GIT job openings in MA
Jobs List

Technical Lead III-US - 73551
Create date: 31-Mar-2021
Note: no subvending long term contract, fully remote candidates can sit anywhere in the us as long as they can work on EST.

Candidate must be our W2 Employee.

Job Description:

Position: Azure Technical Lead

Location: Remote

Duration: 1+ year

Position Description:

Our IT Cl.... (This job is for - GIT PowerShell Jobs in MA Waltham TechLead - (in Waltham, MA))

Release Engineer - 38156
Create date: 04-Sep-2018
Job Description :

Position Description:

It is looking for a DevOps Engineer to help support product engineering by:

Providing technical guidance and leadership in the construction of a new build environment to host a large system composed of many subsystems including a Linux based distribution, open source packa.... (This job is for - GIT Jobs in MA Lowell Engineer - (in LOWELL, MA))
(Engineer: GIT, CI/CD, Azure DevOps, Pyspark in Boston, MA)
     
Search Jobs
     
Keywords,Title,Skills,Company  Location,City,State,Zip  
  Advanced Search
     

    About Us     Services    Privacy policy    Legal     Contact us