Scala Python BASH Spark Cloudera Management Linux Scripting HBase Hive Kafka Microsof   Requirement id 101940 Job title Consultant Job location in Frankfort, KY Skills required Scala, Python, BASH, Spark Cloudera Management Linux Scriptin Open Date 09-Jan-2020 Close Date Job type Contract Duration 12 Months Compensation DOE Status requirement --- Job interview type --- Apply    Email Recruiter: coolsoft Job Description Consultant: Scala, Python, BASH, Spark Cloudera Management Linux Scriptin Description: Required Technologies: Scala Python Bash Spark Cloudera Distributed Hadoop (CDH) Linux HBase Hive Kafka YARN Elasticsearch Logstash Kibana Oracle Microsoft SQL Highly Desired Experience: ESRI ArcGIS stack Hortonworks Data Platform (HDP) Data Visualization and Reporting Tools (Tableau, Power BI) Data Formats (Avro, Parquet, CSV, Json, XML, GeoJson, WKT) Azure AWS ZooKeeper Impala R C# Jenkins Airflow Agile/Scrum methodology Team Foundation Server (TFS) Azure DevOps Git Job Tasks: Planning and management of the enterprise data environment Designing, capacity arrangement, cluster set up, performance fine-tuning, monitoring, scaling and administration of Hadoop and ELK clusters Work closely with infrastructure network teams to ensure business applications are highly available and performing Assist/advise on installing, administering, and supporting Linux operating systems in an enterprise environment Manage and analyze log files Responsible for the new and existing planning of infrastructure Design, build, install, configure and support Hadoop and Elastic technologies. Solution design and implementation Translate complex functional and technical requirements into detailed design. Build scalable, distributed, and fault tolerant data processing pipelines using Spark and Kafka Design solutions that operate with disparate data sets and sources Data lake implementation including its design to integrate unstructured, semi-structured and structured data Write Spark streaming applications to transform and load data into Kafka, HDFS, and SQL Server Transfer data from Kafka to Elasticsearch using Logstash Perform analysis of vast data stores and uncover insights Create scalable and high-performance web services for data tracking Work with business units to aid in optimizing data access patterns Experience in Bash, Scala, Python, SQL, programming languages Experience in Spark streaming and batch applications Propose best practices and standards for support and disaster recovery Practice proficient data warehouse standards and principles Data pipeline design and development from collection of data to published information Assure no data loss from source and ability to perform complex historical analysis to gain insights into temporal trends Leverage machine learning and traditional methods to perform analysis and uncover insights in both real time and historical including predictive analytics Build custom Kibana Dashboards to deliver real time analysis of integrated data Install and implement new software technologies as proof of concepts Responsible for software installation and configuration, database backup and recovery, database connectivity and security Use Git for source code, configuration, and template repositories Regularly document processes and data flows using Azure DevOps Wiki   Call 502-379-4456 Ext 100 for more details. Please provide Requirement id: 101940 while calling.   Other jobs in KY: Cynthiana (1), Louisville (4), Remote (2), Unknown (17),    Scala job openings in other states Jobs List Scala Developer-105020 Create date: 22-Feb-2023 Start date :02-22-2023 End Date :12-31-2023 Submission deadline :2/27/2023 Client Info :Charter Communications - Denver Note : REMOTE Description : --------------------------------------------- Things we are looking for: - Experienced with object oriented and functional.... (This job is for - Scala AWS Spark Jobs in CO Denver Developer - (in Denver, CO)) Scala Developer Create date: 25-Jan-2022 start date:As soon as possible End date:6 months (expected) submission deadline:1/31/2022 Description: Scala Developer – Remote and Direct Client Opportunity Key Skills: ETL, Scala, AWS The Role: The data engineer should be a techn.... (This job is for - Scala Jobs in NY Albany Developer - (in Albany, NY)) Scala Developer Create date: 20-Jan-2022 Description: The data engineer should be a technical contributor who has hands-on knowledge of all phases in building large-scale cloud-based distributed data processing systems and applications. You will be part of the Global Data & Analytics engineering technology team and will partner closely with a team of data scientists, business a.... (This job is for - Scala AWS Jobs in NY Albany Developer - (in Albany, NY)) Java Engineer - 73093 Create date: 18-Mar-2021 Note: Upon offer, it is required to show consultants W2 take home pay in the Exh A. Candidate must be our W2 Employee. Job Description: JAVA ENGINEER Top Requirements: Java/scala – most applications are Java/scala/python. 1 scala, 5-6 java based Ideally candidates have moved form java and wants to sta.... (This job is for - Java Scala Spark Jobs in VA Richmond Engineer - (in Richmond, VA)) Backend Developer - 72965 Create date: 15-Mar-2021 Candidate must be our W2 Employee. Job Description: Backend (Mid if Scala, Sr. if its anything else) Must-Haves (Concepts & Tools): · REST based Microservices architecture · Scala is HIGHLY preferred (Functional paradigm) o Java / JVM is ok if we cant find it…HAS to be someone that.... (This job is for - REST Scala Java Jobs in IL Chicago Developer - (in Chicago, IL))     (Consultant: Scala, Python, BASH, Spark Cloudera Management Linux Scriptin in Frankfort, KY)

Featured Jobs Agile Analyst (Jobs in Lansing, Michigan) MS Office Written Analyst (Jobs in Lansing, Michigan) SDLC Kanban Manager (Jobs in Austin, Texas) SMS WLM JCL Consultant (Jobs in ANDERSON, South Carolina) JSON Analyst (Jobs in Richmond, Virginia) Cloud Architect (Jobs in Columbia, South Carolina) Web Services SQL Architect (Jobs in Denver, Colorado) Bachelors Analyst (Jobs in Lansing, Michigan) IT Project Management Agile Budgeting Manager (Jobs in Raleigh, North Carol SSIS Analyst (Jobs in Richmond, Virginia)