Spark Scala Developer

2 weeks ago


Secunderabad, Telangana, India Corporate Resources Full time
Job Description
  • 4+ years of experience with Java, Spark, Bigdata & Hadoop with strong Unix background
  • Create Scala/Spark jobs for data transformation and aggregation
  • Experience of writing code in spark and Scala
  • Produce unit tests for Spark transformations and helper methods
  • Write Scaladoc-style documentation with all code
  • Design data processing pipelines
  • Scala (with a focus on the functional programming paradigm)
  • Spark query tuning and performance optimization
  • SQL database integration {{ Microsoft, Oracle, Postgres, and/or MySQL }}
  • Experience working with {{ HDFS, S3, Cassandra, and/or DynamoDB }}
  • Deep understanding of distributed systems (e.g. CAP theorem, partitioning, replication, consistency, and consensus)
  • Scala, Spark, Hive, Hadoop & spark Architecture and its components such as HDFS, Job Tracker, Task Tracker, executor cores and memory params.
  • Spark and Spark Streaming creating RDDs, applying operations -Transformation and Actions.
  • Code optimizes to fine tune the applications.
  • Develop Shell scripts to orchestrate execution of all other scripts and move the data files within and outside of HDFS.
  • Industry
  • IT-Software / Software Services
  • Functional Area
  • IT Software - Application Programming, Maintenance
  • Job Role
  • Software Developer
  • Job Type
  • Permanent
Qualification
  • UG Qualification
  • B.Tech/B.E - Computers
  • PG Qualification
  • Any Post Graduate - Any Specialization
  • Doctorate
  • Doctorate Not Required - None
Desired Candidate Profile Please refer to the Job description above
  • Spark Scala Developer

    2 weeks ago


    Secunderabad, Telangana, India Corporate Resources Full time

    Job Description4+ years of experience with Java, Spark, Bigdata & Hadoop with strong Unix backgroundCreate Scala/Spark jobs for data transformation and aggregationExperience of writing code in spark and ScalaProduce unit tests for Spark transformations and helper methodsWrite Scaladoc-style documentation with all codeDesign data processing pipelinesScala...

  • Pyspark Developer

    2 weeks ago


    Secunderabad, Telangana, India Corporate Resources Full time

    Job Description 1. Knowledge of the key phases of software delivery lifecycle and established software development methodologies 2. Must have strong understanding of data architecture, data integration and data management processes, ability to develop transformation logic in Spark-SQL based on dataframes 3. 4 to 7 years of expertise in data and...


  • Secunderabad, Telangana, India Corporate Resources Full time

    Job Description5+ years of hands on technical expertise in Data projectsSHOULD HAVE thorough knowledge and working experience with Java and SparkSHOULD be able to write complex SQL queriesMust be excellent in written/verbal communication skills and working closely with business team and project team.Strong Unix Shell Scripting, Java, Python, Experience in...


  • Secunderabad, Telangana, India Corporate Resources Full time

    Job Description 6 to 10 years of experience with an engineering degree in Computer Science or related degree Excellent coding in Java and/or Scala and an ability to learn/advance rapidly, transitioning from other programming languages Experience implementing RESTful and WebSocket based services with APIs Strong object oriented design ability Youre a...

  • Spark Developer

    3 months ago


    secunderabad, India Corporate Resources Full time

    Job Description Strong knowledge on Python and Spark Strong SQL and data analysis skills Good Pandas and Numpy knowledge Strong knowledge on SQL & PLSQL(especially stored procedures) Understand the current application infrastructure and suggest changes to it Define and document best practices...


  • secunderabad, India Corporate Resources Full time

    Job Description 5 years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive) Experience in writing SQL for any one relation database ex.Oracle Extensive knowledge in HiveSQL Hadoop, SQL Experience in DevOps process (CICD, Jira, Bitbucket) Primary Skills, Spark with Java, Hadoop,...


  • secunderabad, India Corporate Resources Full time

    Job Description 5 years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive) Experience in writing SQL for any one relation database ex.Oracle Extensive knowledge in HiveSQL Hadoop, SQL Experience in DevOps process (CICD, Jira, Bitbucket) Primary Skills, Spark with Java, Hadoop,...


  • Secunderabad, India Corporate Resources Full time

    Job Description5 years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive)Experience in writing SQL for any one relation database ex.OracleExtensive knowledge in HiveSQL Hadoop, SQLExperience in DevOps process (CICD, Jira, Bitbucket)Primary Skills, Spark with Java, Hadoop, Hive, Control-MSecondary Skills, Unix, AWS Cloud, GIT, Jira,Good to...


  • secunderabad, India Corporate Resources Full time

    Job Description 5+ years of hands on technical expertise in Data projects SHOULD HAVE thorough knowledge and working experience with Java and Spark SHOULD be able to write complex SQL queries Must be excellent in written/verbal communication skills and working closely with business team and...


  • secunderabad, India Corporate Resources Full time

    Job Description 6 to 10 years of experience with an engineering degree in Computer Science or related degree Excellent coding in Java and/or Scala and an ability to learn/advance rapidly, transitioning from other programming languages Experience implementing RESTful and WebSocket based services with...


  • secunderabad, India Corporate Resources Full time

    Job Description 6 to 10 years of experience with an engineering degree in Computer Science or related degree Excellent coding in Java and/or Scala and an ability to learn/advance rapidly, transitioning from other programming languages Experience implementing RESTful and WebSocket based services with...


  • Hyderabad/ Secunderabad, India timesjobs Full time

    ## ### Technical Skill Requirements Retail Inventory / Supply Chain Python Pyspark Scala Java SQL Strong Object and Functional programming experience in Python Project Management Architecture Design### Role and Responsibilities Strong functional knowledge in Retail Inventory / Supply Chain domain Working experience and communicating with business...


  • Hyderabad/ Secunderabad, India timesjobs Full time

    ## ### Technical Skill Requirements Retail Inventory / Supply Chain Python Pyspark Scala Java SQL Strong Object and Functional programming experience in Python Project Management Architecture Design### Role and Responsibilities Strong functional knowledge in Retail Inventory / Supply Chain domain Working experience and communicating with business...


  • Hyderabad / Secunderabad, Telangana, India ALLEGIS SERVICES (INDIA) PRIVATE LIMITED (RPO) Full time

    Hi All, Hiring for Data Engineer- Only from Product based or GIC Insurance or Service based with Banking Projects-Hyderabad- F2F Interview(25th&26th May) Mandatory skill set- Data Engineer, Spark, Pyspark, SQL Only product &Service based with Banking Projects Expiriance-4-9 Yrs. Location: Hyderabad Interview Mode-Only F2F- (25th&26th May)-Saturday& Sunday...


  • Hyderabad/ Secunderabad, India timesjobs Full time

    # ## IntroductionIn this role, youll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption...

  • Java Kafka Developer

    4 weeks ago


    Hyderabad/ Secunderabad, India timesjobs Full time

    ### Must be Good in Java, J2EE, Spring, KAFKA Spark Prior work experience in developing and interfacing with web services, RESTful, and JSON are required Must be very comfortable with Database concepts, query optimization of relational databases Prior experience or good knowledge of Kafka, Spring Batch would be nice to have. Experience with streaming in...

  • Java Kafka Developer

    2 months ago


    Hyderabad/ Secunderabad, India timesjobs Full time

    ### Must be Good in Java, J2EE, Spring, KAFKA Spark Prior work experience in developing and interfacing with web services, RESTful, and JSON are required Must be very comfortable with Database concepts, query optimization of relational databases Prior experience or good knowledge of Kafka, Spring Batch would be nice to have. Experience with streaming in...


  • Hyderabad/ Secunderabad, India timesjobs Full time

    # ## IntroductionIn this role, youll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption...

  • SRE Manager Big Data

    4 weeks ago


    Hyderabad/ Secunderabad, India timesjobs Full time

    Role & ResponsibilitiesWe are seeking a hands-on Manager who has experience leading large Big Data environments spread across thousands of nodes and petabytes of data.We look forward to a dynamic manager with a background & experience that looks like this:Grown into leadership roles after proving technical skills in individual contributor roles but still...

  • SRE Manager Big Data

    2 months ago


    Hyderabad/ Secunderabad, India timesjobs Full time

    Role & ResponsibilitiesWe are seeking a hands-on Manager who has experience leading large Big Data environments spread across thousands of nodes and petabytes of data.We look forward to a dynamic manager with a background & experience that looks like this:Grown into leadership roles after proving technical skills in individual contributor roles but still...


  • Secunderabad, India Corporate Resources Full time

    Job DescriptionData Engineering (Big data/Spark) and Analytics.Advance Analytics - Azure Synapse Analytics and AI and ML experience.ETL/Data warehousing experience.Containers and Serverless platform experience.Cloud Application Development – Azure Cloud Native & Microservices Architecture expertise.Handled major Azure projects in the...


  • secunderabad, India Corporate Resources Full time

    Job Description Bachelors or Masters in Computer Science, Engineering Excellent analytical and logical skills Strong knowledge of good engineering practices: coding standards, best practices, design patterns, modularity, use of abstractions, defensive coding, etc. Must have strong background of...

  • Azure Technical Lead

    4 weeks ago


    Hyderabad/ Secunderabad, India timesjobs Full time

    : Microsoft Azure Data Engineer Associate Certification 7 years of strong SQL experience 5 years of experience in Designing, building and launching extremely efficient & reliable data pipelines for movement of data to and from disparate source systems 4 years of experience in working with Microsoft Azure and strong knowledge about Even Hub, ADLS, Blob...

  • Azure Technical Lead

    2 months ago


    Hyderabad/ Secunderabad, India timesjobs Full time

    : Microsoft Azure Data Engineer Associate Certification 7 years of strong SQL experience 5 years of experience in Designing, building and launching extremely efficient & reliable data pipelines for movement of data to and from disparate source systems 4 years of experience in working with Microsoft Azure and strong knowledge about Even Hub, ADLS, Blob...