Spark Scala

3 weeks ago

Chennai, India Cognizant Full time

Strong expertise in Big Data ecosystem like Spark, Hive, Sqoop, HDFS, Map Reduce, Kafka, Oozie, Yarn, Hbase, Nifi.
- In depth Knowledge on Architecture of Distributed Systems and Parallel Computing.
- Experience implementing end to end data pipelines for serving reporting and data science capabilities.
- Strong experience working with various configurations of Spark like broadcast thresholds, increasing shuffle partitions, caching, repartitioning etc., to improve the performance of the jobs.
- In depth knowledge on import/export of data from Databases using Sqoop.
- Well versed in writing complex hive queries using analytical functions.
- Knowledge in writing custom UDF's in Hive to support custom business requirements.
- Solid experience in using the various file formats like CSV, TSV, Parquet, ORC, JSON and AVRO.
- Experience in using the compression techniques like Gzip, Snappy with in Hadoop.
- Strong knowledge of NoSQL databases and worked with HBase, Cassandra and Mongo DB.
- Experience in using the cloud services like Amazon EMR, S3, EC2, Red shift and Athena.
- Experience automating end-to-end data pipelines with strong resilience and recoverability.
- Worked on Spark Streaming and Structured Spark streaming including Kafka for real time data processing.
- Strong knowledge of version control systems like SVN and GITHUB.
- Involved in production monitoring using workflow monitor and experience in development and support environments.
- Experienced in using waterfall, Agile and Scrum models of software development process framework.

**Employee Status **:Full Time Employee

**Shift **:Day Job

**Travel **:No

**Job Posting **:Feb 16 2023

**About Cognizant

  • Spark Scala

    1 month ago

    Chennai, India Cognizant Full time

    Primary Skill : Spark, Scala - Secondary Skill : Python, AWS, Shell Scripting- Strong hands on experience on Spark/Scala - Good Understanding experience in Hadoop, Hive, Oozie, HDFS, YARN, Sqoop - Good understanding in AWS services - Should have experience/understanding of AWS design and architectural concepts - Clear in communication, ability to understand...

  • Scala Spark Developers

    2 weeks ago

    Chennai, India PTS Consulting Full time

    We are seeking Experienced Scala Spark developers with extensive experience to join our growing Data Engineering practice delivering transformative solutions. We strongly encourage immediate joiners. Location :Pune, Bangalore & ChennaiSkill : Spark ScalaTotal Exp: 5-8years, Relevant Experience : 3-7yearsMandatory Skills for screening :Big Data on...

  • Scala Spark Developers

    2 weeks ago

    Chennai, India PTS Consulting Full time

    We are seeking Experienced Scala Spark developers with extensive experience to join our growing Data Engineering practice delivering transformative solutions. We strongly encourage immediate joiners.Location :Pune, Bangalore & Chennai Skill : Spark Scala Total Exp: 5-8years, Relevant Experience : 3-7years Mandatory Skills for screening :  Big Data on...

  • Scala Spark Developers

    2 weeks ago

    chennai, India PTS Consulting Full time

    We are seeking Experienced Scala Spark developers with extensive experience to join our growing Data Engineering practice delivering transformative solutions. We strongly encourage immediate joiners. Location :Pune, Bangalore & Chennai   Skill : Spark Scala   Total Exp: 5-8years, Relevant Experience : 3-7years   Mandatory Skills for screening :   ...

  • Spark+ Scala

    2 months ago

    Chennai, India Nityo Infotech Full time

    Duties , India , Level , Location , PAN , Scala , Spark Experience Required 3 - 9 Years Industry Type IT Employment Type Permanent Location India

  • Spark+scala

    2 months ago

    Chennai, India Nityo Infotech Full time

    Chennai , Duties , Hyderabad , Level , Location , Pune , Scala , Spark Experience Required 3 - 6 Years Industry Type IT Employment Type Permanent Location India

  • Spark Scala Developer

    1 month ago

    chennai, India RiskInsight Consulting Pvt Ltd Full time

    Design, develop, and maintain data processing pipelines using Apache Spark and Scala. Optimize Spark jobs for performance, scalability, and reliability. Work closely with data engineers and data scientists to implement data-driven solutions. Develop and maintain ETL processes to ingest, transform, and load large volumes of data. Perform data analysis...

  • Spark Scala Developer

    1 month ago

    Chennai, India RiskInsight Consulting Pvt Ltd Full time

    Design, develop, and maintain data processing pipelines using Apache Spark and Scala. Optimize Spark jobs for performance, scalability, and reliability. Work closely with data engineers and data scientists to implement data-driven solutions. Develop and maintain ETL processes to ingest, transform, and load large volumes of data. Perform data analysis and...

  • Spark Scala Developer

    1 month ago

    Chennai, India RiskInsight Consulting Pvt Ltd Full time

    Design, develop, and maintain data processing pipelines using Apache Spark and Scala.Optimize Spark jobs for performance, scalability, and reliability.Work closely with data engineers and data scientists to implement data-driven solutions.Develop and maintain ETL processes to ingest, transform, and load large volumes of data.Perform data analysis and...

  • Bigdata Spark/scala

    2 months ago

    Chennai, India Nityo Infotech Full time

    Duties , India , Level , Location , PAN , Scala , Spark Experience Required 3 - 6 Years Industry Type IT Employment Type Permanent Location India

  • Spark/Scala Developer

    2 weeks ago

    Chennai, India RiskInsight Consulting Pvt Ltd Full time

    About the job :- Design, develop, and maintain data processing pipelines using Apache Spark and Scala- Optimize Spark jobs for performance, scalability, and reliability- Work closely with data engineers and data scientists to implement data-driven solutions- Develop and maintain ETL processes to ingest, transform, and load large volumes of data- Perform data...

  • Spark/Scala Developer

    2 weeks ago

    chennai, India RiskInsight Consulting Pvt Ltd Full time

    About the job :- Design, develop, and maintain data processing pipelines using Apache Spark and Scala- Optimize Spark jobs for performance, scalability, and reliability- Work closely with data engineers and data scientists to implement data-driven solutions- Develop and maintain ETL processes to ingest, transform, and load large volumes of data- Perform data...

  • Spark/Scala Developer

    2 weeks ago

    Chennai, India RiskInsight Consulting Pvt Ltd Full time

    About the job :- Design, develop, and maintain data processing pipelines using Apache Spark and Scala- Optimize Spark jobs for performance, scalability, and reliability- Work closely with data engineers and data scientists to implement data-driven solutions- Develop and maintain ETL processes to ingest, transform, and load large volumes of data- Perform data...

  • Big Data

    2 months ago

    Chennai, India Nityo Infotech Full time

    Big Data , Data , Description , Job , Level , Location , Pune , Scala , Spark Experience Required 3 - 12 Years Industry Type IT Employment Type Permanent Location India

  • Big Data- Spark Scala

    2 months ago

    Chennai, India Nityo Infotech Full time

    A , Bangalore , Big Data , Data , Level , Level A , Location , Pune , Scala , Spark Experience Required 3 - 9 Years Industry Type IT Employment Type Permanent Location India

  • Big Data- Spark Scala

    2 months ago

    chennai, India Nityo Infotech Full time

    A , Bangalore , Big Data , Data , Level , Level A , Location , Pune , Scala , Spark Experience Required 3 - 9 Years Industry Type IT Employment Type Permanent Location India

  • Big Data

    2 months ago

    chennai, India Nityo Infotech Full time

    Big Data , Data , Description , Job , Level , Location , Pune , Scala , Spark Experience Required 3 - 12 Years Industry Type IT Employment Type Permanent Location India

  • CGI - Big Data Engineer - Scala/Spark

    2 months ago

    Pune,Bangalore,Chennai,Hyderabad, India CGI Information Systems and Management Consultants Full time

    Job Description : - Experience in application development experience in Scala, Spark, scala test/Junit libraries with maven.- Experience on Hive, Spark using Cloudera data platform.- Knowledge of performance optimization on Hadoop platform, Spark and Scala.- Ability to write optimized SQL queries.- Ability to learn & adapt.- Ability to communicate in clear...

  • Spark Scala Data Engineer

    4 days ago

    Chennai, India CAPCO Full time

    Spark Scala Data Engineer - Bangalore/ Chennaiat Capco IndiaJob Title: Data Engineer with Spark and ScalaAbout Us“Capco, a Wipro company, is a global technology and management consulting firm. Awarded withConsultancy of the year in the British Bank Awardand has been rankedTop Best Companies for Women in India by. With our presence across 32 cities across...

  • Big Data- Spark Scala

    1 month ago

    Chennai, India Nityo Infotech Full time

    A , Bangalore , Big Data , Data , Level , Level A , Location , Pune , Scala , SparkExperience Required3 - 9 YearsIndustry TypeITEmployment TypePermanentLocationIndia