Bigdata

2 weeks ago


Hyderabad, Telangana, India Ness Digital Engineering Full time

Description:

Why Choose Ness?

We understand the value of our people. The professionalism, innovation, teamwork, and commitment to excellence from our staff have propelled us to the forefront of the technology industry. These characteristics are crucial to our continuous growth. As a member of the Ness team, you'll be involved in developing products and platforms for some of the most forward-thinking software companies globally.

Working alongside talented professionals will enhance your career progression and offer various benefits such as training, certifications, bonuses, social activities, and competitive compensation.

Requirements and Responsibilities:

What You'll Do:

  • Design & Build ingestion pipelines using ELT and schema on read in Databricks Delta Lake
  • Design & Develop "Transformations" aspects using the ELT framework for modernizing Ingestion pipelines
  • Collaborate with other data and Data Science teams on Ingestion pipeline development
  • Offer technical expertise in designing and implementing Ratings Data Ingestion pipelines with modern cloud technologies
  • Establish and maintain a high-performance data environment
  • Ensure data governance, quality checks, and data lineage are implemented
  • Stay updated on Big Data and cloud technologies trends
  • Ensure compliance with enterprise standards and best practices

What You'll Bring:

  • Experience in issue resolution and providing guidance to teams
  • Ability to translate requirements into solutions
  • Familiarity with Machine Learning Libraries and Frameworks
  • Proficiency in Agile software development and implementing Agile principles
  • Monitoring industry trends and presenting technical recommendations
  • Strong analytical, interpersonal, and communication skills
  • Capacity to prioritize and manage work efficiently
  • Experience in the financial services industry

Desirable Skills:

  • Degree in Computer Science, Information Technology, or related field
  • 8+ years of experience as a data engineer
  • Hands-on experience with AWS/Azure cloud technologies
  • Expertise in building applications using various tools for data ingestion
  • Proficiency in SDLC cycle practices

If you resonate with this role, we encourage you to apply even if you don't meet every requirement. Many candidates find their fit with us. Let's connect and explore the opportunities together. At Ness Digital Engineering, we are committed to fostering a diverse, inclusive, and authentic work culture.


  • BigData - Tech Lead

    2 weeks ago


    Hyderabad, Telangana, India Virtusa Full time

    BigData - Tech Lead - CREQ186711 Description Job Description: Responsibilities: Responsible for Design, Build & deployment the Solution in Bigdata. Ability to effectively use complex analytical, interpretive and problem solving techniques. Analytical, flexible, team-oriented and has good interpersonal/communication skills. Apply Internal...

  • BigData Developer

    2 weeks ago


    Hyderabad, Telangana, India Virtusa Full time

    BigData Developer - CREQ189748 Description Job Description: 5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive Bachelors or masters degree in Computer Science or related field Strong knowledge of working with large data sets and high-capacity big data processing platform Strong experience in...


  • Hyderabad, Telangana, India State Street Full time

    Job TitleOracle Bigdata Delivery Lead - Assistant Vice PresidentRole Summary & Role DescriptionExperienced Delivery LeadThis role requires expertise with Oracle SQL, PLSQL, Performance tuning, and the Hadoop stack including Impala, Hive, HBase, Spark, and Sqoop. The ideal candidate will focus 80% of their time on hands-on development, design, and...

  • Bigdata

    2 weeks ago


    Hyderabad, Telangana, India Ness Digital Engineering Full time

    Why NessWe know that people are our greatest asset. Our staff's professionalism, innovation, teamwork, and dedication to excellence have helped us become one of the world's leading technology companies. It is these qualities that are vital to our continued success. As a Ness employee, you will be working on products and platforms for some of the most...

  • Bigdata Engineer

    2 weeks ago


    Hyderabad, Telangana, India Nisum Full time

    What You'll DoDesign, Development and Testing of key programs within DTC EngineeringDevelopment of technical solutions that are built for quality, scale and performance.Collaborate with the business, product management and PMO on product roadmaps and quarterly planning sessions.Participate in code and design reviews to minimize rework and catch issues early...

  • Bigdata Engineer

    2 weeks ago


    Hyderabad, Telangana, India Nisum Full time

    What You'll Do Design, Development and Testing of key programs within DTC Engineering Development of technical solutions that are built for quality, scale and performance. Collaborate with the business, product management and PMO on product roadmaps and quarterly planning sessions. Participate in code and design reviews to minimize rework and...


  • Hyderabad, Telangana, India Virtusa Full time

    Big data spark developer - CREQ180562 Description Essential:5 years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive)Experience in writing SQL for any one relation databaseExtensive knowledge in HiveSQL Hadoop, SQLExperience in DevOps process (CICD, Jira, Bitbucket)Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced Primary...


  • Hyderabad, Telangana, India Virtusa Full time

    Big data spark developer - CREQ180562 Description Essential:5 years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive)Experience in writing SQL for any one relation databaseExtensive knowledge in HiveSQL Hadoop, SQLExperience in DevOps process (CICD, Jira, Bitbucket) Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced...

  • Hadoop Administrator

    2 weeks ago


    Hyderabad, Telangana, India Anicalls (Pty) Ltd Full time

    Should have good experience on Bigdata Administration (Hadoop, MongoDB & Splunk) ·• Expertise in Cluster maintenance using tools like IBM BigInsights, Cloudera/Hortonworks Ambari, Ganglia, etc ·• Good at Performance tuning of Hadoop clusters and Hadoop MapReduce routines Experience on a hive, HBase, sqoop, RDBMS and Hadoop ecosystem · Experience on...

  • Big data spark

    2 weeks ago


    Hyderabad, Telangana, India Virtusa Full time

    Big data spark - CREQ178115 DescriptionPosition: Big data spark developerPrimary skills: Big data spark & JavaLocation: Hyderabad & BangaloreEssential:5+ years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive)Experience in writing SQL for any one relation databaseExtensive knowledge in HiveSQL Hadoop, SQLExperience in DevOps process (CICD,...

  • Big data spark

    2 weeks ago


    Hyderabad, Telangana, India Virtusa Full time

    Big data spark - CREQ178115 Description Position: Big data spark developer Primary skills: Big data spark & Java Location: Hyderabad & Bangalore Essential:5+ years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive)Experience in writing SQL for any one relation databaseExtensive knowledge in HiveSQL Hadoop, SQLExperience in DevOps...


  • Hyderabad, Telangana, India Virtusa Full time

    Big Data with Data Modeling CREQ186896 Description EIS DATA JD Tier 2Cloud Data Lead with very strong in Experience in Bigdata (Kafka, Elastic search,Logstash,Kibana)Required experience with Data Engineering and ETL/EDW Design Process and Practices.Experience in Data ModelingExperience in CDC process (Added Advantage if knowledge in Debezium or any CDC...


  • Hyderabad, Telangana, India ServiceNow Full time

    Company OverviewAt ServiceNow, our mission is to push boundaries and drive innovation to serve both our customers and communities. By joining our team, you become part of a group of ambitious individuals who value creativity and exploration. We believe in creating an inclusive environment where everyone's voice is heard and where diverse backgrounds are...


  • Hyderabad, Telangana, India ServiceNow Full time

    Company OverviewAt ServiceNow, our mission is to push boundaries and drive innovation to serve both our customers and communities. By joining our team, you become part of a group of ambitious individuals who value creativity and exploration. We believe in creating an inclusive environment where everyone's voice is heard and where diverse backgrounds are...


  • Hyderabad, Telangana, India State Street Full time

    Job Description Who we are looking for Expected to spend 100% of the time on hands-on development, design and architecture Experience in Finance and FCC is a plus Work shift timings : 11 AM IST to 8 PM IST / 12 PM IST to 9 PM IST Extensive working knowledge and expertise in Spark on Scala, AWS and Databricks Should have worked on DataSync,...


  • Hyderabad, Telangana, India ServiceNow Full time

    Company OverviewAt ServiceNow, our mission is to push boundaries and drive innovation to serve both our customers and communities. By joining our team, you become part of a group of ambitious individuals who value creativity and exploration. We believe in creating an inclusive environment where everyone's voice is heard and where diverse backgrounds are...

  • Bigdata Tester Ii

    2 weeks ago


    Hyderabad, Telangana, India Dun & Bradstreet Full time

    Why We Work at Dun & BradstreetDun & Bradstreet unlocks the power of data through analytics, creating a better tomorrow. Each day, we are finding new ways to strengthen our award-winning culture and accelerate creativity, innovation and growth. Our 6,000+ global team members are passionate about what we do. We are dedicated to helping clients turn...


  • Hyderabad, Telangana, India State Street Full time

    Job Title- Big Data, Java Full Stack Lead Role Summary & Role Description Strong experience in developing applications using Hadoop, Scala and Spark Strong experience in developing back-end dynamic website applications using Core Java 11 and using various module of Spring Boot framework like Spring Core, Spring REST, Spring Jdbc,Spring AOP...

  • Spark Scala Engineer

    2 weeks ago


    Hyderabad, Telangana, India NucleusTeq Full time

    We are looking for exceptional Spark Scala engineer with 5+ yrs experience who will be responsible for:Experience- 5+ YrsLocationHyderabad & IndoreResponsibilities:Implementing the large scale Spark applications and finetune at runtimeDesign and implement high volume and cardinality data using IcebergImplement and optimize pipelines using AirflowExperience...


  • Hyderabad, Telangana, India Corporate Resources Full time

    Job Description 5 years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive) Experience in writing SQL for any one relation database ex.Oracle Extensive knowledge in HiveSQL Hadoop, SQL Experience in DevOps process (CICD, Jira, Bitbucket) Primary Skills, Spark with Java, Hadoop, Hive, Control-M Secondary Skills, Unix, AWS Cloud, GIT,...