Bigdata

2 weeks ago

Hyderabad, Telangana, India Ness Digital Engineering Full time
Why NessWe know that people are our greatest asset.

Our staff's professionalism, innovation, teamwork, and dedication to excellence have helped us become one of the world's leading technology companies.

It is these qualities that are vital to our continued success.

As a Ness employee, you will be working on products and platforms for some of the most innovative software companies in the world.

You'll gain knowledge working alongside other highly skilled professionals that will help accelerate your career progression.

You'll also benefit from various advantages like access to training and certifications, bonuses, and aids, socializing activities, and attractive compensation.

Requirements and responsibilities

What you'll do:
Design & Build ingestion pipelines using ELT and schema on read in Databricks Delta lakeDesign & Develop "Transformations" aspects using the ELT framework to modernize the Ingestion pipelines and build data transformations at scaleWork closely with other data teams & Data Science teams and participate in the development of Ingestion pipelinesProvide technical expertise in the areas of design and implementation of Ratings Data Ingestion pipelines with modern AWS cloud and other technologies such as S3, Hive, Databricks, Scala, Python, and SparkBuild and maintain a data environment for speed, accuracy, consistency, and 'up' timeWork closely with other data teams & Data Science teams and participate in the development of Ingestion pipelinesEnsure data governance principles are adopted, data quality checks and data lineage implemented in each hop of the dataBe in tune with emerging trends Big data and cloud technologies and participate in the evaluation of new technologiesEnsure compliance through the adoption of enterprise standards and promotion of best practice / guiding principles aligned with organization standards

What you'll bring:

Should be in a position to handle issue resolution and provide direction to teams both technically and functionallyShould be able to articulate and convert requirements into solutions.

Experience With Machine Learning Libraries and Frameworks (TensorFlow, MLlib) is an added advantageExperience with development frameworks as well as data and integration technologies such as Informatica, Python, ScalaExpert knowledge of Agile approaches to software development and able to put key Agile principles into practice to deliver solutions incrementally.

Monitors industry trends and directions; develops and presents substantive technical recommendations to senior managementExcellent analytical thinking, interpersonal, oral, and written communication skills with a strong ability to influence both IT and business partnersAbility to prioritize and manage work to critical project timelines in a fast-paced environmentFinancial services industry experience

Desirable Skills:


BE, MCA, or MS degree in Computer Science or Information Technology8+ years of experience as a data engineer at an innovative organization5+ years of hands-on experience implementing data lake systems using AWS/Azure cloud technologies such as S3, Databricks, Hive, Spark & Scala, Python, etc.3+ years of Expertise in building applications using Kafka, Golden Gate, etc.

for building ingestion pipelines for Bulk and incremental data loadsStrong expertise (preferably 5 years) in SDLC cycle including stakeholder management, people management, risk management, strategic management, communication management


Not checking every single requirement?If this role sounds good to you, even if you don't meet every single bullet point in the job description, we encourage you to apply anyway.

For most of the candidates that applied, we found a role that was a very good fit with their skills.

Let's meet and you may just be the right candidate for one of our roles.

At Ness Digital Engineering we are willing to build a work culture that is based on diversification, inclusion, and authenticity.

  • BigData - Tech Lead

    2 weeks ago

    Hyderabad, Telangana, India Virtusa Full time

    BigData - Tech Lead - CREQ186711 Description Job Description: Responsibilities: Responsible for Design, Build & deployment the Solution in Bigdata. Ability to effectively use complex analytical, interpretive and problem solving techniques. Analytical, flexible, team-oriented and has good interpersonal/communication skills. Apply Internal...

  • BigData Developer

    2 weeks ago

    Hyderabad, Telangana, India Virtusa Full time

    BigData Developer - CREQ189748 Description Job Description: 5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive Bachelors or masters degree in Computer Science or related field Strong knowledge of working with large data sets and high-capacity big data processing platform Strong experience in...

  • Oracle Bigdata Delivery Lead

    2 weeks ago

    Hyderabad, Telangana, India State Street Full time

    Job TitleOracle Bigdata Delivery Lead - Assistant Vice PresidentRole Summary & Role DescriptionExperienced Delivery LeadThis role requires expertise with Oracle SQL, PLSQL, Performance tuning, and the Hadoop stack including Impala, Hive, HBase, Spark, and Sqoop. The ideal candidate will focus 80% of their time on hands-on development, design, and...

  • Bigdata

    2 weeks ago

    Hyderabad, Telangana, India Ness Digital Engineering Full time

    Description: Why Choose Ness? We understand the value of our people. The professionalism, innovation, teamwork, and commitment to excellence from our staff have propelled us to the forefront of the technology industry. These characteristics are crucial to our continuous growth. As a member of the Ness team, you'll be involved in developing products and...

  • Bigdata Engineer

    2 weeks ago

    Hyderabad, Telangana, India Nisum Full time

    What You'll Do Design, Development and Testing of key programs within DTC Engineering Development of technical solutions that are built for quality, scale and performance. Collaborate with the business, product management and PMO on product roadmaps and quarterly planning sessions. Participate in code and design reviews to minimize rework and...

  • Bigdata Engineer

    2 weeks ago

    Hyderabad, Telangana, India Nisum Full time

    What You'll DoDesign, Development and Testing of key programs within DTC EngineeringDevelopment of technical solutions that are built for quality, scale and performance.Collaborate with the business, product management and PMO on product roadmaps and quarterly planning sessions.Participate in code and design reviews to minimize rework and catch issues early...

  • Big data spark developer

    2 weeks ago

    Hyderabad, Telangana, India Virtusa Full time

    Big data spark developer - CREQ180562 Description Essential:5 years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive)Experience in writing SQL for any one relation databaseExtensive knowledge in HiveSQL Hadoop, SQLExperience in DevOps process (CICD, Jira, Bitbucket)Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced Primary...

  • Big data spark developer

    2 weeks ago

    Hyderabad, Telangana, India Virtusa Full time

    Big data spark developer - CREQ180562 Description Essential:5 years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive)Experience in writing SQL for any one relation databaseExtensive knowledge in HiveSQL Hadoop, SQLExperience in DevOps process (CICD, Jira, Bitbucket) Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced...

  • Hadoop Administrator

    2 weeks ago

    Hyderabad, Telangana, India Anicalls (Pty) Ltd Full time

    Should have good experience on Bigdata Administration (Hadoop, MongoDB & Splunk) ·• Expertise in Cluster maintenance using tools like IBM BigInsights, Cloudera/Hortonworks Ambari, Ganglia, etc ·• Good at Performance tuning of Hadoop clusters and Hadoop MapReduce routines Experience on a hive, HBase, sqoop, RDBMS and Hadoop ecosystem · Experience on...

  • Big data spark

    2 weeks ago

    Hyderabad, Telangana, India Virtusa Full time

    Big data spark - CREQ178115 DescriptionPosition: Big data spark developerPrimary skills: Big data spark & JavaLocation: Hyderabad & BangaloreEssential:5+ years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive)Experience in writing SQL for any one relation databaseExtensive knowledge in HiveSQL Hadoop, SQLExperience in DevOps process (CICD,...

  • Big data spark

    2 weeks ago

    Hyderabad, Telangana, India Virtusa Full time

    Big data spark - CREQ178115 Description Position: Big data spark developer Primary skills: Big data spark & Java Location: Hyderabad & Bangalore Essential:5+ years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive)Experience in writing SQL for any one relation databaseExtensive knowledge in HiveSQL Hadoop, SQLExperience in DevOps...

  • Big Data with Data Modeling

    2 weeks ago

    Hyderabad, Telangana, India Virtusa Full time

    Big Data with Data Modeling CREQ186896 Description EIS DATA JD Tier 2Cloud Data Lead with very strong in Experience in Bigdata (Kafka, Elastic search,Logstash,Kibana)Required experience with Data Engineering and ETL/EDW Design Process and Practices.Experience in Data ModelingExperience in CDC process (Added Advantage if knowledge in Debezium or any CDC...

  • BigData DevOps Engineer

    2 weeks ago

    Hyderabad, Telangana, India ServiceNow Full time

    Company OverviewAt ServiceNow, our mission is to push boundaries and drive innovation to serve both our customers and communities. By joining our team, you become part of a group of ambitious individuals who value creativity and exploration. We believe in creating an inclusive environment where everyone's voice is heard and where diverse backgrounds are...

  • BigData DevOps Engineer

    4 weeks ago

    Hyderabad, Telangana, India ServiceNow Full time

    Company OverviewAt ServiceNow, our mission is to push boundaries and drive innovation to serve both our customers and communities. By joining our team, you become part of a group of ambitious individuals who value creativity and exploration. We believe in creating an inclusive environment where everyone's voice is heard and where diverse backgrounds are...

  • Bigdata Cloud Developer

    2 weeks ago

    Hyderabad, Telangana, India State Street Full time

    Job Description Who we are looking for Expected to spend 100% of the time on hands-on development, design and architecture Experience in Finance and FCC is a plus Work shift timings : 11 AM IST to 8 PM IST / 12 PM IST to 9 PM IST Extensive working knowledge and expertise in Spark on Scala, AWS and Databricks Should have worked on DataSync,...

  • Bigdata Tester Ii

    2 weeks ago

    Hyderabad, Telangana, India Dun & Bradstreet Full time

    Why We Work at Dun & BradstreetDun & Bradstreet unlocks the power of data through analytics, creating a better tomorrow. Each day, we are finding new ways to strengthen our award-winning culture and accelerate creativity, innovation and growth. Our 6,000+ global team members are passionate about what we do. We are dedicated to helping clients turn...

  • BigData Java Architect

    2 weeks ago

    Hyderabad, Telangana, India State Street Full time

    Job Title- Big Data, Java Full Stack Lead Role Summary & Role Description Strong experience in developing applications using Hadoop, Scala and Spark Strong experience in developing back-end dynamic website applications using Core Java 11 and using various module of Spring Boot framework like Spring Core, Spring REST, Spring Jdbc,Spring AOP...

  • Spark Scala Engineer

    2 weeks ago

    Hyderabad, Telangana, India NucleusTeq Full time

    We are looking for exceptional Spark Scala engineer with 5+ yrs experience who will be responsible for:Experience- 5+ YrsLocationHyderabad & IndoreResponsibilities:Implementing the large scale Spark applications and finetune at runtimeDesign and implement high volume and cardinality data using IcebergImplement and optimize pipelines using AirflowExperience...

  • Java Spark

    2 weeks ago

    Hyderabad, Telangana, India Virtusa Full time

    Java Spark - CREQ189587 DescriptionSkill- Java SparkExperience: 6-9 yrsRole: T2Responsibilities:5-7 Experience in Java development with Bigdata in Apache Spark, Hive, etcMust have exposure on big data bases /Data modelling design and developmentHandled end to end project delivery SDLC exposureDesign develop, implement, configure and document current and...

  • Software Developer/Java Spark

    2 weeks ago

    Hyderabad, Telangana, India Corporate Resources Full time

    Job Description 5 years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive) Experience in writing SQL for any one relation database ex.Oracle Extensive knowledge in HiveSQL Hadoop, SQL Experience in DevOps process (CICD, Jira, Bitbucket) Primary Skills, Spark with Java, Hadoop, Hive, Control-M Secondary Skills, Unix, AWS Cloud, GIT,...