Big Data Specialist

3 weeks ago


Bengaluru, India Tavant Full time

With 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Fintech, Manufacturing, Agtech, Media & Entertainment, and Retail in North America, Europe, and Asia-Pacific.

Powered by Artificial Intelligence and Machine Learning algorithms, we help our customers improve operational efficiency, productivity, speed, and accuracy. Our suite of products and solutions is routinely rated high by the industry.

Ours is a challenging workplace where teams are diverse, competitive, and continually searching for tomorrow's technology and brilliant minds to create it. Furthermore, we do not focus just on what we do – we also care how we do it. So, bring your talent and ambition to make a difference. We will create a world of opportunities for you.


Job Details


Job Title: Big Data Engineer

Location: Bangalore / Noida / Hyderabad

Quick joiners needed


Job Responsibilities:


  • Design and implement scalable and efficient data processing pipelines using Apache Spark and Java.
  • Develop APIs and services for data ingestion, transformation, and aggregation to support analytics and machine learning models.
  • Collaborate with data scientists, analysts, and cross-functional teams to understand data requirements and deliver innovative data solutions.
  • Optimize Spark jobs for performance and cost efficiency across large datasets.
  • Ensure high data quality and integrity by implementing robust testing and validation practices.
  • Lead the adoption of best practices in code quality, CI/CD, and DevOps within the data engineering team.
  • Mentor junior developers and contribute to knowledge sharing and team development.


Qualification:


  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
  • Proficient in Java programming and familiar with the Scala programming language.
  • Strong experience in designing and implementing scalable data processing pipelines using Apache Spark and Java.
  • Solid understanding of big data technologies and ecosystems (HDFS, YARN, Kafka, HBase, etc.).
  • Familiarity with DevOps tools and practices, including Docker, Kubernetes, Jenkins, and Git.
  • Excellent problem-solving skills, with the ability to tackle challenges in large-scale data environments.
  • Strong communication and collaboration skills, with the ability to work effectively in a team and interface with technical and non-technical stakeholders.


What We Offer:


  • A dynamic and challenging work environment.
  • Opportunities for personal and professional growth.


  • Big Data Developer

    3 weeks ago


    Bengaluru, India Aptus Data Labs Full time

    Job Title: Big Data DevelopersExperience: Minimum 8 yearsLocation: Remote / core location - BangaloreMandatory Skills ( Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation )Strong proficiency in Hadoop ecosystem includingHDFS, Hive, and HSQLExtensive experience withPython and PySparkfor data processing and...


  • Bengaluru, India Global Pharma Tek Full time

    REQ – – REFQ Azure Big Data Specialist No Industrial Layout Hosur Road Koramangala, Bengaluru, in Full-time Legal Entity: Bosch Global Software Technologies Private Limited Company Description Bosch Global Software Technologies Private Limited is a % owned subsidiary of Robert Bosch GmbH, one of the world's leading global supplier of...

  • Big Data Specialist

    5 days ago


    Bengaluru, India Sigmoid Full time

    Sigmoid works with a variety of clients from start-ups to fortune 500 companies. We arelooking for a detailed oriented self-starter to assist our engineering and analytics teams invarious roles as a Software Development Engineer.This position will be a part of a growing team working towards building world class large scaleBig Data architectures. This...

  • Big Data Specialist

    5 days ago


    Bengaluru, India Sigmoid Full time

    Sigmoid works with a variety of clients from start-ups to fortune 500 companies. We arelooking for a detailed oriented self-starter to assist our engineering and analytics teams invarious roles as a Software Development Engineer.This position will be a part of a growing team working towards building world class large scaleBig Data architectures. This...


  • Bengaluru, India Société Générale Assurances Full time

    Specialist Software Engineer(Big Data)Permanent contract|Bangalore|IT (Information Technology)Specialist Software Engineer(Big Data)Bangalore, IndiaPermanent contractIT (Information Technology)ResponsibilitiesResponsible for understanding the software requirements and developing it into a working source code accordingly.Take accountability of delivering high...

  • Big Data Specialist

    3 days ago


    Bengaluru, India Sigmoid Full time

    Sigmoid works with a variety of clients from start-ups to fortune 500 companies. We arelooking for a detailed oriented self-starter to assist our engineering and analytics teams invarious roles as a Software Development Engineer.This position will be a part of a growing team working towards building world class large scaleBig Data architectures. This...

  • Big Data Specialist

    3 weeks ago


    Bengaluru, India Tavant Full time

    With 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Fintech, Manufacturing, Agtech, Media & Entertainment, and Retail in North America, Europe, and...


  • Bengaluru, India Société Générale Assurances Full time

    Specialist Software Engineer(Big Data) Permanent contract|Bangalore|IT (Information Technology) Specialist Software Engineer(Big Data) Bangalore, India Permanent contract IT (Information Technology) Responsibilities Responsible for understanding the software requirements and developing it into a working source code accordingly. ...

  • Big Data Developer

    3 weeks ago


    Greater Bengaluru Area, India Aptus Data Labs Full time

    Job Title: Big Data Developers Experience: Minimum 8 years Location: Remote / core location - Bangalore Mandatory Skills (Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation ) Strong proficiency in Hadoop ecosystem including HDFS, Hive, and HSQL Extensive experience with Python and PySpark for data processing and...

  • Big Data Developer

    3 weeks ago


    Greater Bengaluru Area, India Aptus Data Labs Full time

    Job Title: Big Data Developers Experience: Minimum 8 yearsLocation: Remote / core location - BangaloreMandatory Skills (Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation )Strong proficiency in Hadoop ecosystem including HDFS, Hive, and HSQLExtensive experience with Python and PySpark for data processing and...

  • Big Data Specialist

    3 weeks ago


    Bengaluru, India Tavant Full time

    With 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Fintech, Manufacturing, Agtech, Media & Entertainment, and Retail in North America, Europe, and...

  • Big Data Specialist

    2 weeks ago


    Bengaluru, India o9 Solutions, Inc. Full time

    Be part of something revolutionary.At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises’ siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact...

  • Big Data Specialist

    2 days ago


    Bengaluru, India o9 Solutions, Inc. Full time

    Be part of something revolutionary.At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises’ siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact...

  • Big Data Architect

    2 weeks ago


    Bengaluru, India RiskInsight Consulting Pvt Ltd Full time

    ResponsibilitiesDesign and architect Big Data solutions to meet business requirements.Collaborate with stakeholders to understand their data and analytics needs.Create and maintain data models, data flow diagrams, and data integration strategies.Develop and implement data ingestion, processing, and storage solutions using Big Data technologies.Optimize data...

  • Big Data Developer

    2 weeks ago


    Bengaluru, India Unison Consulting Pte Ltd Full time

    Job Description:Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and...

  • Big Data Developer

    2 weeks ago


    Bengaluru, India Virtusa Full time

    Big Data Developer - CREQ181026 Description Lead System Engineer (big data) - Druid + ElasticSearch + Nifi - admin of tools, devops & cloud Ownership and Production MetrologyLead System Engineer (big data) - Druid + ElasticSearch + Nifi - admin of tools, devops & cloud Ownership and Production MetrologyPrimary Location Bangalore, Karnataka, India Job Type...

  • Big Data Architect

    7 days ago


    Bengaluru, India RiskInsight Consulting Pvt Ltd. Full time

    ResponsibilitiesDesign and architect Big Data solutions to meet business requirementsCollaborate with stakeholders to understand their data and analytics needsCreate and maintain data models, data flow diagrams, and data integration strategiesDevelop and implement data ingestion, processing, and storage solutions using Big Data technologiesOptimize data...

  • Big Data Architect

    3 weeks ago


    Bengaluru, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. Optimize...

  • Big Data Specialist

    2 weeks ago


    Bengaluru, India o9 Solutions, Inc. Full time

    Be part of something revolutionary. At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises’ siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact...

  • Big Data Specialist

    2 weeks ago


    Bengaluru, India o9 Solutions, Inc. Full time

    Be part of something revolutionary.At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises’ siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact...