Big Data Specialist

3 weeks ago

bangalore, India Tavant Full time

With 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Fintech, Manufacturing, Agtech, Media & Entertainment, and Retail in North America, Europe, and Asia-Pacific.

Powered by Artificial Intelligence and Machine Learning algorithms, we help our customers improve operational efficiency, productivity, speed, and accuracy. Our suite of products and solutions is routinely rated high by the industry.

Ours is a challenging workplace where teams are diverse, competitive, and continually searching for tomorrow's technology and brilliant minds to create it. Furthermore, we do not focus just on what we do – we also care how we do it. So, bring your talent and ambition to make a difference. We will create a world of opportunities for you.


Job Details


Job Title : Big Data Engineer

Location: Bangalore / Noida / Hyderabad

Quick joiners needed


Job Responsibilities:


  • Design and implement scalable and efficient data processing pipelines using Apache Spark and Java .
  • Develop APIs and services for data ingestion, transformation, and aggregation to support analytics and machine learning models.
  • Collaborate with data scientists, analysts, and cross-functional teams to understand data requirements and deliver innovative data solutions.
  • Optimize Spark jobs for performance and cost efficiency across large datasets.
  • Ensure high data quality and integrity by implementing robust testing and validation practices.
  • Lead the adoption of best practices in code quality, CI/CD, and DevOps within the data engineering team.
  • Mentor junior developers and contribute to knowledge sharing and team development.


Qualification:


  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
  • Proficient in Java programming and familiar with the Scala programming language.
  • Strong experience in designing and implementing scalable data processing pipelines using Apache Spark and Java.
  • Solid understanding of big data technologies and ecosystems (HDFS, YARN, Kafka, HBase, etc.).
  • Familiarity with DevOps tools and practices, including Docker, Kubernetes, Jenkins, and Git.
  • Excellent problem-solving skills, with the ability to tackle challenges in large-scale data environments.
  • Strong communication and collaboration skills, with the ability to work effectively in a team and interface with technical and non-technical stakeholders.


What We Offer:


  • A dynamic and challenging work environment.
  • Opportunities for personal and professional growth.

  • Big Data Specialist

    3 days ago

    bangalore, India Sigmoid Full time

    Sigmoid works with a variety of clients from start-ups to fortune 500 companies. We arelooking for a detailed oriented self-starter to assist our engineering and analytics teams invarious roles as a Software Development Engineer.This position will be a part of a growing team working towards building world class large scaleBig Data architectures. This...

  • Azure Big Data Specialist

    3 weeks ago

    bangalore, India Global Pharma Tek Full time

    REQ – – REFQ Azure Big Data Specialist No Industrial Layout Hosur Road Koramangala, Bengaluru, in Full-time Legal Entity: Bosch Global Software Technologies Private Limited Company Description Bosch Global Software Technologies Private Limited is a % owned subsidiary of Robert Bosch GmbH, one of the world's leading global...

  • Big Data Specialist

    5 days ago

    bangalore, India Sigmoid Full time

    Sigmoid works with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software Development Engineer. This position will be a part of a growing team working towards building world class large scale Big Data architectures. This...

  • Big Data Specialist

    3 days ago

    bangalore, India Tavant Full time

    With 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Fintech, Manufacturing, Agtech, Media & Entertainment, and Retail in North America, Europe, and...

  • Specialist Software Engineer(Big Data)Permanent contractBangalore, India

    3 weeks ago

    bangalore, India Société Générale Assurances Full time

    Specialist Software Engineer(Big Data) Permanent contract|Bangalore|IT (Information Technology) Specialist Software Engineer(Big Data) Bangalore, India Permanent contract IT (Information Technology) Responsibilities Responsible for understanding the software requirements and developing it into a working source code...

  • Big Data Developer

    3 weeks ago

    Bangalore Metropolitan Area, India Aptus Data Labs Full time

    Job Title: Big Data Developers Experience: Minimum 8 yearsLocation: Remote / core location - BangaloreMandatory Skills (Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation )Strong proficiency in Hadoop ecosystem including HDFS, Hive, and HSQLExtensive experience with Python and PySpark for data processing and...

  • Big Data Architect

    3 weeks ago

    bangalore, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. ...

  • Big Data Developer

    3 weeks ago

    bangalore, India Virtusa Full time

    Big Data Developer - CREQ181026 Description Lead System Engineer (big data) - Druid + ElasticSearch + Nifi - admin of tools, devops & cloud Ownership and Production MetrologyLead System Engineer (big data) - Druid + ElasticSearch + Nifi - admin of tools, devops & cloud Ownership and Production Metrology Primary Location Bangalore, Karnataka, India Job Type...

  • Big Data Developer

    3 weeks ago

    bangalore, India Unison Consulting Pte Ltd Full time

    Job Description: Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and...

  • Big Data Engineer

    3 weeks ago

    bangalore, India Virtusa Full time

    Big Data Engineer - CREQ184231 Description Profile : 5-8 years IT experience with minimum 2 years in Spark and Big Data platform Experience in Big Data technologies Hadoop, HDFS, Hive, Yarn, Jenkins, Ansible Job DescriptionResponsibilitiesSkill: Spark, ScalaLevel: Senior Software EngineerCategory: Special/NicheTenure: 1 YearMission :He (or she) is in charge...

  • Big Data Developer

    2 weeks ago

    bangalore, India BigShyft Full time

    JobDescription: We are seeking askilled and experienced Big Data Developer/Data Engineer to joinour clients team in Bengaluru. The ideal candidate should have astrong background in Java Spark Hadoop and Scala with 47 years ofrelevant workexperience.Responsibilities: Designdevelop and maintain largescale data processing systems leveragingHadoop Spark and...

  • Big Data Analyst

    3 weeks ago

    bangalore, India Corporate Resources Full time

    Job Description  Big data analyst with knowledge of big data technologies and ability to analyze large volumes of data and bring out insights  Reporting and presenting on data insights  Handson knowledge of scripting and using Big data tools  Data analysis and processing ...

  • Big data architect

    3 weeks ago

    bangalore, India Virtusa Full time

    Big data architect - CREQ185795 Description Position: Big data architect Location: BLR Primary skills: Big data hadoop spark & aws Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig...

  • Big data developer

    3 weeks ago

    bangalore, India Virtusa Full time

    Big data developer - CREQ185815 Description Position: Big data developer Primary skills: Hadoop, hive, spark, aws Location: BLR Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems...

  • Big Data Engineer

    3 weeks ago

    bangalore, India Adobe Full time

    Our Company Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies...

  • Leader (Specialist), Data & AI

    2 weeks ago

    bangalore, India Databricks Full time

    DiscoverCustomersPartners Databricks PlatformIntegrations and DataPricingOpen Source Databricks for IndustriesCross Industry SolutionsMigration & DeploymentSolution Accelerators Training and CertificationEventsBlog and PodcastsGet HelpDive Deep CompanyCareersPressSecurity and Trust Ready to get started? Leader (Specialist), Data & AI ...

  • Data Engineer

    3 weeks ago

    Bangalore, India Intelliswift Software (India) Pvt. Ltd Full time

    Job Description : - Bachelor's degree in computer science or related discipline with 4+ years' experience- Minimum 4 years of experience in Big Data and distributed computing.- Proven experience building pipelines on Big Data- Technologies/Stack - Hadoop, Spark, Hive, Kafka, Airflow - Deep understanding of the Hadoop ecosystem and strong...

  • Data Engineer

    6 days ago

    Bangalore, India Intelliswift Software (India) Pvt. Ltd Full time

    Job Description : - Bachelor's degree in computer science or related discipline with 4+ years' experience- Minimum 4 years of experience in Big Data and distributed computing.- Proven experience building pipelines on Big Data- Technologies/Stack - Hadoop, Spark, Hive, Kafka, Airflow - Deep understanding of the Hadoop ecosystem and strong...

  • Senior GCP Big Data Engineer

    3 days ago

    Bangalore, India Notus Full time

    Job Title : GCP (Google Cloud Platform) SpecialistNumber of Positions : 6 (1 Senior Role, 5 Lead Roles)Shift : 12 : 00 PM to 9 : 00 PM OR 1 : 00 PM to 10 : 00 PMLocation : TechM India locationsNotice Period : Early/Immediate/30 days (Positions need to be filled by May)Budget : Senior Role : 4 to 5/6 years of experience - Depending upon hike % and candidate...

  • Senior GCP Big Data Engineer

    4 days ago

    Bangalore, Karnataka, India Notus Full time

    Job Title : GCP (Google Cloud Platform) SpecialistNumber of Positions : 6 (1 Senior Role, 5 Lead Roles)Shift : 12 : 00 PM to 9 : 00 PM OR 1 : 00 PM to 10 : 00 PMLocation : TechM India locationsNotice Period : Early/Immediate/30 days (Positions need to be filled by May)Budget : Senior Role : 4 to 5/6 years of experience - Depending upon hike % and candidate...