Current jobs related to Big Data Engineer - Bengaluru, Karnataka - Scoop Technologies Pvt Ltd

  • Big Data Engineer

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About This Role:">This is an exciting opportunity for a seasoned data engineer to join our team at NTT DATA. As a Big Data Engineer, you will be responsible for designing and implementing large-scale data processing systems using PySpark in Azure Synapse. Your expertise in big data technologies, data warehousing, and data analytics will enable us to deliver...

  • Big Data Analytics Expert

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Summary:We're seeking a skilled Data Engineer to join our team in India. As a Data Engineer, you'll be responsible for designing and implementing data infrastructure using AWS services, analyzing big data using Hadoop, Spark, and Scala, and developing DevOps skills using Jenkins and scripting.Key Requirements:AWS expertise.Big Data Hadoop...

  • Big Data Engineer for Azure Synapse

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Global Delivery Services Limited Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team in Bangalore, India. As a Big Data Engineer, you will play a crucial role in designing and implementing scalable and high-performance big data solutions using PySpark and Azure Synapse.Your primary responsibilities will include building and maintaining large-scale data pipelines,...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Juniper Networks Full time

    Juniper Networks is seeking a highly skilled Big Data Engineer to join our data engineering team. As a key member of our team, you will be responsible for designing, developing, and deploying large-scale big data solutions using Apache Spark, Hadoop, and NoSQL databases.The ideal candidate will have a strong background in big data technologies, with...

  • Senior Big Data Specialist

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About NTT DATANTT DATA is a leading provider of digital and AI infrastructure worldwide. We are part of the NTT Group, which invests over $3.6 billion each year in R&D to help organizations move confidently and sustainably into the digital future.Data Engineer Job DescriptionWe are seeking an experienced Data Engineer to join our team in India. The...

  • Big Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Human Horizon Full time

    Responsibilities : - Design, develop, and execute test cases for large-scale big data platforms. - Perform testing on various Big Data technologies (e. g., Hadoop, Hive, Spark, NoSQL databases). - Ensure data accuracy, integrity, and quality in data processing and transformations. - Work closely with developers, data engineers, and business analysts to...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Global Delivery Services Limited Full time

    Company Overview:NTT DATA Global Delivery Services Limited is a leading IT services provider that helps clients achieve their business goals through innovative and technology-driven solutions.Job Description:We are seeking a highly skilled Data Engineer to join our team as a Databricks Developer. The successful candidate will be responsible for designing,...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India TEKDOORS Full time

    We are looking for a Big Data Engineer to build scalable data pipelines and support enterprise analytics applications by integrating and processing large datasets. Roles and Responsibilities : - Develop and manage data pipelines for integrating, consolidating, and cleansing data. - Utilize ETL tools and REST APIs for data integration and management. - Plan,...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Infogain Full time

    Big Data Engineer (Standard) with skills Data Engineering, Data Warehouse, Big Data, databricks, Apache Spark, Azure Datalake, Pyspark for location Bangalore, India Posted on: July 30, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Advanced knowledge of Azure data services such as Azure SQL Database, Azure...

  • Big Data Engineer

    20 hours ago

    Bengaluru, Karnataka, India LION AND ELEPHANTS Full time

    About the JobWe are looking for a skilled Big Data Engineer using Java Spark with 6-8 years of experience in designing, developing and optimizing real-time & batch data pipelines in a Big Data environment at an enterprise scale.Job DescriptionDevelop scalable and high-performance data processing solutions by integrating real-time data streams.Maintain and...

  • Senior Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Ifintalent Global Private Limited Full time

    As a Senior Big Data Engineer at Ifintalent Global Private Limited, you will play a critical role in designing, building, and maintaining large-scale big data systems. You will be working with a talented team of engineers to develop innovative solutions using cutting-edge technologies.We are looking for someone with a strong background in big data...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Infogain Full time

    Big Data Engineer (Lead) with skills Data Engineering, Data Warehouse, Big Data, snowflake, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: July 30, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+...

  • Senior Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Global Delivery Services Limited Full time

    About UsNTT DATA Global Delivery Services Limited is a leading IT services company that provides innovative solutions to clients across industries. Our team of experts is committed to delivering high-quality services that meet the evolving needs of our clients.Job DetailsWe are seeking an experienced Digital Engineering Staff Engineer to join our team. The...

  • Big Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Kiash Solutions LLp Full time

    About Kiash Solutions LLP">We are a leading provider of data-driven solutions, and we're seeking an experienced Big Data Engineer to join our team. With a strong background in big data technologies, you will play a key role in designing, implementing, and maintaining scalable big data pipelines using Apache Spark, Scala, Hive, and other related...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Robotics Technologies Full time

    Job DescriptionDescriptionWe are seeking a skilled Big Data Engineer to join our team in India. The ideal candidate will have extensive experience in building and maintaining big data solutions to support data-driven decision making across the organization.Responsibilities- Design, develop, and maintain scalable data pipelines and architectures.- Work with...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Aqilea Full time

    About the JobAqilea is looking for a highly skilled Data Engineer to enhance our team's capabilities. The ideal candidate will have expertise in designing, developing, and implementing data pipelines to extract, transform, and load (ETL) data from multiple sources.Job Summary:Develop, test, and deploy data pipelines using Apache Spark, Kafka, and other big...

  • Data Engineer for Big Data Analytics

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy ServicesWe are hiring a skilled Big Data Developer to join our team.Desired Experience: 4+ years of experience in big data development and administration.Job Location: Bangalore, Chennai, Hyderabad, Mumbai, Gurgaon, Indore, or Ahmedabad.Required skillset: Big Data, Hadoop, Spark, Scala, Hive.Job Description:Tata Consultancy...

  • Big Data Engineering Expert

    6 days ago

    Bengaluru, Karnataka, India Wipro Limited Full time

    We are building a modern Wipro, and we need people inspired by reinvention. Of yourself, your career, and your skills.We are seeking a Big Data Engineering Expert to join our team. As a Big Data Engineering Expert, you will be responsible for designing, developing, and deploying scalable, real-time, and high-performance big data solutions.The ideal candidate...

  • Big Data Innovation Lead

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    We are looking for a Big Data Innovation Lead to join our team. The successful candidate will have a strong background in Big Data, Cloud, and AI ML projects, with a focus on the health insurance or retail domains or manufacturing domains.Industry Expertise:Health InsuranceRetail

  • Big Data Engineer/Architect

    1 week ago

    Bengaluru, Karnataka, India NETSACH GLOBAL Full time

    Greetings from Netsach - A Cyber Security Company.Netsach is currently hiring Big Data Engineer/Architect is responsible for designing, developing, and maintaining large-scale data processing systems and architecture. This role involves working closely with data scientists, analysts, and other stakeholders to ensure data systems are scalable, secure, and...

Big Data Engineer

1 month ago

Bengaluru, Karnataka, India Scoop Technologies Pvt Ltd Full time

Job Title : Big Data Engineer

Location : Bangalore

Employment Type : Full-time

Work Mode : 4 Days Work from Office

Notice Period : Immediate to 30 days

Job Description :

We are looking for a Big Data Engineer with expertise in Hadoop, Hive, SQL, Python, PySpark, and AWS to join our team in Bangalore. The ideal candidate will have hands-on experience in designing, building, and optimizing data pipelines, ensuring efficient data processing and analytics.

Key Responsibilities :

- Develop and maintain scalable Big Data solutions using Hadoop, Hive, SQL, and PySpark.

- Design and implement ETL (Extract, Transform, Load) pipelines for data ingestion and transformation.

- Optimize big data processing and storage for performance and cost efficiency.

- Work with structured and unstructured datasets to ensure data quality and integrity.

- Collaborate with data scientists, analysts, and business teams to support their data needs.

- Deploy and manage AWS cloud-based data solutions, including S3, EMR, Lambda, Glue, and Redshift.

- Ensure security, governance, and compliance in data engineering processes.

- Troubleshoot and optimize Spark jobs and queries for efficiency.

Required Skills & Experience :

- 4+ years of experience as a Big Data Engineer or in a similar role.

- Strong knowledge of Hadoop ecosystem and Hive for data warehousing.

- Proficiency in SQL for querying large datasets.

- Expertise in Python and PySpark for data processing.

- Hands-on experience with AWS services like S3, EMR, Glue, Lambda, and Redshift.

- Experience in optimizing big data pipelines for high-performance analytics.

- Understanding of data governance, security, and compliance best practices.

(ref:hirist.tech)