Big Data Engineer

4 weeks ago


Bengaluru, Karnataka, India VidPro Consultancy Services Full time
Job Description

Role : Big Data Engineer

Location : Bangalore

Job Type : Fulltime, Hybrid

Skills : Python, Spark, SQL, Databricks, Hadoop, Hive, Spark, AWS, DSA

Job Overview

We are seeking a Junior Big Data Engineer specializing in AWS for a full-time role located in Bangalore Urban, Bangalore Rural, Bangalore. As a key contributor in this role, you will leverage your expertise in big data technologies to design, implement, and optimize complex data processing solutions. Your contribution will be pivotal in enhancing our clients&apos data architectures and ensuring robust data pipelines.

Qualifications and Skills

- Proficiency in Python (Mandatory skill) is required to efficiently handle data processing tasks and pipeline creation.
- Experience with PySpark (Mandatory skill) for scalable data analytics and large data set processing is essential.
- Expertise in Databricks (Mandatory skill) to collaborate and transform data in a cloud-based environment is necessary.
- Strong knowledge of Amazon Redshift for creating and managing data warehouses and ensuring data storage efficiency.
- Experience with AWS Glue for developing and managing ETL jobs to prepare data for analytics.
- Familiarity with AWS Lambda for executing code in response to triggers, ensuring a flexible data processing environment.
- Experience with Hadoop frameworks for processing large volumes of data and managing data storage effectively.
- Advanced SQL skills for querying, managing, and structuring data stored in relational databases.

Roles and Responsibilities

- Design and implement scalable data processing pipelines to handle large data sets and support business goals.
- Collaborate with clients and team members to gather data requirements and ensure accurate data structuring.
- Optimize data architectures for performance, reliability, and scalability within cloud environments.
- Utilize AWS services to develop innovative data solutions tailored to client needs.
- Conduct regular data monitoring and maintenance to ensure data integrity and security.
- Analyze and interpret complex data sets, providing actionable insights to stakeholders.
- Stay updated with emerging trends and technologies in big data engineering to drive continuous improvement.
- Participate in code reviews and contribute to maintaining coding standards and practices.

  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Summary:We're seeking a skilled Data Engineer to join our team in India. As a Data Engineer, you'll be responsible for designing and implementing data infrastructure using AWS services, analyzing big data using Hadoop, Spark, and Scala, and developing DevOps skills using Jenkins and scripting.Key Requirements:AWS expertise.Big Data Hadoop...

  • Big Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Scoop Technologies Pvt Ltd Full time

    Job Title : Big Data Engineer Location : Bangalore Employment Type : Full-time Work Mode : 4 Days Work from Office Notice Period : Immediate to 30 days Job Description : We are looking for a Big Data Engineer with expertise in Hadoop, Hive, SQL, Python, PySpark, and AWS to join our team in Bangalore. The ideal candidate will have hands-on experience in...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Human Horizon Full time

    Responsibilities : - Design, develop, and execute test cases for large-scale big data platforms. - Perform testing on various Big Data technologies (e. g., Hadoop, Hive, Spark, NoSQL databases). - Ensure data accuracy, integrity, and quality in data processing and transformations. - Work closely with developers, data engineers, and business analysts to...

  • Data Engineer

    23 hours ago


    Bengaluru, Karnataka, India NTT DATA Global Delivery Services Limited Full time

    Company Overview:NTT DATA Global Delivery Services Limited is a leading IT services provider that helps clients achieve their business goals through innovative and technology-driven solutions.Job Description:We are seeking a highly skilled Data Engineer to join our team as a Databricks Developer. The successful candidate will be responsible for designing,...

  • Big Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Scoop Technologies Pvt Ltd Full time

    Job Title : Big Data EngineerLocation : BangaloreEmployment Type : Full-timeWork Mode : 4 Days Work from OfficeNotice Period : Immediate to 30 daysJob Description :We are looking for a Big Data Engineer with expertise in Hadoop, Hive, SQL, Python, PySpark, and AWS to join our team in Bangalore. The ideal candidate will have hands-on experience in designing,...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionWe are currently seeking a Data Engineer to join our team in India. The ideal candidate will have expertise in AWS services such as EC2, Lambda, and EMR, with configuration using Terraform. Additionally, experience with Big Data Hadoop, Spark, Scala, Control-m, GIT, Maven, Jenkins, and SQL is required.

  • Big Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India TEKDOORS Full time

    We are looking for a Big Data Engineer to build scalable data pipelines and support enterprise analytics applications by integrating and processing large datasets. Roles and Responsibilities : - Develop and manage data pipelines for integrating, consolidating, and cleansing data. - Utilize ETL tools and REST APIs for data integration and management. - Plan,...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Robotics Technologies Full time

    Job DescriptionDescriptionWe are seeking a skilled Big Data Engineer to join our team in India. The ideal candidate will have extensive experience in building and maintaining big data solutions to support data-driven decision making across the organization.Responsibilities- Design, develop, and maintain scalable data pipelines and architectures.- Work with...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy ServicesWe are hiring a skilled Big Data Developer to join our team.Desired Experience: 4+ years of experience in big data development and administration.Job Location: Bangalore, Chennai, Hyderabad, Mumbai, Gurgaon, Indore, or Ahmedabad.Required skillset: Big Data, Hadoop, Spark, Scala, Hive.Job Description:Tata Consultancy...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India LTIMindtree Full time

    We are seeking an experienced Java Spark developer to join our team at LTIMindtree.About the RoleThis is a fantastic opportunity for a skilled Java Spark developer to leverage their expertise in Big Data technologies, including Hadoop and SparkSQL, to drive business growth.Key ResponsibilitiesData Engineering: Design and implement large-scale data processing...

  • Big data engineer

    3 weeks ago


    Bengaluru, Karnataka, India Mercedes-Benz Full time

    Tätigkeitsbereich:Forschung & Entwicklung incl. DesignFachabteilung:Business AnalyticsGesellschaft:Mercedes-Benz Research and Development India Private LimitedStandort:Mercedes-Benz Research and Development India Private Limited, BangaloreStartdatum:sofortVeröffentlichungsdatum:..5Stellennummer:MER3GEIArbeitszeit:Vollzeit BewerbenAufgaben · Mandatory:...

  • Big data engineer

    3 weeks ago


    Bengaluru, Karnataka, India Mercedes-Benz Full time

    Tätigkeitsbereich:Forschung & Entwicklung incl. DesignFachabteilung:Data Analytics @ GCSPGesellschaft:Mercedes-Benz Research and Development India Private LimitedStandort:Mercedes-Benz Research and Development India Private Limited, BangaloreStartdatum:sofortVeröffentlichungsdatum:..5Stellennummer:MER3GEIArbeitszeit:Vollzeit BewerbenAufgaben · Mandatory:...

  • Big Data Engineer

    3 days ago


    Bengaluru, Karnataka, India LinkedIn Full time

    Join Our Team of Big Data ExpertsWe are seeking a highly skilled Big Data Engineer to join our team at LinkedIn. As a key member, you will be responsible for designing, developing, and supporting large-scale big data systems. Your expertise will help us unlock insights from our vast amounts of data and make informed decisions that drive business growth.About...

  • Big Data Engineer

    2 days ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    About Us:Tata Consultancy Services is a global leader in IT services and consulting.We are seeking a skilled Big Data Developer to help us design and administer data projects using Big Data Services.Technical Requirements:We require expertise in Spark programming.Familiarity with the Hadoop ecosystem is essential.You should have skills in Hive data...


  • Bengaluru, Karnataka, India Mphasis Full time

    About the Job:Mphasis is seeking an experienced Big Data Engineering Lead to join our team. In this role, you will be responsible for designing and implementing large-scale distributed data processing systems using Hadoop and related big data technologies. Your expertise in the Hadoop ecosystem, including HDFS, YARN, MapReduce, Hive, HBase, Pig, Oozie,...


  • Bengaluru, Karnataka, India Accolite Full time

    Join us at Accolite Digital and become a Big Data Engineering Lead.This exciting opportunity involves designing and implementing large-scale data architectures to support business growth and improvement.You will lead a team of data engineers and architects to deliver innovative data solutions that meet our clients' needs.Your expertise in data engineering,...


  • Bengaluru, Karnataka, India EXL Service Full time

    **Job Summary:**We are looking for a Big Data Engineering Manager to lead the development of our big data infrastructure. This is an excellent opportunity for someone who wants to work on high-impact projects and contribute to the growth of our organization.**Key Responsibilities:**Develop and implement large-scale distributed systems and pipelines that...

  • Big Data Engineer

    2 days ago


    Bengaluru, Karnataka, India Publicis Sapient Full time

    Job OverviewThe Senior Associate Data Engineering L2 DE is a technical lead responsible for designing and implementing data engineering solutions. This role involves translating client requirements into technical design, utilizing deep understanding of data integration and big data design principles to create custom solutions or implement package solutions....


  • Bengaluru, Karnataka, India NIKE Full time

    Data Engineering ExpertiseWe are seeking self-driven individuals with deep technical knowledge in big data. This role requires excellent problem-solving skills to design and implement complex data pipelines that solve business problems at Nike.RequirementsBachelor's degree in computer science engineering3+ years of hands-on experience in data...

  • Big Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India ScaleneWorks Full time

    Job Title: Data Engineer Position: SSE Experience: 5-6yrs Category: IT Infrastructure Main location: India, Karnataka, Bangalore Employment Type: Full Time Primary skill-Data Engineer Qualification: Bachelor's degree in Computer Science or related field or higher. Roles and Responsibilities Data Engineer - 5-6 years experience. Responsibilities...