Big Data Engineer

3 weeks ago


Bengaluru, Karnataka, India VidPro Consultancy Services Full time
Job Description

Role : Big Data Engineer

Location : Bangalore

Job Type : Fulltime, Hybrid

Skills : Python, Spark, SQL, Databricks, Hadoop, Hive, Spark, AWS, DSA

Job Overview

We are seeking a Junior Big Data Engineer specializing in AWS for a full-time role located in Bangalore Urban, Bangalore Rural, Bangalore. As a key contributor in this role, you will leverage your expertise in big data technologies to design, implement, and optimize complex data processing solutions. Your contribution will be pivotal in enhancing our clients data architectures and ensuring robust data pipelines.

Qualifications and Skills

- Proficiency in Python (Mandatory skill) is required to efficiently handle data processing tasks and pipeline creation.
- Experience with PySpark (Mandatory skill) for scalable data analytics and large data set processing is essential.
- Expertise in Databricks (Mandatory skill) to collaborate and transform data in a cloud-based environment is necessary.
- Strong knowledge of Amazon Redshift for creating and managing data warehouses and ensuring data storage efficiency.
- Experience with AWS Glue for developing and managing ETL jobs to prepare data for analytics.
- Familiarity with AWS Lambda for executing code in response to triggers, ensuring a flexible data processing environment.
- Experience with Hadoop frameworks for processing large volumes of data and managing data storage effectively.
- Advanced SQL skills for querying, managing, and structuring data stored in relational databases.

Roles and Responsibilities

- Design and implement scalable data processing pipelines to handle large data sets and support business goals.
- Collaborate with clients and team members to gather data requirements and ensure accurate data structuring.
- Optimize data architectures for performance, reliability, and scalability within cloud environments.
- Utilize AWS services to develop innovative data solutions tailored to client needs.
- Conduct regular data monitoring and maintenance to ensure data integrity and security.
- Analyze and interpret complex data sets, providing actionable insights to stakeholders.
- Stay updated with emerging trends and technologies in big data engineering to drive continuous improvement.
- Participate in code reviews and contribute to maintaining coding standards and practices.
  • Big Data Engineer

    7 days ago


    Bengaluru, Karnataka, India Scoop Technologies Pvt Ltd Full time

    Job Title : Big Data Engineer Location : Bangalore Employment Type : Full-time Work Mode : 4 Days Work from Office Notice Period : Immediate to 30 days Job Description : We are looking for a Big Data Engineer with expertise in Hadoop, Hive, SQL, Python, PySpark, and AWS to join our team in Bangalore. The ideal candidate will have hands-on experience in...

  • Big Data Engineer

    2 days ago


    Bengaluru, Karnataka, India Human Horizon Full time

    Responsibilities : - Design, develop, and execute test cases for large-scale big data platforms. - Perform testing on various Big Data technologies (e. g., Hadoop, Hive, Spark, NoSQL databases). - Ensure data accuracy, integrity, and quality in data processing and transformations. - Work closely with developers, data engineers, and business analysts to...

  • Big Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Scoop Technologies Pvt Ltd Full time

    Job Title : Big Data EngineerLocation : BangaloreEmployment Type : Full-timeWork Mode : 4 Days Work from OfficeNotice Period : Immediate to 30 daysJob Description :We are looking for a Big Data Engineer with expertise in Hadoop, Hive, SQL, Python, PySpark, and AWS to join our team in Bangalore. The ideal candidate will have hands-on experience in designing,...

  • Big Data Engineer

    6 days ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Welcome to Tata Consultancy Services, where we are driven by innovation and excellence. We are seeking an experienced Big Data Engineer to join our team.As a Big Data Engineer, you will work on designing and implementing scalable ETL/ELT processes and modeling data for low latency reporting. You will also work with large cloud data lakes and have experience...

  • Big Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India Human Horizon Full time

    Responsibilities :- Design, develop, and execute test cases for large-scale big data platforms.- Perform testing on various Big Data technologies (e. g., Hadoop, Hive, Spark, NoSQL databases).- Ensure data accuracy, integrity, and quality in data processing and transformations.- Work closely with developers, data engineers, and business analysts to...

  • Big Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Human Horizon Full time

    Responsibilities :- Design, develop, and execute test cases for large-scale big data platforms.- Perform testing on various Big Data technologies (e. g., Hadoop, Hive, Spark, NoSQL databases).- Ensure data accuracy, integrity, and quality in data processing and transformations.- Work closely with developers, data engineers, and business analysts to...

  • Big Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Telescopp Full time

    Job DescriptionJob OverviewWe are looking for a talented Big Data Engineer to join our team in Bengaluru. This is a mid-level, full-time position requiring a minimum of 4 years to a maximum of 6 years of relevant work experience. As a Big Data Engineer at Telescopp, you will be responsible for developing, testing, and maintaining big data solutions to...

  • Big Data Engineer

    6 days ago


    Bengaluru, Karnataka, India Vishanz Business Services Private Limited Full time

    Vishanz Business Services Private Limited is seeking an experienced Big Data Engineer to design and develop scalable data solutions. As a Data Engineer, you will work on creating data pipelines and ETL processes that handle large volumes of data.Key TasksDesign and develop big data solutions using Microsoft Azure services.Collaborate with data scientists and...

  • Big Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India Telescopp Full time

    Job OverviewWe are looking for a talented Big Data Engineer to join our team in Bengaluru. This is a mid-level, full-time position requiring a minimum of 4 years to a maximum of 6 years of relevant work experience. As a Big Data Engineer at Telescopp, you will be responsible for developing, testing, and maintaining big data solutions to support our client's...

  • Big Data Engineer

    7 days ago


    Bengaluru, Karnataka, India TEKDOORS Full time

    We are looking for a Big Data Engineer to build scalable data pipelines and support enterprise analytics applications by integrating and processing large datasets. Roles and Responsibilities : - Develop and manage data pipelines for integrating, consolidating, and cleansing data. - Utilize ETL tools and REST APIs for data integration and management. - Plan,...

  • Big Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India Infogain Full time

    Big Data Engineer (Standard) with skills Data Engineering, Data Warehouse, Big Data, databricks, Apache Spark, Azure Datalake, Pyspark for location Bangalore, India Posted on: July 30, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Advanced knowledge of Azure data services such as Azure SQL Database, Azure...

  • Big Data Engineer

    7 days ago


    Bengaluru, Karnataka, India Synechron Technologies Private Limited Full time

    Job DescriptionAbout UsSynechron Technologies Private Limited is a global digital transformation consulting and technology services company.Key ResponsibilitiesDesign and develop big data solutions using Hadoop, Spark, Hive, and Python.Develop and implement data processing pipelines for large-scale data sets.Analyze and optimize system performance for...

  • Big Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India Infogain Full time

    Big Data Engineer (Lead) with skills Data Engineering, Data Warehouse, Big Data, snowflake, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: July 30, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+...


  • Bengaluru, Karnataka, India Licious Full time

    Big Data Infrastructure EngineerLicious is seeking an experienced Big Data Infrastructure Engineer to join our team. As a Big Data Infrastructure Engineer, you will be responsible for designing and implementing scalable big data infrastructure that supports our core business processes. **Responsibilities**:* Design and implement scalable big data...

  • Big Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India TEKDOORS Full time

    We are looking for a Big Data Engineer to build scalable data pipelines and support enterprise analytics applications by integrating and processing large datasets.Roles and Responsibilities :- Develop and manage data pipelines for integrating, consolidating, and cleansing data.- Utilize ETL tools and REST APIs for data integration and management.- Plan,...

  • Big Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India TEKDOORS Full time

    We are looking for a Big Data Engineer to build scalable data pipelines and support enterprise analytics applications by integrating and processing large datasets.Roles and Responsibilities :- Develop and manage data pipelines for integrating, consolidating, and cleansing data.- Utilize ETL tools and REST APIs for data integration and management.- Plan,...


  • Bengaluru, Karnataka, India Tredence Inc. Full time

    About the PositionWe are looking for a highly skilled Big Data Engineering Expert to join our team. As a key member of our engineering group, you will be responsible for designing, developing, and implementing big data engineering solutions using cloud-based technologies such as Azure, GCP, and Snowflake.Key Responsibilities:Design and develop big data...

  • Big Data Engineer

    6 days ago


    Bengaluru, Karnataka, India Freight Tiger Full time

    About the JobWe are seeking an experienced Data Engineer to join our dynamic team in Bangalore. This role is crucial in building and maintaining our data infrastructure, enabling us to derive valuable insights and drive data-driven decisions.ResponsibilitiesDesign and Develop Data Pipelines: Build and optimize robust data pipelines to extract, transform, and...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India VidPro Consultancy Services Full time

    Job DescriptionRole : Big Data EngineerLocation : BangaloreJob Type : Fulltime, HybridSkills : Python, Spark, SQL, Databricks, Hadoop, Hive, Spark, AWS, DSAJob OverviewWe are seeking a Junior Big Data Engineer specializing in AWS for a full-time role located in Bangalore Urban, Bangalore Rural, Bangalore. As a key contributor in this role, you will leverage...

  • Big Data Engineer

    3 days ago


    Bengaluru, Karnataka, India Robotics Technologies Full time

    Job DescriptionDescriptionWe are seeking a skilled Big Data Engineer to join our team in India. The ideal candidate will have extensive experience in building and maintaining big data solutions to support data-driven decision making across the organization.Responsibilities- Design, develop, and maintain scalable data pipelines and architectures.- Work with...