Big Data Engineer

4 weeks ago


Bengaluru, Karnataka, India upGrad Full time

UpGrad is seeking a highly skilled Big Data Engineer to join our team. This role involves designing, developing, and maintaining scalable data solutions using Azure Databricks, Snowflake, and DBT.

We estimate the salary for this position to be around $120,000 - $180,000 per annum, depending on experience.

About the Role:

This position requires a strong understanding of modern data platforms, hands-on experience with Azure Databricks, Snowflake, DBT, SQL, and Kafka. The successful candidate will be responsible for:

  • Designing and developing scalable data pipelines using Azure Databricks, Snowflake, and DBT
  • Extracting, transforming, and loading data from various sources databases, files, APIs
  • Ensuring data quality and consistency throughout the data lifecycle
  • Optimizing data pipelines for performance and efficiency
  • Developing and maintaining data models and schemas
  • Collaborating with data analysts and scientists to support their data needs
  • Staying up-to-date with the latest data engineering technologies and trends

Requirements:

The ideal candidate should have:

  • 6+ years of experience working with modern data platforms and ETL processes
  • Strong understanding of Azure Databricks and its architecture, including Databricks Delta Lake, Spark, and MLflow
  • Proficient in Snowflake and its SQL dialect, data warehousing concepts, and performance optimization techniques
  • Hands-on experience with DBT for data modeling, testing, and deployment
  • Solid understanding of SQL and data querying techniques
  • Experience working with Kafka for real-time data streaming and processing
  • Knowledge of data engineering best practices and methodologies
  • Ability to work with large datasets and complex data pipelines

  • Big Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India NetAnalytiks Technologies Full time

    Job Title: Big Data EngineerWe are seeking an experienced Big Data Engineer to join our team at NetAnalytiks Technologies. As a key member of our data engineering team, you will play a crucial role in designing and implementing large-scale data processing systems.Key Responsibilities:Design and develop scalable data pipelines using Apache Spark and...

  • Big Data Engineer

    1 month ago


    Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

    Job DescriptionWe are seeking a highly skilled Big Data Engineer to join our team at Coders Brain Technology Private Limited. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying scalable big data pipelines using AWS Databricks.About the RoleDesign, develop, and deploy complex big data pipelines using...

  • Big Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India Yuma Full time

    Job Title: Big Data EngineerWe are seeking an experienced Big Data Engineer to join our team at Yuma. In this role, you will be responsible for designing and developing batch and streaming solutions using various Big Data technologies.The ideal candidate should have hands-on experience working with Big Data/Analytics technologies like Hadoop, Spark, Python,...

  • Big Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India Worksconsultancy Full time

    Company OverviewWe are Worksconsultancy, a leading provider of innovative solutions in the field of data engineering.About the RoleWe are seeking an experienced Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data systems using big data technologies such as Apache Spark,...

  • Big Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India Rapture Staffing Full time

    About Rapture StaffingWe are a staffing company that specializes in placing top talent in data engineering roles. Our team is passionate about helping professionals grow their careers and achieve their goals.Job Description:We are seeking an experienced Big Data Engineer to join our team at Rapture Staffing. The ideal candidate will have a strong background...

  • Big Data Engineer

    1 month ago


    Bengaluru, Karnataka, India QUESS Full time

    We are seeking a highly skilled Big Data Engineer to join our team at QUESS in Bangalore. The estimated salary for this role is ₹1,800,000 - ₹2,400,000 per annum.The ideal candidate will have extensive experience in big data engineering, including building data systems and pipelines, analyzing and organizing raw data, evaluating business needs and...


  • Bengaluru, Karnataka, India Grid Dynamics Full time

    Job Title: Big Data Engineering ExpertCompany Overview: Grid Dynamics is a leading provider of technology consulting, platform and product engineering, and advanced analytics services. We are seeking an experienced Big Data Engineering Expert to join our team.Job Description: As a Big Data Engineering Expert at Grid Dynamics, you will be responsible for...

  • Big Data Engineer

    1 month ago


    Bengaluru, Karnataka, India HR Consulting Full time

    About the RoleWe are seeking a skilled Senior Data Engineer to join our team at HR Consulting in Bengaluru. This is an exciting opportunity to work on deep data engineering projects and help define our technical strategy and team culture.This role involves designing and building data platforms and services while managing our data infrastructure in cloud...

  • Big Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Coffeee Full time

    About CoffeeeCoffeee is a dynamic company that values innovation and collaboration. We're looking for talented professionals to join our team and contribute to the development of cutting-edge big data solutions.Estimated Salary: $120,000 - $180,000 per yearHadoop Developer Job DescriptionWe're seeking an experienced Hadoop developer to join our team and lead...

  • Big Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India Idyllic Services Pvt Ltd Full time

    Job Title: Big Data EngineerWe are looking for a highly skilled Big Data Engineer to join our team at Idyllic Services Pvt Ltd. In this role, you will design, build, and maintain scalable data pipelines, optimize data processes, and ensure seamless integration of data from various sources.About UsWe are a leading provider of innovative data solutions,...


  • Bengaluru, Karnataka, India LTIMindtree Full time

    LTIMindtree is a global leader in digital transformation consulting and technology services. We are seeking an experienced Big Data Engineer to join our team in Bengaluru, NCR Noida, Gurugram, or Delhi.The ideal candidate will have 5+ years of experience in working with big data technologies such as Pyspark, SQL, and Hive. The role involves designing,...

  • Big Data Engineer

    3 days ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    OverviewTata Consultancy Services (TCS) is a global leader in IT services and consulting, with a rich history of innovation and excellence. We are looking for a talented Big Data Engineer - Data Scientist to join our team.Job DescriptionWe are seeking a highly skilled Big Data Engineer - Data Scientist to design and develop high-quality data solutions that...

  • Big Data Engineer

    5 days ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Tata Consultancy Services is a leading global consulting and technology services firm that has been at the forefront of digital transformation for over five decades.As a Big Data Engineer, you will be responsible for designing and implementing large-scale data processing systems using Hadoop and related technologies. Your expertise in distributed computing...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Tata Consultancy Services is seeking an experienced Big Data Engineering Lead to join our team.With a minimum of 8-12 years experience, this individual will be responsible for performing Big Data Administration and Engineering activities on multiple Hadoop, Hbase and Spark clusters.Main Responsibilities:Work on Performance Tuning and Increase Operational...


  • Bengaluru, Karnataka, India Sail Analytics Full time

    **Job Summary:** Big Data Engineering SpecialistWe are looking for a highly skilled Big Data Engineering Specialist to join our team at Sail Analytics. As a big data engineer, you will be responsible for designing, developing, testing, and maintaining scalable data warehouses and data pipelines using a range of technologies including SQL, Python, and...


  • Bengaluru, Karnataka, India Sigmoid Full time

    Sigmoid is a leading provider of big data solutions, and we are seeking an exceptional Technical Lead to join our team. In this role, you will be responsible for building highly scalable and extensible big data platforms that provide the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.This position reports...


  • Bengaluru, Karnataka, India Powerplay Full time

    **Job Description**We are looking for an experienced Big Data Engineer Lead to lead our data engineering efforts at Powerplay.The ideal candidate will have a strong background in designing and implementing scalable data architectures, as well as experience with big data tools and technologies.Key Responsibilities:Design and implement large-scale data...

  • Senior Data Engineer

    1 month ago


    Bengaluru, Karnataka, India LinkedIn Full time

    About the RoleThis role offers a hybrid work option, meaning you can both work from home and commute to an office, depending on what's best for you and your team. As a Senior Data Engineer - Big Data, you will leverage big data to empower business decisions and deliver data-driven insights, metrics, and tools in order to drive member engagement, business...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    About the RoleWe are seeking an experienced Senior Big Data Cluster Engineer to join our team at Tata Consultancy Services. This is a critical role that requires strong technical skills, expertise in big data technologies, and experience in leading teams.Key ResponsibilitiesDesign, implement, and manage large-scale Hadoop clusters across multiple...


  • Bengaluru, Karnataka, India LTIMindtree Full time

    Job Title: Senior Big Data EngineerAbout the Role:We are seeking a skilled Senior Big Data Engineer to join our team at LTIMindtree. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop scalable big data architectures using...