Big Data Engineer

1 month ago


Gurgaon, Haryana, India Spectral Consultants – Search & Recruitment firm Full time
Job Title: Big Data Developer

Job Summary:

We are seeking an experienced Big Data Developer to join our team at Spectral Consultants. The ideal candidate will have a strong background in building scalable and efficient data pipelines using Hive, Spark, Hadoop, and MapReduce.

Key Responsibilities:

  • Design, implement, and optimize large-scale data processing pipelines using Hive, Spark, Hadoop, and MapReduce.
  • Collaborate with the data engineering team to develop and maintain scalable data solutions.
  • Ensure data quality and integrity by implementing data validation and cleansing processes.
  • Utilize knowledge in Snowflake, Snowpark, and SnowSQL to handle large datasets and improve performance.
  • Work with both RDBMS and NoSQL databases to design and query data models.
  • Optimize and deploy data solutions on cloud platforms like AWS, Azure, or GCP.

Requirements:

  • Strong understanding of Big Data technologies, including Hive, Spark, Hadoop, and MapReduce.
  • Proficiency in at least one programming language: Python, Java, or Scala.
  • Experience with Snowflake, Snowpark, and SnowSQL.
  • Good understanding of RDBMS and NoSQL database concepts.
  • Exposure to Cloud Platforms: AWS, Azure, GCP.

Desired Skills:

  • Ability to write efficient and optimized code for processing large datasets.
  • Familiarity with CI/CD pipelines, version control systems, and testing frameworks.
  • Strong problem-solving skills and a desire to learn new technologies.

Qualifications:

  • B.E/B.Tech in Computer Science, Information Technology, or a related field.


  • Gurgaon, Haryana, India Arrixa Full time

    Arrixa is seeking an experienced Senior Big Data Engineer to lead the design and implementation of our big data solutions on Azure Databricks. This role requires a strong background in big data technologies, including Apache Spark, and experience working with large-scale data processing pipelines.About ArrixaArrixa is a leading provider of innovative...

  • Data Engineer

    4 weeks ago


    Gurgaon, Haryana, India Chiselon Technologies Pvt Ltd Full time

    We are seeking a talented Data Engineer with expertise in Big Data and Google Cloud Platform (GCP) to join our team at Chiselon Technologies Pvt Ltd.This role is ideal for individuals with hands-on experience in Big Query, Data Proc, Airflow, Cloud Composer, GCP Hydra Services, and Cloud Data Optimization.Key responsibilities:Design and develop scalable data...

  • Big Data Engineer

    4 weeks ago


    Gurgaon, Haryana, India ACS Consultants Full time

    **Job Title:** Big Data Engineer**Job Summary:We are seeking an experienced Big Data Engineer to join our team at ACS Consultants. As a key member of our data science team, you will be responsible for designing, developing, and managing large-scale data processing systems using Hadoop, Hive, and Spark.Main Responsibilities:• Design and implement scalable...

  • Data Engineer

    4 weeks ago


    Gurgaon, Haryana, India Spectral Consultants – Search & Recruitment firm Full time

    Job Role : Data Engineer - Big Data ArchitectureWe are seeking a skilled Data Engineer to join our team at Spectral Consultants. As a Data Engineer, you will play a crucial role in designing, building, and maintaining large-scale data processing pipelines using Big Data technologies like Hive, Spark, Hadoop, and MapReduce.Key Responsibilities :Design and...


  • Gurgaon, Haryana, India Uncap Research Labs Full time

    Data Engineering Role at Uncap Research LabsWe are seeking a highly skilled Data Engineer to join our team at Uncap Research Labs. This role will involve designing and implementing scalable data services, developing and deploying production data pipelines, and optimizing big data systems for performance and efficiency.Key Responsibilities Apache Spark and...

  • Big Data Engineer

    3 weeks ago


    Gurgaon, Haryana, India dunnhumby Full time

    Transformative Data Engineering OpportunityWe're seeking a seasoned Big Data Engineer to extend and improve dunnhumby's Data Engineering Team. As a key member of our Innovation Technology department, you'll work with a market-leading business to explore new opportunities for data-driven growth and influence global retailers.ResponsibilitiesDevelop data...

  • Data Engineer

    1 week ago


    Gurgaon, Haryana, India exl Full time

    Job DescriptionWe are seeking a skilled Data Engineer to join our team as a Big Data Architect. This is an exciting opportunity to work with cutting-edge technology and contribute to the design and implementation of large-scale data processing systems.About EXLEXL (NASDAQ:EXLS) is a leading operations management and analytics company that helps businesses...

  • Big Data Engineer

    3 weeks ago


    Gurgaon, Haryana, India Impetus Full time

    About the RoleWe are seeking a skilled Big Data Developer to join our team at Impetus. The ideal candidate will have experience with design and coding across multiple platforms and languages, including Python, Pyspark, and Scala.Key ResponsibilitiesDesign, develop, test, and deploy efficient and maintainable systems using Big Data technologies.Collaborate...

  • Data Engineer

    4 weeks ago


    Gurgaon, Haryana, India dunnhumby Full time

    We're seeking a Big Data Engineerwho is passionate about data technology and wants to be part of a market-leading business. This is an opportunity to work with a talented team and contribute to the development of data technology that meets the goals of the dunnhumby technology strategy and data principles.Key Responsibilities:Manage Big Data space with 2+...


  • Gurgaon, Haryana, India BayOne Solutions Full time

    Job Title: Senior Cloud Data Engineer for Big Data SolutionsAbout BayOne SolutionsBayOne Solutions is a 12-year-old software consulting organization based in Pleasanton, California, USA. We specialize in providing talent and solutions, with a passion for diversity in tech.Job OverviewWe are seeking an experienced Senior Cloud Data Engineer to join our team....


  • Gurgaon, Haryana, India PRONTO CONSULTING SERVICES Full time

    Job SummaryPRONTO CONSULTING SERVICES is seeking an experienced Big Data Solutions Architect to join our team. As a key member of our data engineering team, you will be responsible for designing and developing scalable data engineering solutions on big data ecosystems.About the RoleWe are looking for a skilled professional with expertise in big data...

  • Big Data Developer

    4 weeks ago


    Gurgaon, Haryana, India dunnhumby Full time

    We're searching for a talented Big Data EngineerWho is passionate about data technology and wants to be part of a market-leading business that explores new opportunities for growth. This is an opportunity to work with a world-class team to develop and improve dunnhumby's Data Engineering capabilities. You'll be responsible for working with stakeholders to...


  • Gurgaon, Haryana, India PRONTO CONSULTING SERVICES Full time

    Job DescriptionWe are seeking a highly skilled Big Data Solutions Architect to join our team at Pronto Consulting Services. The ideal candidate will have expertise in designing and developing data engineering solutions on big data ecosystems, including Spark, Hive, and Python.Key Responsibilities:Design and develop data engineering solutions on big data...


  • Gurgaon, Haryana, India Chiselon Technologies Pvt Ltd Full time

    # Opportunity Alert #Chiselon Technologies Pvt Ltd is seeking a highly skilled Big Data Engineer to join our team.Key Responsibilities:Develop and implement big data solutions on GCP.Utilize GCP services such as Big Query, Data Proc, Airflow, and Cloud Composer.Collaborate with cross-functional teams to design and implement data pipelines.Requirements:3+...

  • Cloud Engineer

    1 week ago


    Gurgaon, Haryana, India The Nielsen Company Full time

    We are looking for a seasoned Cloud Engineer with expertise in Big Data technologies to join our team at The Nielsen Company. This role is perfect for someone who wants to leverage their passion for cloud architecture and big data processing to drive business growth.Job DescriptionThis is an exciting opportunity to work on complex projects that involve...


  • Gurgaon, Haryana, India Absolutdata Full time

    About the RoleAbsolutdata is at the forefront of the Big Data revolution, leveraging advanced analytics to transform business decision-making. As a Big Data Infrastructure Specialist, you will play a key role in building and implementing optimal solutions for our clients. With a strong background in Big Data technologies, you will work closely with our...

  • Senior Data Engineer

    3 weeks ago


    Gurgaon, Haryana, India Orange Business Full time

    Job SummaryOrange Business is seeking a Senior Data Engineer to join our Big Data B2B program. As part of this program, we have set up a shared Big Data platform and a Data Lake for use cases exploration and industrialization.The successful candidate will have 4-6 years of experience in building Data Pipelines on Prem and Cloud with the following key...

  • Senior Data Architect

    3 weeks ago


    Gurgaon, Haryana, India Absolutdata Full time

    Job SummaryAbsolutdata is at the forefront of the Big Data revolution, leveraging advanced analytics to transform business decision-making. As a Senior Data Architect, you will design and implement scalable Big Data solutions, driving business results through data-driven insights.Key ResponsibilitiesLead the development of Big Data infrastructure, ensuring...


  • Gurgaon, Haryana, India Nielsen Full time

    Are you a talented software engineer looking to make an impact in the media industry? We have an exciting opportunity for a Cloud Architect Engineer for Big Data Solutions at Nielsen, a global leader in providing powerful insights that drive client decisions and deliver extraordinary results.About UsWe are passionate about our work to power a better media...


  • Gurgaon, Haryana, India HuQuo Consulting Pvt. Ltd. Full time

    Job SummaryHuQuo Consulting Pvt. Ltd. seeks a highly skilled Data Architect/Engineer to lead the development and implementation of Big Data and Spark-based solutions. The ideal candidate will have expertise in Apache Spark 3.X and SCALA programming, as well as hands-on experience with Delta lake implementation.Key ResponsibilitiesDesign and optimize Spark...