Senior Big Data Engineer

2 weeks ago


Gurgaon, Haryana, India SMARTWORK IT SERVICES Full time

About the Role

We are seeking an experienced Senior Big Data Engineer to work on collecting, storing, processing, and analyzing large data sets in our Bangalore, Chennai, Kolkata, Gurugram, Pune office.

The ideal candidate will have a strong understanding of data warehousing and data modeling techniques, proficient knowledge of distributed computing principles, and hands-on experience with GCP platforms, including Airflow, Cloud Composer, Data Fusion, Data Flow, Data Proc, BigQuery.

Key Responsibilities

  • Selecting and integrating Big Data tools and frameworks to provide requested capabilities.
  • Developing and maintaining data pipelines, implementing ETL processes, monitoring performance, and advising on necessary infrastructure changes.
  • Translating complex technical and functional requirements into detailed designs.
  • Investigating and analyzing alternative solutions for data storage, processing, etc., to ensure the most streamlined approaches are implemented.

Requirements

  • Strong understanding of data warehousing and data modeling techniques.
  • Proficient understanding of distributed computing principles.
  • Hands-on experience with GCP platforms, including Airflow, Cloud Composer, Data Fusion, Data Flow, Data Proc, BigQuery.
  • Experience with building stream-processing systems, using solutions such as Storm or Spark Streaming.
  • Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala.
  • Experience with Spark, SQL, and Linux.
  • Knowledge of various ETL techniques and frameworks, such as Flume, Apache NiFi, or DBT.
  • Experience with messaging systems like Kafka or RabbitMQ.

What We Offer

  • An estimated salary of ₹1200000 - ₹1800000 per annum.
  • A dynamic and challenging work environment.
  • Ongoing training and professional development opportunities.


  • Gurgaon, Haryana, India Arrixa Full time

    Arrixa is seeking an experienced Senior Big Data Engineer to lead the design and implementation of our big data solutions on Azure Databricks. This role requires a strong background in big data technologies, including Apache Spark, and experience working with large-scale data processing pipelines.About ArrixaArrixa is a leading provider of innovative...


  • Gurgaon, Haryana, India BayOne Solutions Full time

    Job Title: Senior Cloud Data Engineer for Big Data SolutionsAbout BayOne SolutionsBayOne Solutions is a 12-year-old software consulting organization based in Pleasanton, California, USA. We specialize in providing talent and solutions, with a passion for diversity in tech.Job OverviewWe are seeking an experienced Senior Cloud Data Engineer to join our team....


  • Gurgaon, Haryana, India SMARTWORK IT SERVICES Full time

    Job Title: Senior Big Data Solutions ArchitectJob Summary:We are seeking a skilled Senior Big Data Solutions Architect to join our team at SMARTWORK IT SERVICES. As a Senior Big Data Solutions Architect, you will be responsible for designing and implementing scalable big data solutions to meet the ever-growing needs of our clients.Key...


  • Gurgaon, Haryana, India Impetus Technologies Full time

    Impetus Technologies is seeking a Senior Big Data Architect to lead our PySpark development team.Salary: $150,000 - $200,000 per yearJob Description:We are looking for an experienced professional with a strong background in Big Data technologies, particularly PySpark, Hadoop, and Hive. The ideal candidate will have 5-7 years of hands-on experience in...

  • Data Architect

    2 days ago


    Gurgaon, Haryana, India Impetus Full time

    Job SummaryWe are seeking a skilled Data Architect - Big Data Engineer to join our team at Impetus. As a key member of our data engineering team, you will design, develop, and implement efficient ETL pipelines using big data technologies.About the RoleDevelop scalable and secure data pipelines using Hadoop, Hive, and PySpark.Collaborate with cross-functional...


  • Gurgaon, Haryana, India AIDA projektai, MB Full time

    Job Description:We are seeking a highly skilled Senior Real-Time Data Engineer to join our team at AIDA projektai, MB. This role is ideal for someone with strong expertise in working with big data and hands-on experience in managing and deploying real-time data streaming pipelines.Key Responsibilities:Design, implement, and manage real-time data streaming...


  • Gurgaon, Haryana, India PAR Tech India Full time

    Job OverviewWe are seeking a highly skilled Senior Data Engineer to join our team at PAR Tech India. As a Senior Data Engineer, you will play a critical role in shaping Punchh's data innovations and creating cutting-edge big data solutions.Estimated Salary: ₹33 Lakhs - ₹35 Lakhs per annum (commensurate with work location, experience, skills,...


  • Gurgaon, Haryana, India The Nielsen Company Full time

    Senior/Lead Software Engineer Position OverviewWe are seeking an experienced Senior/Lead Software Engineer to join our DevOps team at The Nielsen Company. In this role, you will be responsible for analyzing, developing, testing, and supporting Big Data applications.


  • Gurgaon, Haryana, India Spectral Consultants – Search & Recruitment firm Full time

    Job OverviewSpectral Consultants is seeking an experienced Big Data Developer to join our team.About the RoleWe are looking for a skilled professional with expertise in building scalable and efficient data pipelines using Big Data technologies such as Hive, Spark, Hadoop, and MapReduce.Key ResponsibilitiesDesign, implement, and optimize large-scale data...

  • Data Engineer

    3 weeks ago


    Gurgaon, Haryana, India exl Full time

    Job DescriptionWe are seeking a skilled Data Engineer to join our team as a Big Data Architect. This is an exciting opportunity to work with cutting-edge technology and contribute to the design and implementation of large-scale data processing systems.About EXLEXL (NASDAQ:EXLS) is a leading operations management and analytics company that helps businesses...


  • Gurgaon, Haryana, India AMEX Full time

    At American Express, we're committed to being the best at what we do. That's why we're looking for a seasoned Senior Software Engineer to join our team.We offer a competitive salary of $120,000 per year, plus bonus incentives and comprehensive benefits, including medical, dental, vision, life insurance, and disability coverage. You'll also have access to...


  • Gurgaon, Haryana, India Myananta Technologies Full time

    Myananta Technologies is a leading technology firm based in Gurugram, India.We are seeking an experienced Data Engineer to join our team and help us drive innovation in big data analytics.About the Role:We are looking for a highly skilled individual with expertise in Hadoop, Spark, Hive, and Airflow. The successful candidate will have extensive experience in...


  • Gurgaon, Haryana, India Aays Full time

    About UsAays is a cutting-edge company at the forefront of innovation, dedicated to harnessing the power of data to drive business growth.Salary and BenefitsWe offer an attractive salary range of $120,000 - $180,000 per annum, along with a comprehensive benefits package that includes health insurance, retirement plans, and generous paid time off.Job...


  • Gurgaon, Haryana, India NITS Solutions Full time

    Position Overview :We are seeking an Associate Big Data Engineer to join our team at NITS Solutions. The ideal candidate will have hands-on experience with Python, SQL, and POSTGRESQL, as well as a basic understanding of Pandas, Pyspark, and ETL processes.Key Responsibilities :Understand business needs and apply analytical concepts to generate actionable...


  • Gurgaon, Haryana, India BayOne Solutions Full time

    Are you a seasoned data engineer looking for a new challenge? BayOne Solutions is seeking an experienced Cloud Data Engineer to join our team. With a strong background in modern data engineering, data warehousing, and data lakes technologies on cloud platforms like Azure, AWS, and GCP, this role is perfect for those who want to work with cutting-edge...


  • Gurgaon, Haryana, India Nielsen Full time

    At Nielsen, we're driven by a passion to revolutionize the media landscape and empower informed decision-making. As a Senior Software Engineer-AM-TECH-DA-DC-11 on our team, you'll play a pivotal role in shaping the future of data-driven insights.About the RoleWe're seeking an exceptional Big Data Software Engineer to join our DevOps team. Your primary...

  • Cloud Engineer

    3 weeks ago


    Gurgaon, Haryana, India The Nielsen Company Full time

    We are looking for a seasoned Cloud Engineer with expertise in Big Data technologies to join our team at The Nielsen Company. This role is perfect for someone who wants to leverage their passion for cloud architecture and big data processing to drive business growth.Job DescriptionThis is an exciting opportunity to work on complex projects that involve...

  • Big Data Architect

    1 week ago


    Gurgaon, Haryana, India dunnhumby Full time

    About Usdunnhumby is a market-leading business that explores new opportunities for global retailers.We're looking for a Big Data Architect who expects more from their career. It's a chance to extend and improve our Data Engineering Team and influence our technology strategy and data principles.You will be responsible for working with stakeholders in the...


  • Gurgaon, Haryana, India Nielsen Full time

    Are you a talented software engineer looking to make an impact in the media industry? We have an exciting opportunity for a Cloud Architect Engineer for Big Data Solutions at Nielsen, a global leader in providing powerful insights that drive client decisions and deliver extraordinary results.About UsWe are passionate about our work to power a better media...


  • Gurgaon, Haryana, India Metyis Full time

    Job SummaryWe are seeking a highly skilled Senior Data Engineering Lead to join our team at Metyis. As a key member of our data engineering team, you will be responsible for designing and implementing large-scale data processing solutions.About the RoleThe ideal candidate will have 7+ years of experience in managing and leading data engineering projects,...