Senior Big Data Engineer

18 hours ago


Delhi, Delhi, India HCLTech Full time
About HCLTech

We are a leading global technology company with a strong presence in the IT services industry. Our team of experts is passionate about delivering innovative solutions that drive business growth and success.

Job Title: Senior Big Data Engineer - ETL Framework DeveloperLocation: Pan India

Salary: ₹ 25,00,000 - ₹ 40,00,000 per annum

Job Description

As a Senior Big Data Engineer at HCLTech, you will be responsible for designing and developing an ETL framework using BigQuery, with expertise in concepts like Nested Queries, Clustering, Partitioning, etc.

You will work on data integration, data transformation, data quality, and data lineage tools, ensuring seamless automation of data load from Big Query using APIs or scripting language.

Additionally, you will manage end-to-end data engineering and lifecycle (including non-functional requirements and operations) management, as well as design and develop end-to-end solution designs skills – prototyping, usability testing, and data visualization literacy.

You will also have experience with SQL and NoSQL modern data stores, working in a Dev-Sec-Ops environment, and leveraging technologies like Spark, Hadoop, Hive, MapReduce, Airflow, DAG, etc.

Required Skills and Qualifications
  • Professional experience in Data Engineering using Google Big Query (GBQ) and Google Cloud Platform (GCP) datasets and building data pipelines.
  • Hands-on experience working with Google Data Products (e.g., BigQuery, Dataflow, Dataproc, Dataprep, Cloud Composer, Airflow, DAG, etc.).
  • Python programming expertise in PySpark, Pandas.
  • Experience in Airflow (Create DAG, Configure variables in Airflow, Scheduling).
  • Big Data technologies and solutions (Spark, Hadoop, Hive, MapReduce) and multiple scripting languages (YAML, Python).
  • Experience in DBT to create lineage in GCP – Optional.
Benefits

We offer a comprehensive benefits package, including competitive salary, medical insurance, paid time off, and professional development opportunities.

How to Apply

Interested candidates can drop their CV to our HR department.



  • Delhi, Delhi, India Circana Full time

    About the RoleWe are seeking a highly skilled Senior Big Data Engineer to join our team at Circana. The ideal candidate will have a strong background in big data technologies, including Hadoop, Spark, and Scala.Key ResponsibilitiesDesign and develop large-scale data processing systems using Hadoop and Spark.Work with our data engineering team to architect...


  • Delhi, Delhi, India PRONEXUS CONSULTING PRIVATE LIMITED Full time

    **Job Title:** Senior Data Engineer - Big Data Pipeline SpecialistAt Pronexus Consulting Private Limited, we are seeking an experienced and highly skilled Senior Data Engineer - Big Data Pipeline Specialist to join our team. This role will involve designing, developing, and implementing large-scale data pipelines using various technologies such as Spark,...


  • Delhi, Delhi, India CodeVyasa Full time

    Job DescriptionWe are seeking a highly skilled Senior Big Data Engineer to join our team in Bangalore. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing pipelines using PySpark for both streaming and batch processing.Key Responsibilities:- Design, implement, and...


  • Delhi, Delhi, India Railofy Full time

    About Railofy: We are a young team of technologists who have made a significant breakthrough in the field using Machine Learning to create a major impact in the lives of Indians. Our mission is to solve the largest problems for Indian Railway passengers, such as waitlisted tickets and quality of food in trains.Job Description: We are looking for a Senior...


  • Delhi, Delhi, India HCLTech Full time

    About the RoleWe are seeking a highly skilled Senior Big Data Engineer to join our team at HCLTech. As a key member of our engineering team, you will be responsible for designing and developing scalable data pipelines using Google Cloud Platform (GCP) technologies.Key ResponsibilitiesDesign and implement data pipelines using GCP services such as BigQuery,...

  • Big Data Engineer

    1 week ago


    Delhi, Delhi, India Wipro Full time

    We are seeking a highly skilled Big Data Engineer to join our team at Wipro. As a Big Data Engineer, you will play a key role in designing, developing, and maintaining large-scale data processing systems.The ideal candidate will have a strong background in Hadoop and related technologies such as Scala. You will work closely with cross-functional teams to...


  • Delhi, Delhi, India LTIMindtree Full time

    We are seeking an experienced Data Engineer to join our team at LTIMindtree. As a key member of our big data solutions group, you will be responsible for designing and developing scalable data platforms using modern technologies like Spark, HBase, Hive, and other Hadoop ecosystem tools.About the RoleIn this role, you will work closely with cross-functional...

  • Big Data Engineer

    1 month ago


    Delhi, Delhi, India Talent Pro Full time

    Hadoop Developer Job DescriptionWe are currently looking for a skilled and experienced Hadoop Developer to join our team at Talent Pro.As a Hadoop Developer, you will be responsible for designing, developing, and maintaining large-scale big data processing pipelines using the Hadoop ecosystem (HDFS, MapReduce) and Spark.The ideal candidate will have a strong...

  • Engineering Manager

    3 weeks ago


    Delhi, Delhi, India PROTEGRITY INDIA PRIVATE LIMITED Full time

    About the RoleProtegrity - Engineering Manager - Big DataProtegrity is a pioneering company in data protection, and we're seeking a seasoned Engineering Manager to lead our Big Data team. This role requires a strategic thinker with expertise in data security and a passion for mentoring and guiding technical teams.Key ResponsibilitiesManage the research and...


  • Delhi, Delhi, India NEXUS CONSULTING SOLUTIONS Full time

    We are seeking a skilled Data Engineer to join our team at NEXUS CONSULTING SOLUTIONS. This role requires experience in working with large data sets and a strong understanding of big data systems.Job DescriptionA successful candidate will have hands-on experience in Python and Scala programming languages. Additionally, they should be familiar with the Spark...


  • Delhi, Delhi, India NucleusTeq Consulting Pvt. Ltd. Full time

    About the RoleAs a Big Data Solutions Architect, you will be responsible for finalizing the scope of the system and delivering Big Data solutions. This position requires in-depth knowledge of Hadoop, Spark, and similar frameworks.Responsibilities- Lead a team of engineers and have a good attitude toward learning the domain and implementation.- Collaborate...

  • Cloud Data Engineer

    6 days ago


    Delhi, Delhi, India Tata Consultancy Services Full time

    Tata Consultancy Services is seeking a highly skilled Cloud Data Engineer - Big Data Analytics to join our team. We are conducting interviews for this role, and we encourage qualified candidates to apply. Company Overview


  • Delhi, Delhi, India Freelancer Recruiter Full time

    At Freelancer Recruiter, we're looking for a highly skilled Big Data DevOps Engineer to join our team. If you have 5+ years of experience managing the Big Data application stack, including HDFS, YARN, Spark, Hive, and Hbase, this could be the perfect opportunity for you.We're offering an estimated salary range of $120,000 - $180,000 per year, depending on...

  • Data Engineering Lead

    2 weeks ago


    Delhi, Delhi, India Lancetech solutions Full time

    **About Lancetech Solutions**We are a cutting-edge technology company that provides innovative solutions to meet the ever-evolving needs of our clients. As a data engineering lead, you will play a vital role in shaping the future of our data-driven products.**Salary and Benefits**We offer a competitive salary range of $180,000 - $250,000 per annum, depending...

  • Big Data Engineer

    2 hours ago


    Delhi, Delhi, India Talent Pro Full time

    Job Title: Big Data Engineer - Design and Develop Scalable Solutions">About the Role:Talent Pro is seeking a highly skilled Hadoop Developer to join our team. As a Big Data Engineer, you will design and develop large-scale big data processing pipelines using Hadoop ecosystem (HDFS, MapReduce) and Spark.Key Responsibilities:Design, develop, test, deploy, and...


  • Delhi, Delhi, India Insight Global Full time

    We are seeking a highly skilled Big Data Solutions Architect to join our team at Insight Global.The ideal candidate will have a solid background in data engineering and a strong understanding of big data technologies such as Hadoop and Spark. They will design, build, and optimize complex data pipelines and data sets to support business strategies and drive...


  • Delhi, Delhi, India CAI Info India Pvt Ltd. Full time

    About the RoleCAI Info India Pvt Ltd. is seeking an experienced AWS Data Engineer to design and develop robust data lakes, leveraging cutting-edge technologies such as S3, Glue, Lake Formation, EMR, Kinesis, RDS, DMS, and Redshift.This full-time remote position requires a strong background in cloud computing, data engineering, and software development, with...

  • Data Engineer

    2 weeks ago


    Delhi, Delhi, India Max life insurance co ltd Full time

    **About the Role**Max Life Insurance Co Ltd is seeking an experienced Data Engineer - Cloud Big Data Specialist to join our team. This role requires a skilled professional who can design, implement, and maintain scalable data pipelines and infrastructure on AWS cloud platform.In this position, you will be responsible for architecting large-scale data...

  • Senior Data Engineer

    2 weeks ago


    Delhi, Delhi, India Interspence Solutions Full time

    About the Job :Company Overview :We are Interspence Solutions, a leading IT consulting and support services provider in the manufacturing and process industry. We have entered into a long-term contract with a Major US-based Oil & Gas company to provide skilled IT resources and services under their IT leadership team direction.We are transforming our business...

  • Senior Data Engineer

    18 hours ago


    Delhi, Delhi, India Mindteck Full time

    About the RoleWe are seeking an exceptional Senior Data Engineer to join our team in India (Work-From-Home). This is a permanent position with a salary range of INR 24-28 LPA.