Senior Big Data Engineer
18 hours ago
We are a leading global technology company with a strong presence in the IT services industry. Our team of experts is passionate about delivering innovative solutions that drive business growth and success.
Job Title: Senior Big Data Engineer - ETL Framework DeveloperLocation: Pan IndiaSalary: ₹ 25,00,000 - ₹ 40,00,000 per annum
Job DescriptionAs a Senior Big Data Engineer at HCLTech, you will be responsible for designing and developing an ETL framework using BigQuery, with expertise in concepts like Nested Queries, Clustering, Partitioning, etc.
You will work on data integration, data transformation, data quality, and data lineage tools, ensuring seamless automation of data load from Big Query using APIs or scripting language.
Additionally, you will manage end-to-end data engineering and lifecycle (including non-functional requirements and operations) management, as well as design and develop end-to-end solution designs skills – prototyping, usability testing, and data visualization literacy.
You will also have experience with SQL and NoSQL modern data stores, working in a Dev-Sec-Ops environment, and leveraging technologies like Spark, Hadoop, Hive, MapReduce, Airflow, DAG, etc.
Required Skills and Qualifications- Professional experience in Data Engineering using Google Big Query (GBQ) and Google Cloud Platform (GCP) datasets and building data pipelines.
- Hands-on experience working with Google Data Products (e.g., BigQuery, Dataflow, Dataproc, Dataprep, Cloud Composer, Airflow, DAG, etc.).
- Python programming expertise in PySpark, Pandas.
- Experience in Airflow (Create DAG, Configure variables in Airflow, Scheduling).
- Big Data technologies and solutions (Spark, Hadoop, Hive, MapReduce) and multiple scripting languages (YAML, Python).
- Experience in DBT to create lineage in GCP – Optional.
We offer a comprehensive benefits package, including competitive salary, medical insurance, paid time off, and professional development opportunities.
How to ApplyInterested candidates can drop their CV to our HR department.
-
Senior Big Data Engineer
4 weeks ago
Delhi, Delhi, India Circana Full timeAbout the RoleWe are seeking a highly skilled Senior Big Data Engineer to join our team at Circana. The ideal candidate will have a strong background in big data technologies, including Hadoop, Spark, and Scala.Key ResponsibilitiesDesign and develop large-scale data processing systems using Hadoop and Spark.Work with our data engineering team to architect...
-
Senior Data Engineer
1 week ago
Delhi, Delhi, India PRONEXUS CONSULTING PRIVATE LIMITED Full time**Job Title:** Senior Data Engineer - Big Data Pipeline SpecialistAt Pronexus Consulting Private Limited, we are seeking an experienced and highly skilled Senior Data Engineer - Big Data Pipeline Specialist to join our team. This role will involve designing, developing, and implementing large-scale data pipelines using various technologies such as Spark,...
-
Senior Big Data Engineer
6 days ago
Delhi, Delhi, India CodeVyasa Full timeJob DescriptionWe are seeking a highly skilled Senior Big Data Engineer to join our team in Bangalore. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing pipelines using PySpark for both streaming and batch processing.Key Responsibilities:- Design, implement, and...
-
Senior Data Scientist for Big Data Solutions
2 hours ago
Delhi, Delhi, India Railofy Full timeAbout Railofy: We are a young team of technologists who have made a significant breakthrough in the field using Machine Learning to create a major impact in the lives of Indians. Our mission is to solve the largest problems for Indian Railway passengers, such as waitlisted tickets and quality of food in trains.Job Description: We are looking for a Senior...
-
Senior Big Data Engineer
18 hours ago
Delhi, Delhi, India HCLTech Full timeAbout the RoleWe are seeking a highly skilled Senior Big Data Engineer to join our team at HCLTech. As a key member of our engineering team, you will be responsible for designing and developing scalable data pipelines using Google Cloud Platform (GCP) technologies.Key ResponsibilitiesDesign and implement data pipelines using GCP services such as BigQuery,...
-
Big Data Engineer
1 week ago
Delhi, Delhi, India Wipro Full timeWe are seeking a highly skilled Big Data Engineer to join our team at Wipro. As a Big Data Engineer, you will play a key role in designing, developing, and maintaining large-scale data processing systems.The ideal candidate will have a strong background in Hadoop and related technologies such as Scala. You will work closely with cross-functional teams to...
-
Data Engineer for Big Data Solutions
18 hours ago
Delhi, Delhi, India LTIMindtree Full timeWe are seeking an experienced Data Engineer to join our team at LTIMindtree. As a key member of our big data solutions group, you will be responsible for designing and developing scalable data platforms using modern technologies like Spark, HBase, Hive, and other Hadoop ecosystem tools.About the RoleIn this role, you will work closely with cross-functional...
-
Big Data Engineer
1 month ago
Delhi, Delhi, India Talent Pro Full timeHadoop Developer Job DescriptionWe are currently looking for a skilled and experienced Hadoop Developer to join our team at Talent Pro.As a Hadoop Developer, you will be responsible for designing, developing, and maintaining large-scale big data processing pipelines using the Hadoop ecosystem (HDFS, MapReduce) and Spark.The ideal candidate will have a strong...
-
Engineering Manager
3 weeks ago
Delhi, Delhi, India PROTEGRITY INDIA PRIVATE LIMITED Full timeAbout the RoleProtegrity - Engineering Manager - Big DataProtegrity is a pioneering company in data protection, and we're seeking a seasoned Engineering Manager to lead our Big Data team. This role requires a strategic thinker with expertise in data security and a passion for mentoring and guiding technical teams.Key ResponsibilitiesManage the research and...
-
Data Engineering Expert for Big Data Systems
18 hours ago
Delhi, Delhi, India NEXUS CONSULTING SOLUTIONS Full timeWe are seeking a skilled Data Engineer to join our team at NEXUS CONSULTING SOLUTIONS. This role requires experience in working with large data sets and a strong understanding of big data systems.Job DescriptionA successful candidate will have hands-on experience in Python and Scala programming languages. Additionally, they should be familiar with the Spark...
-
Big Data Solutions Architect
4 weeks ago
Delhi, Delhi, India NucleusTeq Consulting Pvt. Ltd. Full timeAbout the RoleAs a Big Data Solutions Architect, you will be responsible for finalizing the scope of the system and delivering Big Data solutions. This position requires in-depth knowledge of Hadoop, Spark, and similar frameworks.Responsibilities- Lead a team of engineers and have a good attitude toward learning the domain and implementation.- Collaborate...
-
Cloud Data Engineer
6 days ago
Delhi, Delhi, India Tata Consultancy Services Full timeTata Consultancy Services is seeking a highly skilled Cloud Data Engineer - Big Data Analytics to join our team. We are conducting interviews for this role, and we encourage qualified candidates to apply. Company Overview
-
Big Data DevOps Expert
2 weeks ago
Delhi, Delhi, India Freelancer Recruiter Full timeAt Freelancer Recruiter, we're looking for a highly skilled Big Data DevOps Engineer to join our team. If you have 5+ years of experience managing the Big Data application stack, including HDFS, YARN, Spark, Hive, and Hbase, this could be the perfect opportunity for you.We're offering an estimated salary range of $120,000 - $180,000 per year, depending on...
-
Data Engineering Lead
2 weeks ago
Delhi, Delhi, India Lancetech solutions Full time**About Lancetech Solutions**We are a cutting-edge technology company that provides innovative solutions to meet the ever-evolving needs of our clients. As a data engineering lead, you will play a vital role in shaping the future of our data-driven products.**Salary and Benefits**We offer a competitive salary range of $180,000 - $250,000 per annum, depending...
-
Big Data Engineer
2 hours ago
Delhi, Delhi, India Talent Pro Full timeJob Title: Big Data Engineer - Design and Develop Scalable Solutions">About the Role:Talent Pro is seeking a highly skilled Hadoop Developer to join our team. As a Big Data Engineer, you will design and develop large-scale big data processing pipelines using Hadoop ecosystem (HDFS, MapReduce) and Spark.Key Responsibilities:Design, develop, test, deploy, and...
-
Big Data Solutions Architect
18 hours ago
Delhi, Delhi, India Insight Global Full timeWe are seeking a highly skilled Big Data Solutions Architect to join our team at Insight Global.The ideal candidate will have a solid background in data engineering and a strong understanding of big data technologies such as Hadoop and Spark. They will design, build, and optimize complex data pipelines and data sets to support business strategies and drive...
-
Delhi, Delhi, India CAI Info India Pvt Ltd. Full timeAbout the RoleCAI Info India Pvt Ltd. is seeking an experienced AWS Data Engineer to design and develop robust data lakes, leveraging cutting-edge technologies such as S3, Glue, Lake Formation, EMR, Kinesis, RDS, DMS, and Redshift.This full-time remote position requires a strong background in cloud computing, data engineering, and software development, with...
-
Data Engineer
2 weeks ago
Delhi, Delhi, India Max life insurance co ltd Full time**About the Role**Max Life Insurance Co Ltd is seeking an experienced Data Engineer - Cloud Big Data Specialist to join our team. This role requires a skilled professional who can design, implement, and maintain scalable data pipelines and infrastructure on AWS cloud platform.In this position, you will be responsible for architecting large-scale data...
-
Senior Data Engineer
2 weeks ago
Delhi, Delhi, India Interspence Solutions Full timeAbout the Job :Company Overview :We are Interspence Solutions, a leading IT consulting and support services provider in the manufacturing and process industry. We have entered into a long-term contract with a Major US-based Oil & Gas company to provide skilled IT resources and services under their IT leadership team direction.We are transforming our business...
-
Senior Data Engineer
18 hours ago
Delhi, Delhi, India Mindteck Full timeAbout the RoleWe are seeking an exceptional Senior Data Engineer to join our team in India (Work-From-Home). This is a permanent position with a salary range of INR 24-28 LPA.