Big Data Engineer Lead
4 days ago
We are seeking a skilled AWS Big Data Engineer to join our dynamic team at Axis Max Life Insurance Limited. In this role, you will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure on the AWS cloud platform.
The ideal candidate will have extensive experience with AWS services, particularly in the realm of big data processing and analytics. You will work closely with cross-functional teams to support data-driven decision-making and focus on delivering business objectives while improving efficiency and ensuring high service quality.
Key Responsibilities- Architect, design, develop, and maintain large-scale data pipelines that can handle large datasets from multiple sources.
- Expertise in real-time data replication and batch processing of data using distributed computing platforms like Spark, Kafka, etc.
- Optimize performance of data processing jobs and ensure system scalability and reliability.
- Collaborate with DevOps teams to manage infrastructure, including cloud environments like AWS.
- Collaborate with data scientists, analysts, and business stakeholders to develop tools and platforms that enable advanced analytics and reporting.
- Lead and mentor junior data engineers, providing guidance on best practices, code reviews, and technical solutions.
- Evaluate and implement new frameworks, tools for data engineering.
- Strong analytical and problem-solving skills with attention to detail.
- Maintain a healthy working relationship with business partners/users and other departments.
- Hands-on experience with AWS services such as S3, DMS, Lambda, EMR, Glue, Redshift, RDS (Postgres) Athena, Kinesis, etc.
- Expertise in data modelling and knowledge of modern file and table formats.
- Expertise in data replication tool like Qlik Replicate, AWS DMS.
- Proficiency in programming languages such as Python, PySpark, SQL/PLSQL for implementing data pipelines and ETL processes.
- Experience data architecting or deploying Cloud/Virtualization solutions (like Data Lake, EDW, Mart) in enterprise.
- Knowledge of modern data stack and keeping the technology stack refreshed.
- Knowledge of DevOps to perform CI/CD for data pipelines.
- Knowledge of Data Observability, automated data lineage and metadata management would be an added advantage.
- Cloud/hybrid cloud solution for data strategy for Data lake, BI and Analytics.
- Set-up logging, monitoring, alerting, dashboards for cloud solution and data solution.
- Experience with data warehousing concepts.
Axis Max Life Insurance Limited is a leading insurance company that provides innovative solutions to customers. We are committed to delivering exceptional service and products to our clients.
LocationPlease note that the location for this position is not specified.
-
Senior Big Data Engineer Lead
3 weeks ago
Gurgaon, Haryana, India HUNTINGCUBE RECRUITMENT SOLUTIONS PRIVATE LIMITED Full timeJob Description: Senior Big Data Engineer LeadHUNTINGCUBE RECRUITMENT SOLUTIONS PRIVATE LIMITED is a cutting-edge technology company that values innovation, collaboration, and excellence. Our team is passionate about leveraging data science to drive business growth and transform industries.About the Role:We are looking for a seasoned Senior Big Data Engineer...
-
Big Data Engineering Lead
3 weeks ago
Gurgaon, Haryana, India Gemini Solutions Private Limited Full timeWe are looking for a talented Data Engineer with expertise in big data/Databricks environment and data engineering to join our team at Gemini Solutions Private Limited.In this role, you will design and implement efficient data ingestion pipelines from Oracle Fusion Cloud to Databricks, leveraging your knowledge of Oracle Fusion ecosystem and data-extracting...
-
Big Data Engineer
3 weeks ago
Gurgaon, Haryana, India IGT Solutions Full timeData Engineer Position:We're seeking a highly skilled Big Data Engineer to join our data engineering team. The ideal candidate will have over 8 years of hands-on experience designing, architecting, and implementing robust ETL pipelines using technologies such as Python, PySpark, PLSQL, Snowflake, and AWS.Main Responsibilities:Design and develop...
-
AWS Big Data Engineer
15 hours ago
Gurgaon, Haryana, India Axis Max Life Insurance Limited Full timeJob DescriptionWe are seeking a skilled AWS Big Data Engineer to lead the design, implementation, and maintenance of scalable data pipelines and infrastructure on the AWS cloud platform. This role involves working closely with cross-functional teams to support data-driven decision-making and focus on delivering business objectives while improving efficiency...
-
Data Engineer for Big Data Analytics
4 weeks ago
Gurgaon, Haryana, India Myananta Technologies Full timeMyananta Technologies is a leading technology firm based in Gurugram, India.We are seeking an experienced Data Engineer to join our team and help us drive innovation in big data analytics.About the Role:We are looking for a highly skilled individual with expertise in Hadoop, Spark, Hive, and Airflow. The successful candidate will have extensive experience in...
-
Data Architect
4 weeks ago
Gurgaon, Haryana, India Impetus Full timeJob SummaryWe are seeking a skilled Data Architect - Big Data Engineer to join our team at Impetus. As a key member of our data engineering team, you will design, develop, and implement efficient ETL pipelines using big data technologies.About the RoleDevelop scalable and secure data pipelines using Hadoop, Hive, and PySpark.Collaborate with cross-functional...
-
Senior Big Data Specialist
3 weeks ago
Gurgaon, Haryana, India DEUTSCHE TELEKOM DIGITAL LABS PRIVATE LIMITED Full timeAbout our Ideal Candidate:">We are looking for a motivated and experienced data engineer who can lead our team in delivering high-quality big data solutions. The ideal candidate should have a strong background in big data engineering, excellent problem-solving skills, and the ability to work effectively in a collaborative environment.
-
Big Data Architect
3 weeks ago
Gurgaon, Haryana, India DEUTSCHE TELEKOM DIGITAL LABS PRIVATE LIMITED Full timeJob Title: Big Data ArchitectWe are seeking an experienced Big Data Architect to join our team at Deutsche Telekom Digital Labs Private Limited. As a Senior Hadoop Engineer, you will design and implement scalable big data solutions using Hadoop-based technologies along with AWS. Your primary responsibilities include designing and implementing various big...
-
Senior Big Data Engineer
3 weeks ago
Gurgaon, Haryana, India Max life insurance co ltd Full timeJob Description: Max Life Insurance Co Ltd is seeking an experienced Senior Big Data Engineer to lead the development and maintenance of our big data infrastructure on the AWS cloud platform. In this role, you will be responsible for architecting, designing, and implementing scalable data pipelines and infrastructure that support data-driven decision-making...
-
Cloud Data Engineer for Azure and Big Data
1 month ago
Gurgaon, Haryana, India BayOne Solutions Full timeAre you a seasoned data engineer looking for a new challenge? BayOne Solutions is seeking an experienced Cloud Data Engineer to join our team. With a strong background in modern data engineering, data warehousing, and data lakes technologies on cloud platforms like Azure, AWS, and GCP, this role is perfect for those who want to work with cutting-edge...
-
Senior Big Data Engineer
3 weeks ago
Gurgaon, Haryana, India Rapture Staffing Full timeData Engineering PositionAbout the Role:We are seeking an experienced data engineer to develop and implement efficient data architectures and pipelines. The ideal candidate will have a strong background in ETL tools, big data technologies, and cloud platforms.Responsibilities:Design and implement data architectures and pipelines that meet business...
-
Big Data Developer
2 weeks ago
Gurgaon, Haryana, India Material Full timeJob Description: We are looking for a highly skilled Big Data Developer to join our team at Material. The ideal candidate will have extensive experience with big data technologies such as Hadoop, Spark, and Hive, as well as programming languages like Java, Python, and Scala.As a Big Data Developer, you will be responsible for designing and developing big...
-
Big Data Engineer Position
3 weeks ago
Gurgaon, Haryana, India Falcon Full timeAbout the RoleFalcon is looking for an experienced Big Data Engineer to join our team in Gurgaon, India. As a key member of our engineering team, you will be responsible for designing and developing scalable data pipelines using open source tools. You will collaborate with product and engineering teams to design a platform for data modelling and machine...
-
Big Data Architect
3 weeks ago
Gurgaon, Haryana, India DEUTSCHE TELEKOM DIGITAL LABS PRIVATE LIMITED Full timeJob SummaryWe are seeking a highly skilled Data Engineer to join our team at Deutsche Telekom Digital Labs Private Limited. The successful candidate will be responsible for designing and implementing big data solutions using Hadoop-based technologies, including AWS.About the RoleDesign and implement various big data platform components, including batch...
-
Big Data Specialist
3 weeks ago
Gurgaon, Haryana, India Aptita Consulting Partners Full timeAbout Aptita Consulting PartnersWe are a leading consulting firm that specializes in delivering high-quality data engineering and analytics solutions to our clients. Our team of experts has a deep understanding of the latest technologies and trends in the field.Job DescriptionWe are seeking a Senior Data Engineer to join our team. As a Senior Data Engineer,...
-
Big Data Solutions Architect
3 weeks ago
Gurgaon, Haryana, India SMARTWORK IT SERVICES Full timeJob Overview:At SMARTWORK IT SERVICES, we are looking for a highly skilled Big Data Solutions Architect to lead our team in designing and implementing cutting-edge data processing solutions using Google Cloud Platform (GCP) technologies. As a key member of our team, you will be responsible for selecting and integrating big data tools and frameworks,...
-
Data Engineering Lead
1 month ago
Gurgaon, Haryana, India NAB Full timeNAB is seeking an experienced Data Engineer to join our team.Job Title: Data Engineering LeadSalary:$120,000 - $160,000 per annumAbout the Role:We are looking for a skilled Data Engineer to lead our data engineering efforts. The successful candidate will have a strong background in SQL, Python, and experience with source code control (GitHub) and Jenkins....
-
Senior Big Data Engineer Position at Impetus
5 days ago
Gurgaon, Haryana, India Impetus Full timeJob Title: Senior Big Data EngineerOverview:Impetus is a leading technology firm seeking a skilled Senior Big Data Engineer to join our team. The ideal candidate will have hands-on experience with Big Data technologies, including pySpark, Hadoop, and Hive.Salary Estimate:We are offering a competitive salary of $140,000 - $160,000 per annum, commensurate with...
-
Big Data Architectural Lead
4 days ago
Gurgaon, Haryana, India Snap Find Full timeAt Snap Find, we are seeking an exceptional Data Engineer to join our team. As a key member of our data engineering group, you will play a critical role in designing, implementing, and optimizing scalable and efficient data architectures and pipelines.We offer a competitive compensation package with an estimated salary range of $120,000 - $180,000 per year,...
-
Senior Cloud Data Engineer for Big Data Solutions
2 months ago
Gurgaon, Haryana, India BayOne Solutions Full timeJob Title: Senior Cloud Data Engineer for Big Data SolutionsAbout BayOne SolutionsBayOne Solutions is a 12-year-old software consulting organization based in Pleasanton, California, USA. We specialize in providing talent and solutions, with a passion for diversity in tech.Job OverviewWe are seeking an experienced Senior Cloud Data Engineer to join our team....