Lead Data Engineer
5 days ago
Lead Data Engineer Location & Work ModelLocation: Remote Work Model: Full-time Timings :8AM IST to 5 PM ISTJob SummaryWe are seeking a highly experienced Senior Cloud Data Engineer with 10+ years of hands-on experience in designing, building, and managing large-scale data platforms and pipelines in cloud environments. The ideal candidate will have strong expertise in AWS, Snowflake, PySpark, and ETL frameworks, along with proven leadership experience in delivering scalable, secure, and high-performance data solutions. This role requires close collaboration with business stakeholders, cross-functional teams, and mentoring junior engineers while driving data-driven decision-making.Key ResponsibilitiesDesign, develop, and maintain scalable cloud-based data pipelines using AWS services such as S3, EMR, Glue, Lambda, Kinesis, and Snowflake.Lead end-to-end data ingestion, transformation, and orchestration workflows using PySpark, Apache Airflow, Kafka, and ETL tools.Architect and optimize data warehousing solutions on Snowflake, Hive, Redshift, and HDFS for large-volume and high-performance analytics.Manage and execute on-prem to cloud data migrations, ensuring minimal downtime, cost optimization, and improved scalability.Implement and enforce data governance, security, audit logging, and compliance standards across data platforms.Develop and optimize PySpark jobs for data ingestion into Snowflake, Hive, and HBase tables.Monitor and tune system performance, including query optimization, error handling, and recovery mechanisms.Collaborate with BI and analytics teams to support reporting solutions using Power BI and Tableau.Lead and mentor a team of data engineers, conducting code reviews and promoting best practices.Work in an Agile/Scrum environment, participating in sprint planning, POCs, and continuous improvement initiatives.Coordinate with cross-functional teams and stakeholders to deliver business-aligned data solutions.Required Skills & Experience10–12+ years of experience in Data Engineering with strong exposure to cloud-based data platforms.Strong hands-on experience with AWS (EMR, Glue, Lambda, S3, Kinesis, ECS).Expertise in Snowflake (development and administration).Advanced proficiency in Python and PySpark, including data structures and distributed processing.Solid experience with ETL tools such as Informatica PowerCenter, Informatica BDM/BDE, Alteryx, and DBT.Strong knowledge of Big Data technologies: Hadoop, Hive, HDFS, HBase, Spark.Experience with real-time data processing using Kafka, ActiveMQ, and Spark Streaming.Proficiency in SQL and databases: Oracle, Hive, Snowflake, Redshift, Netezza, Sybase.Hands-on experience with job scheduling tools: Airflow, Control-M, Autosys, Tidal, Cron.Experience in performance optimization, data validation, audit logging, and error handling.Exposure to Banking, Investment, or Financial Services domains is a strong plus.Preferred QualificationsAWS Certified Solutions Architect – AssociateAWS Certified Developer – AssociateExperience working with BI tools such as Power BI and TableauExposure to Databricks and modern analytics platformsStrong stakeholder management and leadership skillsIdeal Candidate ProfileThe ideal candidate is a hands-on technical leader who can balance architecture, development, and team leadership. You should be comfortable working in fast-paced environments, handling complex data challenges, and delivering reliable, business-ready data solutions at scale.
-
Leading Data Engineering Expert
1 week ago
Jamnagar, India beBeeDataEngineer Full timeJob Title: Data EngineerWe are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with expertise in designing and implementing scalable data architectures.Key Responsibilities:Design and implement data pipelines using Spark or Pyspark, SQL, and Python.Develop and maintain large-scale...
-
Lead Data Engineer
5 days ago
Jamnagar, India KPI Partners Full timeMandatory skill : Snowflake, DBT, Airflow, Terraform, AWS/ AzureNotice period : immediate to 30 daysLocation : Bangalore, Hyderabad, Pune Experience : 7- 12 YearsWe are seeking a highly skilled Principal Data Engineer with 7 to 12 years of experience to join our dynamic team at KPI Partners. The successful candidate will be responsible for designing,...
-
Lead Data Engineer
5 days ago
Jamnagar, India KPI Partners Full timeMandatory skill : Snowflake, DBT, Airflow, Terraform, AWS/ AzureNotice period : immediate to 30 daysLocation : Bangalore, Hyderabad, Pune Experience : 7- 12 YearsWe are seeking a highly skilled Principal Data Engineer with 7 to 12 years of experience to join our dynamic team at KPI Partners. The successful candidate will be responsible for designing,...
-
Lead Data Designer
2 weeks ago
Jamnagar, India beBeeData Full timeJob Opportunity: Lead Data DesignerWe are seeking a seasoned professional with expertise in data engineering and large-scale data platform design.The ideal candidate must have hands-on experience in Snowflake, ETL processes, and data migration solutioning.Required Skills:Minimum 10+ years of experience in data engineering, data warehousing, and data lake...
-
Lead Data Scientist
2 weeks ago
Jamnagar, India beBeeDataScience Full timeLead Data Scientist - News AnalyticsThe Lead Data Scientist is a key role in news publishing, responsible for driving data-driven strategies across editorial planning, newsroom automation, and audience analytics.Oversee delivery of AI/ML projects including Gen AI, NLP, personalization, content tagging, and recommendation systems.Manage cross-functional teams...
-
Data Engineering Expert
1 week ago
Jamnagar, India beBeeAzure Full timeSenior Azure Data Engineer JobWe are seeking a highly skilled Senior Azure Data Engineer to join our team.As a senior azure data engineer, you will be responsible for building data pipelines for enterprise search applications using ADF and Databricks. You will work on designing and implementing data integration feeds, reviewing business requirements, and...
-
Lead Electrical Engineer
4 weeks ago
Jamnagar, India Reliance Industries Limited Full timeTitle: Lead ElectricalLocation: Jamnagar, GujaratYears of Experience: 15-20 yearsTo lead and oversee all electrical works for the AI/Data Center project, ensuring the development of high-performance, resilient, and energy-efficient electrical infrastructure to support advanced computing environments. The Lead Electrical Engineer is responsible for the safe,...
-
Lead Electrical Engineer
4 weeks ago
Jamnagar, India Reliance Industries Limited Full timeTitle: Lead ElectricalLocation: Jamnagar, GujaratYears of Experience: 15-20 yearsTo lead and oversee all electrical works for the AI/Data Center project, ensuring the development of high-performance, resilient, and energy-efficient electrical infrastructure to support advanced computing environments. The Lead Electrical Engineer is responsible for the safe,...
-
Lead Electrical Engineer
4 weeks ago
Jamnagar, India Reliance Industries Limited Full timeTitle: Lead Electrical Location: Jamnagar, Gujarat Years of Experience: 15-20 years To lead and oversee all electrical works for the AI/Data Center project, ensuring the development of high-performance, resilient, and energy-efficient electrical infrastructure to support advanced computing environments. The Lead Electrical Engineer is responsible for the...
-
Lead Electrical Engineer
4 weeks ago
Jamnagar, India Reliance Industries Limited Full timeTitle: Lead ElectricalLocation: Jamnagar, GujaratYears of Experience: 15-20 yearsTo lead and oversee all electrical works for the AI/Data Center project, ensuring the development of high-performance, resilient, and energy-efficient electrical infrastructure to support advanced computing environments. The Lead Electrical Engineer is responsible for the safe,...
