Lead Data Engineer

2 days ago

Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

About Data Engineering

Data engineers play a pivotal role in driving innovation and delivering cutting-edge solutions to propel business growth.

Job Description:

We are seeking an experienced data engineer to lead the design, implementation, and deployment of enterprise data platforms. As a key member of our team, you will be responsible for architecting scalable, reliable, and secure data infrastructure to meet the needs of large organizations.

Key Responsibilities:

  • Enterprise Data Platforms:
    • Design and implement robust data pipelines that integrate with various data sources.
    • Oversight of data platform deployment, ensuring scalability, reliability, and security.
  • Technology Innovation:
    • Research and integrate cutting-edge tools and frameworks for data ingestion, processing, and governance.
  • Mentorship and Leadership:
    • Mentor junior and mid-level data engineers in technical leadership, code reviews, and career development support.
  • Cross-Functional Collaboration:
    • Collaborate with stakeholders across teams to align data engineering initiatives with business objectives.
  • Data Governance:
    • Establish and enforce data engineering best practices, defining standards for pipeline architecture, data quality, security, and compliance.
  • Technical Communication:
    • Presentation of findings and recommendations to senior leadership, articulating technical concepts and business impacts.

Required Skills:

  • Programming Proficiency:
    • Expert-level proficiency in Python and automation/orchestration tools.
  • Data Storage and Processing:
    • Deep understanding of data storage, processing, and governance, including data warehousing, Lakehouse architectures, and real-time streaming.
  • Big Data Technologies:
    • Experience with big data technologies such as Dataflow, Dataproc, Pub/sub, or similar for large-scale data processing.
  • Data Security and Compliance:
    • Strong security and compliance expertise, implementing and enforcing security controls, encryption, audit logging for data systems, and compliance standards.
  • Communication and Presentation:
    • Excellent communication and presentation skills to articulate technical concepts and business value to diverse audiences.

Necessary Skills:

  • Python and Orchestration Tools:
    • Proficiency in Python and orchestration tools (e.g., Airflow, Cloud Composer).
  • Data Architecture:
    • Experience with data lakes, warehouses, and streaming technologies (e.g., Pub/Sub, Dataflow, Dataproc).
  • GCP Deployment:
    • Production-grade data platform deployment experience on GCP.
  • Data Modeling:
    • Data modeling skills, including dimensional modeling, relational modeling, and scalable data models.
  • SQL Expertise:
    • Expert SQL skills level.
  • BigQuery Experience:
    • Deep understanding of BigQuery, including partitioning, clustering, and performance optimizations.
  • Cloud Functionality:
    • Experience with Cloud Functions, Composer, and Cloud Run, as well as dataflow flex templates.

Action Required:

To apply for this position, please submit your resume and cover letter with relevant work experience highlighted.

  • Strategic Data Engineering Lead

    3 days ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 3,00,00,000

    We are seeking an experienced Senior Data Engineer to play a key role in our projects.Key Responsibilities:Lead team best practices in design, development, and implementation, mentoring team members, and fostering a culture of continuous learning and innovation.Design and implement data pipelines using tools like EMR, AWS Glue, AWS Lambda, AWS Step...

  • Lead Data Engineering Expert

    1 day ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 1,50,40,000 - ₹ 2,01,60,000

    Job Title: Senior Data Engineering LeadWe are seeking a visionary data engineering leader with strong focus on Databricks and cloud-based data engineering to design, develop, and manage scalable data infrastructure and pipelines. This role requires collaboration with business stakeholders, data scientists, and software teams to understand requirements and...

  • Senior Data Engineer Lead

    7 days ago

    Palakkad, Kerala, India beBeeArchitect Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a seasoned Technical Architect to lead the full lifecycle of our data engineering solutions, from strategic design to hands-on implementation.In this key role, you will be a hands-on architect, building secure and scalable data platforms while mentoring our engineering teams.The ideal candidate will have proven expertise in...

  • Data Engineering Lead

    2 days ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Unlock the power of big data and propel your career as a Data Engineer. We seek a skilled professional with expertise in Spark and SQL to join our innovative team.Key Responsibilities:Design and develop scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark)Integrate data from various sources, ensuring data quality and...

  • Senior Data Engineering Project Lead

    19 hours ago

    Palakkad, Kerala, India beBeeData Full time ₹ 30,00,000 - ₹ 50,00,000

    We are seeking a seasoned Technical Project Manager to spearhead our data engineering initiatives.Job Type: Full-timeLocation: Hybrid (Cochin/Trivandrum/Chennai)Key Responsibilities:Lead cross-functional teams to deliver scalable and high-quality data platforms, ensuring timely completion and alignment with business objectives.Develop comprehensive project...

  • Data Engineering Team Lead

    2 days ago

    Palakkad, Kerala, India beBeeDomain Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description:We are seeking a highly skilled and dynamic individual to lead our Data Engineering team. This role is based in Palakkad, India, and requires a hybrid work arrangement with a minimum of three days per week in the office.Key Responsibilities:Develop a deep understanding of global market dynamics and become a principal domain...

  • Data Engineering Project Lead

    15 hours ago

    Palakkad, Kerala, India beBeeProject Full time ₹ 20,00,000 - ₹ 25,00,000

    About this role: We are seeking a skilled Technical Project Manager to lead and deliver technical projects in data engineering and analytics, ensuring alignment with business goals and timely delivery.The Job Responsibilities:Develop, execute, and deliver technical projects on time, within scope, utilizing project management methodologies.Maintain a strong...

  • Chief Data Engineering Lead

    19 hours ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Data Architect Job DescriptionIn this role, you will oversee the design, implementation, and maintenance of data systems to ensure business intelligence and insights are delivered effectively.Key Responsibilities:Select and integrate Big Data tools and frameworks as required to meet business capabilitiesDevelop and maintain data pipelines using ETL...

  • Senior Data Engineering Leader

    2 days ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data ArchitectWe are seeking a skilled Data Engineer to lead our analytics team. This role is ideal for an individual with a strong background in log-level data handling, cross-platform data engineering, and a solid command of modern business intelligence tools.The ideal candidate will have 4-6 years of experience in data analytics or data...

  • Data Engineering Strategist

    13 hours ago

    Palakkad, Kerala, India beBeeEngineering Full time ₹ 20,00,000 - ₹ 35,00,000

    We are seeking a seasoned Data Engineering Lead to spearhead the development and implementation of our data engineering strategy.This role requires a strong background in team handling, with at least 14 years of experience in managing teams and leading projects from concept to delivery.The ideal candidate will have extensive knowledge in ETL, SQL, Oracle,...