Highly Experienced Data Engineering Lead

7 days ago

Cochin, Kerala, India beBeeData Full time ₹ 2,30,40,000 - ₹ 2,59,20,000

Job Title: Scalable Data Solutions Architect

  • This is a highly experienced role requiring 5+ years of data engineering experience, with a proven track record of designing, building and optimizing scalable data pipelines and architectures on Google Cloud Platform (GCP).

Mandatory Skills:

  • Expertise in GCS, BigQuery and Airflow/Composer.
  • Proficient in Python programming language.

Key Responsibilities:

  • Design and implement highly scalable, reliable and secure data pipelines on GCP using GCS, BigQuery and Airflow.
  • Develop robust ETL/ELT processes using Python and integrate with data orchestration tools.
  • Collaborate with data analysts, data scientists and business stakeholders to understand data requirements and deliver high-quality solutions.
  • Optimize BigQuery performance through efficient schema design, partitioning, clustering and query optimization.
  • Manage and maintain data lake and data warehouse environments ensuring data integrity and availability.
  • Automate and monitor data pipelines to ensure consistent and reliable data delivery.
  • Contribute to architecture decisions and ensure adherence to data governance and security standards.

Must-Have Skills:

  • Google Cloud Platform (GCP): In-depth experience with core services like GCS, BigQuery, IAM and Cloud Functions.
  • BigQuery (BQ): Expertise in data modeling, performance tuning and large-scale analytics.
  • Apache Airflow: Experience in authoring and managing DAGs for complex workflows.
  • Python: Proficient in scripting and automation, including working with APIs, data processing libraries and custom operators in Airflow.

Preferred Qualifications:

  • Experience with CI/CD pipelines for data workflows.
  • Exposure to Dataflow, Pub/Sub or other GCP data services.
  • Familiarity with Terraform or Infrastructure as Code (IaC) on GCP.
  • Strong problem-solving and communication skills.
  • GCP certifications are a plus.

At our company, we strive to provide the best environment for our employees to grow professionally. If you're looking for a challenging and rewarding opportunity, apply today

  • Data Engineering Team Lead

    1 week ago

    Cochin, Kerala, India beBeeEngineering Full time ₹ 18,00,000 - ₹ 21,00,000

    Scrum Master - Data EngineeringA highly skilled Data Engineer is required to drive project success by implementing Scrum frameworks, developing data processing solutions, and enhancing data pipelines.This role involves:Designing and implementing efficient database structures using SQL expertise.Leveraging Python programming language to enhance data quality...

  • Highly Skilled Data Engineer

    2 weeks ago

    Cochin, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Overview:We are seeking a highly skilled Data Engineering professional to join our team as a Senior Data Engineer. This key role involves designing, developing, and maintaining large-scale data processing systems. The ideal candidate will have extensive experience with distributed data processing systems, including Python, Pyspark, Azure Data Bricks,...

  • Lead Data Engineers

    4 weeks ago

    Cochin, Kerala, India Velodata Global Pvt Ltd Full time

    1) Lead Data Engineer – MS Fabric Experience: 8+ years Location: Trivandrum / Kochi Budget: Up to 28 LPA Notice Period: Immediate – 30 Days Mandatory Skills: MS Fabric (6 months–2 years hands-on), Azure Stack (ADF, Data Lake, Lakehouse, Power BI) 2) Lead Data Engineer – SSIS & SQL Experience: 6+ years Location: Kochi / Trivandrum Budget:...

  • Lead Data Engineers

    2 weeks ago

    Cochin, Kerala, India Velodata Global Pvt Ltd Full time ₹ 1,80,000 - ₹ 2,80,000 per year

    1) Lead Data Engineer – MS Fabric Experience: 8+ years Location: Trivandrum / Kochi Budget: Up to 28 LPA Notice Period: Immediate – 30 Days Mandatory Skills: MS Fabric (6 months–2 years hands-on), Azure Stack (ADF, Data Lake, Lakehouse, Power BI)2) Lead Data Engineer – SSIS & SQL Experience: 6+ years Location: Kochi / Trivandrum Budget: 18–23 LPA...

  • Highly Experienced Reliability Engineering Leader Wanted

    1 week ago

    Cochin, Kerala, India beBeeReliability Full time US$ 1,50,000 - US$ 2,50,000

    Reliability Engineering Leadership Opportunity">We are seeking a highly skilled and experienced Reliability Engineering Manager to lead our team in ensuring the optimal performance and resiliency of our infrastructure. This is a unique opportunity to join a dynamic organization and contribute to the development of a high-performing SRE team.About the...

  • Lead Data Engineer

    2 weeks ago

    Cochin, Kerala, India Kairos Technologies Full time US$ 1,25,000 - US$ 1,75,000 per year

    Role Lead Data EngineerWork Location Kochi/TVM/RemoteNotice period: 0-2 weeksSkills - Primary Big QuerySnowflake, ADFQualification Bachelors DegreeTotal Experience 8 Relevant Experience 5Job PurposeWe are looking for an experienced Lead Data Engineer with strong expertise in Google BigQuery and working knowledge of Looker to support a data modernization...

  • Highly Skilled Data Engineer Wanted

    3 days ago

    Cochin, Kerala, India beBeeDataEngineer Full time ₹ 23,00,000

    Senior Data Engineer Job SummaryWe are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion framework while ensuring high data quality and validation.The ideal candidate will have at least 7 years of relevant experience in data engineering with a strong emphasis on analytical platform development. They should be...

  • Lead Data Engineer

    2 weeks ago

    Cochin, Kerala, India Velodata Global Pvt Ltd Full time

    Job Title : Lead Data Engineer - AWSLocation : Kochi / : 6- 8 YearsNotice Period : Immediate to 15 DaysJob Overview :We are looking for a highly skilled Lead Data Engineer (AWS) to architect, build, and manage scalable data pipelines with a strong emphasis on data quality, governance, and secure API integrations. The role requires deep expertise in AWS...

  • Highly Skilled Azure Data Engineering Professional

    2 weeks ago

    Cochin, Kerala, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Azure Data Engineer Job DescriptionDear Candidate,Greetings from a leading organization!We are seeking an experienced Azure Data Engineer to join our team. As a key member, you will be responsible for designing, developing, and maintaining large-scale data processing systems on Azure.Key Responsibilities:Design and implement data pipelines using Azure Data...

  • Lead Data Engineer

    1 week ago

    Cochin, Kerala, India Velodata Global Pvt Ltd Full time

    Job Overview :We are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion framework while ensuring high data quality and validation. The successful candidate will also be responsible for designing and implementing robust APIs for seamless data integration. This role is ideal for someone with deep expertise in...