Lead Data Engineer – Python

4 weeks ago

Gandhinagar, India Whatjobs IN C2 Full time

Job Title: Lead Data Engineer – Python & GCP Location : Hyderabad Exp : 10+ Years Overview: We are seeking an experienced Lead Data Engineer with strong expertise in Python and Google Cloud Platform (GCP) . You will design, develop, and manage scalable ETL/ELT data pipelines , work closely with clients to understand requirements, and build data solutions using modern cloud and open-source technologies. Key Responsibilities: Design, build, and maintain scalable data pipelines using Python and GCP services . Work with GCP tools such as Dataflow, BigQuery, Cloud Composer, Cloud Functions, Cloud Run, GCS, and IAM . Implement data ingestion, transformation, and quality checks to ensure accurate, reliable data. Architect enterprise data solutions using tools like Kafka, Spark, Airflow, DBT, GKE, APIGEE, and DLP . Use FastAPI for API development and GitHub for version control. Deploy solutions using CI/CD pipelines and manage data workflows in Airflow/Cloud Composer . Write and optimize complex SQL queries (SQL Server, Oracle, PostgreSQL, etc.). Collaborate with data scientists and analysts to deliver efficient data solutions. Document data flows, pipelines, and operational procedures. Required Skills & Experience: 10+ years of experience in data engineering or backend development. Strong programming skills in Python . Hands-on experience with GCP (Dataflow, BigQuery, Cloud Functions, Cloud Composer). Experience with Kafka, Spark, Redis, Airflow, GKE, Cloud Run, and FastAPI . Excellent knowledge of SQL and relational databases. Experience with CI/CD and GitHub . Experience migrating data from on-premise systems to the cloud. Nice to Have: Experience with Snowflake or Databricks . Knowledge of Azure Data Factory or other Azure data tools. Exposure to machine learning or LLMs in data solutions.

  • Lead Python Developer

    2 days ago

    Gandhinagar, India Unified Infotech Full time

    Lead Python Developer Experience: 10+ Years Location: Kolkata / Remote (Flexible) Job Type: Full-time Industry: IT Services / Software Development The Opportunity We’re looking for a seasoned Senior / Lead Python Developer who combines deep technical expertise with strong leadership and client-facing capabilities. You will drive backend architecture, lead...

  • Data Engineering Lead

    2 days ago

    Gandhinagar, India Kanerika Inc Full time

    Job Location: Ahmedabad What You Will Do: - Develop and maintain data pipelines using Azure Data Factory (ADF) /Databricks for data integration and ETL processes. - Design, implement, and optimize Power BI /Fabric reports and dashboards to deliver actionable business insights. - Collaborate with data analysts, business users, and other teams to understand...

  • Leading Machine Learning Engineer

    4 days ago

    Gandhinagar, India beBeeMachineLearning Full time

    Lead Data ScientistWe are seeking a highly experienced Lead Data Scientist to spearhead our machine learning initiatives in Bangalore.About the Role:Pioneer advanced data-driven solutions and cultivate a culture of innovation within the teamLeverage expertise in machine learning algorithms and collaborate with cross-functional teams to drive business...

  • Data Engineer

    6 days ago

    Gandhinagar, India BLJ Tech Geeks Full time

    Job Title: Data Engineer Company - Big4 (PERMANENT) Location: Bangalore (Hybrid) Job Type: Full-time Experience Level: 5Yrs above Notice Period - Serving only till 31st Dec not more than this About the Role: We are looking for a skilled and detail-oriented Data Engineer to join our growing data team. You will be responsible for building and maintaining...

  • AWS Snowflake Cloud Data Engineer

    4 days ago

    Gandhinagar, India beBeeCloudDataEngineer Full time

    Job Title: Cloud Data Engineering SpecialistThis role is ideal for a seasoned data engineer with expertise in designing, developing, and implementing scalable data solutions using AWS and Snowflake.The successful candidate will lead the design of complex data pipelines, collaborate with cross-functional teams to translate business requirements into technical...

  • Backend Python Engineer

    2 weeks ago

    Gandhinagar, Gujarat, India Helius Work Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Role OverviewHelius Work is looking for anexpert-level Backend Python Engineerto join our on-site engineering team inInfoCity, Gandhinagar.This role demands strong hands-on experience in designing modular SDK architectures, building scalable APIs, and integrating open-source and M&A platforms.You'll be a key contributor in architecting backend systems that...

  • Data Engineer Lead

    2 days ago

    Gandhinagar, India beBeeData Full time

    Senior Data ArchitectWe are seeking an experienced professional to join our team as a Senior Data Architect. This role centers on architecting robust data pipelines across on-prem and cloud ecosystems, automating ingestion from varied sources including APIs.Design, Develop, and Optimize ETL/ELT Data PipelinesAutomate Data Ingestion WorkflowsIntegrate...

  • Leading Data Expert

    2 days ago

    Gandhinagar, India beBeeData Full time

    Job OverviewWe are seeking a highly skilled professional to join our advanced analytics team as a Data Analyst. The ideal candidate will design, build, and deploy data-driven solutions leveraging machine learning, deep learning, and cloud-based AI platforms.This role requires hands-on coding capability, strong analytical thinking, and experience...

  • Lead Data Architect

    2 days ago

    Gandhinagar, India beBeeDataEngineer Full time

    Unlock Career Advancement in Data EngineeringWe are seeking a Senior Data Engineer to join our team and play a crucial role in shaping the future of healthcare analytics.This is an exciting opportunity for candidates based in Europe or India with periodic team gatherings in Mountain View, California.Pipeline Development: Design, build, and maintain scalable...

  • Data engineer jis117883

    2 weeks ago

    Gandhinagar, India Krayr Solutions Full time

    Required QualificationsBachelor’s Degree in Computer Science, IT, or related fieldMinimum 4–5 years of experience in Data EngineeringMandatory:DBT (Data Build Tool)Looker (Look ML development & dashboards)Python scriptingFivetranExpertise in databases such as Postgres, Mongo DB, My SQL, Big QueryStrong knowledge of SQL , data mapping, data...