Lead Data Engineer – Python

2 days ago


Jamnagar, India People Prime Worldwide Full time

Job Title: Lead Data Engineer – Python & GCPExperience: 10+ YearsLocation: HyderabadInterview Mode: Face-to-FaceAbout the RoleWe are seeking an experienced Lead Data Engineer with deep expertise in Python and Google Cloud Platform (GCP). This role involves designing and building scalable data solutions, developing ETL/ELT pipelines, and leading the architecture and implementation of complex data workflows. You’ll collaborate with business and technical teams to deliver high-quality data solutions that support analytics, reporting, and business intelligence needs.Experience Level: 10+ years in IT, with hands-on experience in data engineering and cloud-based systems.Key ResponsibilitiesDesign, develop, and maintain robust ETL/ELT data pipelines using Python.Architect enterprise-grade data solutions using GCP services and other technologies.Work extensively with GCP services such as Dataflow, BigQuery, Cloud Functions, Composer (Airflow), GCS, IAM, and Cloud Run.Build APIs using Python (FastAPI Framework).Handle real-time and batch data processing using Apache Kafka and Apache Spark.Utilize storage systems like MongoDB, Redis, and Bigtable.Manage deployments on GKE and Cloud Run with CI/CD integration (GitHub).Ensure data quality, validation, and transformation for accurate, consistent data delivery.Collaborate closely with data scientists, analysts, and cross-functional teams.Write advanced SQL queries for data extraction and validation.Document designs, data flow diagrams, and standard operating procedures.Required SkillsStrong programming experience in Python.Solid understanding of GCP services (Dataflow, BigQuery, Cloud Functions, Composer, etc.).Hands-on experience with Apache Spark, Airflow, Kafka, and Redis.Proficiency with SQL and database systems like SQL Server, Oracle, or PostgreSQL.Knowledge of CI/CD practices and version control (GitHub).Expertise in designing and managing large-scale data architectures.Experience with cloud data migrations from on-premise sources.Good to HaveExperience with Snowflake and Databricks.Familiarity with Azure Data Factory (ADF) and other Azure tools.


  • Lead Data Engineer

    3 days ago


    Jamnagar, India Advantmed Full time

    Lead Data Engineer – Azure Cloud We are looking for an experienced Lead Data Engineer to build and manage a robust data platform on Azure Cloud. The ideal candidate will design, develop, and maintain scalable data pipelines, ensure data quality, and leverage cloud technologies for efficient data processing. Key Responsibilities - Develop and maintain data...


  • Jamnagar, India Crest Data Full time

    We are looking for a strong ReactJS Lead Engineers to join our engineering team in Ahmedabad. The primary responsibility will be to lead the design and develop Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data segments.Location: PUNE / AHMEDABAD ( WFO Only)Key Responsibilities -- Responsible for providing expertise in...


  • Jamnagar, India Cephei Infotech Full time

    Data Engineer (SQL & Python Expertise Required) 📅 Experience: 0.5-2 Years 🏢 Company: Cephei Infotech 💼 Job Type: Full-Time About Us Cephei Infotech is a leading Data & Analytics-focused IT company, delivering scalable data engineering, business intelligence, and AI-driven solutions. We help businesses unlock the power of data through robust...


  • Jamnagar, India Egen Full time

    Senior Data Engineer – GCP Job Overview: We are looking for a skilled and motivated Senior Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data...

  • AI Data Engineer

    1 week ago


    Jamnagar, India Turing Full time

    Role Overview:We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models think, reason, and code.In this role, you’ll generate and evaluate high-quality data used to fine-tune and benchmark LLMs. You’ll design...


  • Jamnagar, India Crest Data Full time

    Hiring Sr. Site Reliability Engineer (Network) L2 | CCNA Certified Experience - 5+ Years Location - Ahmedabad Certifications Required - CCNA / CCNP Certified Network Engineering: - Complex Operations: Can manage and optimize complex network environments, including large-scale deployments and high-availability systems. - Advanced Troubleshooting: Proficient...

  • Data Engineer

    4 weeks ago


    Jamnagar, India Whatjobs IN C2 Full time

    Organization Description: Jaipur Rugs is a social enterprise that connects rural craftsmanship with global markets through its luxurious handmade carpets. It is a family-run business that offers an exclusive range of hand-knotted and hand-woven rugs made using 2500 years old traditional art forms. The founder, Mr. Nand Kishore Chaudhary created a unique...

  • Azure data engineer

    3 days ago


    Jamnagar, India SystemBender Full time

    *Role: Azure Data Engineer* • Advance SQL Azure Data Factory (ADF) Databricks with Py Spark Azure Synapse (added advantage) • Fully conversant with big-data processing approaches and schema-on-read methodologies is a must and knowledge of Azure Data Factory / Azure Databricks (Py Spark) / Azure Data Lake Storage (ADLS Gen 2) • Good to have an excellent...

  • Senior Data Engineer

    3 weeks ago


    Jamnagar, India iPath Infotech Full time

    Company Description At iPath Infotech, we assist businesses around the globe with top-notch IT solutions. We specialize in mobile app development, web development, BPO, software development, and managed services. Our team is dedicated to delivering exceptional results tailored to meet client needs. With a focus on affordable, high-quality solutions, we...

  • Data Engineer

    3 weeks ago


    Jamnagar, India Aptologics Full time

    Company Description Aptologics is a global Data & AI company that simplifies complex data, builds scalable analytics platforms, and operationalizes AI to drive measurable outcomes. We deliver tailored solutions that help enterprises move faster, decide smarter, and grow with confidence. Role Description We are looking for an experienced Data Engineer to join...