Lead Data Engineer – Python

2 days ago

Vellore, India People Prime Worldwide Full time

Job Title: Lead Data Engineer – Python & GCPExperience: 10+ YearsLocation: HyderabadInterview Mode: Face-to-FaceAbout the RoleWe are seeking an experienced Lead Data Engineer with deep expertise in Python and Google Cloud Platform (GCP). This role involves designing and building scalable data solutions, developing ETL/ELT pipelines, and leading the architecture and implementation of complex data workflows. You’ll collaborate with business and technical teams to deliver high-quality data solutions that support analytics, reporting, and business intelligence needs.Experience Level: 10+ years in IT, with hands-on experience in data engineering and cloud-based systems.Key ResponsibilitiesDesign, develop, and maintain robust ETL/ELT data pipelines using Python.Architect enterprise-grade data solutions using GCP services and other technologies.Work extensively with GCP services such as Dataflow, BigQuery, Cloud Functions, Composer (Airflow), GCS, IAM, and Cloud Run.Build APIs using Python (FastAPI Framework).Handle real-time and batch data processing using Apache Kafka and Apache Spark.Utilize storage systems like MongoDB, Redis, and Bigtable.Manage deployments on GKE and Cloud Run with CI/CD integration (GitHub).Ensure data quality, validation, and transformation for accurate, consistent data delivery.Collaborate closely with data scientists, analysts, and cross-functional teams.Write advanced SQL queries for data extraction and validation.Document designs, data flow diagrams, and standard operating procedures.Required SkillsStrong programming experience in Python.Solid understanding of GCP services (Dataflow, BigQuery, Cloud Functions, Composer, etc.).Hands-on experience with Apache Spark, Airflow, Kafka, and Redis.Proficiency with SQL and database systems like SQL Server, Oracle, or PostgreSQL.Knowledge of CI/CD practices and version control (GitHub).Expertise in designing and managing large-scale data architectures.Experience with cloud data migrations from on-premise sources.Good to HaveExperience with Snowflake and Databricks.Familiarity with Azure Data Factory (ADF) and other Azure tools.

  • Senior Data Engineer

    2 days ago

    Vellore, India MyRemoteTeam Inc Full time

    About UsMyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better.Position: Senior Data Engineer (Python Coder)Location: India ( Remote )Work Commitment: 40 Hrs...

  • Data Engineer(Python,Hadoop,Hive)

    2 days ago

    Vellore, India ACL Digital Full time

    🚀 We’re Hiring: Data Engineers(Python , Hadoop , Hive) – Bangalore 🚀Are you passionate about building your career in Data Engineering? We’re looking for talented Data Engineers with 4+ years of experience to join our Bangalore team!Location: BangaloreExperience: 4+ YearsInterview Mode: Face-to-Face ONLYJD:· Technical Skills and Platforms:...

  • Data Scientist

    1 week ago

    Vellore, India FactEntry Data Solutions Pvt Ltd Full time

    **Python NLP Engineer - Machine Learning** **Skills**: - Python developer - 3+yrs - Elastic Search - 1+yrs - Database - SQL, MongoDB 3+yrs - AWS or cloud / web hosting - 1+yrs **Desired Qualification**: - Proficient knowledge of programming in Python - Ability to wrangle both Unstructured and Structured data. - Work on research problems in information...

  • Technical Lead

    8 hours ago

    Vellore, Tamil Nadu, India Factentry Data Solutions Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job Summary: We are seeking an experienced Technical Lead with expertise in Python Django and to join our dynamic team. The ideal candidate will be responsible for leading the development and implementation of web applications using Django framework on the backend and on the frontend. This role requires strong technical skills, leadership abilities, and a...

  • Senior data engineer

    3 weeks ago

    Vellore, India AIQU Full time

    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Job Details:Role: Senior Data EngineerWork Location: RemoteEmployment Type: Contract – 12 months & extendableRole Summary:The Senior Data Engineer plays a lead role in designing, building, optimizing, and governing data pipelines and architectures that power analytics,...

  • Lead PySpark Data Engineer _ Exp: 7+ Years

    2 days ago

    Vellore, India Atyeti Inc Full time

    Job Description:Roles and Responsibility:Build and maintain all facets of Data Pipelines for Data Engineering team.Build the pipelines required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Spark, Python and Airflow.Work with internal and external stakeholders to assist with data-related technical...

  • Lead PySpark Data Engineer _ Exp: 7+ Years

    2 days ago

    Vellore, India Atyeti Inc Full time

    Job Description:Roles and Responsibility:Build and maintain all facets of Data Pipelines for Data Engineering team.Build the pipelines required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Spark, Python and Airflow.Work with internal and external stakeholders to assist with data-related technical...

  • Data engineer – azure

    1 week ago

    Vellore, India Yoda Tech Full time

    Job Description   We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms. The ideal candidate will have 2 to 4 years of hands-on experience with modern data engineering tools and cloud platforms, particularly in Azure and AWS ecosystems.   Key Responsibilities  ...

  • FactEntry - Technical Lead - Python/React.js

    2 weeks ago

    Vellore, India Factentry Full time

    Job Summary : We are seeking an experienced Technical Lead with expertise in Python Django and React.js to join our dynamic team. The ideal candidate will be responsible for leading the development and implementation of web applications using Django framework on the backend and React.js on the frontend. This role requires strong technical skills, leadership...

  • Python Developer

    5 days ago

    Vellore, India Landmark Group Full time

    Python Backend Developer Job DescriptionWe are seeking a talented and experienced Python Backend Developer to join our engineering team. The ideal candidate will have 3-5 years of professional experience, a strong proficiency in Python and its frameworks, and a proven track record of designing, building, and deploying scalable microservices and RESTful...