Python Data Engineer

5 hours ago

Noida India ShyftLabs Full time

Job Description

Position Overview

We are seeking a highly skilled Python Data Engineer with a strong background in designing, developing, and maintaining scalable data solutions. The ideal candidate will have 5+ years of professional experience in Python and SQL, with proven expertise in building ETL/ELT pipelines, managing data streaming solutions. This role requires a hands-on engineer who can translate business requirements into reliable data systems, optimize performance, and ensure high data quality.

ShyftLabs is a growing data product company that was founded in early 2020 and works primarily with Fortune 500 companies. We deliver digital solutions built to help accelerate the growth of businesses in various industries, by focusing on creating value through innovation.

Job Responsibilities

- Develop and maintain data pipelines and ETL/ELT processes using Python
- Design and implement scalable, high-performance applications
- Work collaboratively with cross-functional teams to define requirements and deliver solutions
- Develop and manage near real-time data streaming solutions using PubSub or Beam
- Contribute to code reviews, architecture discussions, and continuous improvement initiatives
- Monitor and troubleshoot production systems to ensure reliability and Performance

Basic Qualification

- 5+ years of professional software development experience with Python and SQL
- Strong understanding of software engineering best practices (testing, version control, CI/CD)
- Experience building and optimizing ETL/ELT processes and data pipelines
- Proficiency with SQL and database concepts
- Experience with data processing frameworks (e.g., Pandas)
- Understanding of software design patterns and architectural principles
- Ability to write clean, well-documented, and maintainable code
- Experience with unit testing and test automation
- Experience working with any cloud provider (GCP is preferred)
- Experience with CI/CD pipelines and Infrastructure as code
- Experience with Containerization technologies like Docker or Kubernetes

Preferred Qualification

- Experience with GCP services, particularly Cloud Run and Dataflow
- Experience with stream processing technologies (Pub/Sub)
- Familiarity with big data technologies (Airflow)
- Experience with data visualization tools and libraries
- Knowledge of CI/CD pipelines with Gitlab and infrastructure as code with Terraform
- Familiarity with platforms like Snowflake, Bigquery or Databricks,

We are proud to offer a competitive salary alongside a strong insurance package. We pride ourselves on the growth of our employees, offering extensive learning and development resources.

  • Data Engineer

    4 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 303115NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer to join our team in Noida Uttar Pradesh IN-UP India IN Job Duties As a data engineer you will have a...

  • 3 Days Left: Python developer

    5 hours ago

    Noida, India Gauge data solutions Full time

    Job Description Essential Skills - Develop, enhance and maintain Python related projects, data services, platforms and processes. - Apply and maintain data quality checks to ensure data integrity and completeness. - Able to integrate multiple data sources and databases. - Collaborate with cross-functional teams across, Decision Sciences, Search, Database...

  • Python developer

    3 days ago

    Noida, Uttar Pradesh, India Gauge data solutions Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Essential SkillsDevelop, enhance and maintain Python related projects, data services, platforms and processes.Apply and maintain data quality checks to ensure data integrity and completeness.Able to integrate multiple data sources and databases.Collaborate with cross-functional teams across, Decision Sciences, Search, Database Management. To design...

  • Python Data Engineer

    5 days ago

    Bengaluru, India Capgemini Full time

    Job Description Location:Bangalore (Preferred), Gurgaon, Chennai Experience:7+ years Notice Period:Immediate to 15 days Role Level:B2 / C1 Choosing Capgemini means choosing a place where you'll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what's possible. Join us in helping leading...

  • Python API + Data Engineer

    2 days ago

    India Digitrix Software LLP Full time

    Experience : 5 to 8 years Job description: Python API + Data Engineer We are looking for a self-motivated Python Data Engineer with strong skills in backend/API development and large-scale data processing , who can work independently and thrive in a fast-paced, agile environment. Key Responsibilities Design, develop, and optimize data pipelines using...

  • Python/Hadoop Developer

    2 weeks ago

    Hyderabad, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Python/Hadoop Developer to join our team in Hyderabad, Telangana (IN-TG), India (IN). NTT DATA Services currently...

  • Python aws data engineer

    7 days ago

    India Digitrix Software LLP Full time

    Experience : 5 to 8 years Job description: Python AWS Data Engineer Python, AWS Python (core language skill) -- Backend, Pandas, Py Spark (Data Frame API), interacting with AWS (e.g., boto3 for S3, Glue, Lambda) Data Processing: Spark (Py Spark), Glue, EMR AWS Core Services: S3, Glue, Athena, Lambda, Step Functions, EMR Containerization: Docker ...

  • Python AWS Data Engineer

    7 days ago

    India Digitrix Software LLP Full time

    Experience: 5 to 8 years Job description: Python AWS Data Engineer - Python, AWS Python (core language skill) -- Backend, Pandas, PySpark (DataFrame API), interacting with AWS (e.g., boto3 for S3, Glue, Lambda) - Data Processing: Spark (PySpark), Glue, EMR AWS Core Services: S3, Glue, Athena, Lambda, Step Functions, EMR - Containerization: Docker -...

  • Python - Engineer

    2 weeks ago

    Noida, India IRIS software Full time

    Job Description Why Join Us Are you inspired to grow your career at one ofIndia's Top 25 Best Workplaces in IT industryDo you want to do the best work of your life at one of thefastest growing IT services companies Do you aspire to thrive in an award-winning work culture thatvalues your talent and career aspirations It'shappening right hereat Iris...

  • Data Engineer

    2 weeks ago

    Mumbai, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Mahrshtra (IN-MH), India (IN). Job Duties: Key Responsibilities: ....