Python Data Engineer

9 hours ago

Noida, Uttar Pradesh, India ShyftLabs Full time ₹ 12,00,000 - ₹ 24,00,000 per year
POSITION OVERVIEW
We are seeking a highly skilled Python Data Engineer with a strong background in designing, developing, and maintaining scalable data solutions. The ideal candidate will have 5+ years of professional experience in Python and SQL, with proven expertise in building ETL/ELT pipelines, managing data streaming solutions. This role requires a hands-on engineer who can translate business requirements into reliable data systems, optimize performance, and ensure high data quality. 
ShyftLabs is a growing data product company that was founded in early 2020 and works primarily with Fortune 500 companies. We deliver digital solutions built to help accelerate the growth of businesses in various industries, by focusing on creating value through innovation.
Job Responsibilities
  • Develop and maintain data pipelines and ETL/ELT processes using Python
  • Design and implement scalable, high-performance applications
  • Work collaboratively with cross-functional teams to define requirements and deliver solutions
  • Develop and manage near real-time data streaming solutions using PubSub or Beam.
  • Contribute to code reviews, architecture discussions, and continuous improvement initiatives
  • Monitor and troubleshoot production systems to ensure reliability and Performance.
Basic Qualification
  • 5+ years of professional software development experience with Python and SQL
  • Strong understanding of software engineering best practices (testing, version control, CI/CD)
  • Experience building and optimizing ETL/ELT processes and data pipelines
  • Proficiency with SQL and database concepts
  • Experience with data processing frameworks (e.g., Pandas)
  • Understanding of software design patterns and architectural principles
  • Ability to write clean, well-documented, and maintainable code
  • Experience with unit testing and test automation
  • Experience working with any cloud provider (GCP is preferred)
  • Experience with CI/CD pipelines and Infrastructure as code
  • Experience with Containerization technologies like Docker or Kubernetes
Preferred Qualification
  • Experience with GCP services, particularly Cloud Run and Dataflow
  • Experience with stream processing technologies (Pub/Sub)
  • Familiarity with big data technologies (Airflow)
  • Experience with data visualization tools and libraries
  • Knowledge of CI/CD pipelines with Gitlab and infrastructure as code with Terraform
  • Familiarity with platforms like Snowflake, Bigquery or Databricks,
We are proud to offer a competitive salary alongside a strong insurance package. We pride ourselves on the growth of our employees, offering extensive learning and development resources. 

  • Data Senior Engineer

    4 days ago

    Noida, Uttar Pradesh, India NTT DATA North America Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Req ID:345995NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Senior Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN).Job Duties: As a data analyst you will...

  • SENIOR DATA ENGINEER with PYTHON

    2 weeks ago

    Noida, Uttar Pradesh, India Soft Elevation Full time ₹ 30,00,000 - ₹ 40,00,000 per year

    Company OverviewSoft Elevation has fronted our client's goals by transforming their ideas into functional products. From IoT and Blockchain, to IoT and Big Data, to Custom Web Development, to Bespoke Mobile App Development, to UI/UX design there is no technology we have left in the raw. Our team of specialist Tech experts can remold from scratch a raw idea...

  • Senior Python Data Engineer

    7 days ago

    Noida, Uttar Pradesh, India Algoworks Technologies Pvt. Ltd Full time ₹ 27,00,000 - ₹ 32,40,000 per year

    Job SummaryWe are seeking a highly skilled Data Engineer with a strong background in Databricks and a passion for data engineering. The ideal candidate will have extensive experience in designing and implementing data solutions using various technologies, including PySpark, Spark SQL, and Power BI. This role requires a proactive individual who can work...

  • Python Engineer

    4 days ago

    Noida, Uttar Pradesh, India Coforge Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: Generative AI Python Senior Specialist EngineerBand: 3 & 4.xLocation –Greater NoidaJob Summary:Coforge is looking for a Generative AI Python Senior Specialist Engineer to build both Traditional AI/ML as well as Generative AI based systems. The candidate should be highly skilled in programming & statistics with the ability to confidently assess,...

  • Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Innova ESI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role: Data EngineerExperience: 7 year+Location: Publicis Sapient(Pan India)Note: We need Immediate Joiner.Job Description:Primary Skills :Data Engineering – Data StreamingPython, Spark, Kafka, Spark Streaming, Databricks, Delta Lake, Azure (ADLS)We are looking for a Data Streaming Engineer to design, develop, and test real-time data pipelines leveraging...

  • Python ( Airflow / DBT ) Engineer

    4 days ago

    Noida, Uttar Pradesh, India Luxoft Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Project descriptionThis project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data accessibility, performance, and governance while enabling advanced analytics and automation.The resource will join an ongoing effort to accelerate...

  • Data Engineer

    8 hours ago

    Noida, Uttar Pradesh, India ShyftLabs Full time ₹ 12,00,000 - ₹ 18,00,000 per year

    About ShyftLabs ShyftLabs is a fast-growing data product company founded in early 2020, working primarily with Fortune 500 clients. We design and deliver cutting-edge digital and data-driven solutions that help businesses accelerate growth, improve decision-making, and create measurable value through innovation. Position Overview We're looking for an...

  • Data Engineer

    2 days ago

    Noida, Uttar Pradesh, India BIZ2X Platform Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are seeking a hands-on data engineer with a strong understanding of both data engineering and reporting. The ideal candidate will design and maintain data pipelines, curate analytical datasets, and build reports and dashboards that empower business stakeholders with insights. Youll work across ETL development, data modelling, and business reporting...

  • Data Engineer

    2 days ago

    Noida, Uttar Pradesh, India ShyftLabs Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About ShyftLabsShyftLabs is a fast-growing data product company founded in early 2020, working primarily with Fortune 500 clients. We design and deliver cutting-edge digital and data-driven solutions that help businesses accelerate growth, improve decision-making, and create measurable value through innovation.Position OverviewWe're looking for an...

  • MFT L3 Engineer

    4 days ago

    Noida, Uttar Pradesh, India NTT DATA Full time US$ 60,000 - US$ 1,20,000 per year

    Req ID: 342049NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a MFT L3 Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Roles and responsibilities Resolve...