Current jobs related to Lead, Data Engineer - Pune, Maharashtra - Dynamic Yield

  • Data Engineering Lead

    1 day ago

    Pune, Maharashtra, India Ascentt Full time US$ 1,25,000 - US$ 1,75,000 per year

    Job Title: Data Engineering LeadJob Summary:We are seeking an experienced Data Engineering Lead to oversee and guide our organization's data engineering function. The ideal candidate will combine deep technical expertise in big data and data engineering with strong leadership skills to drive innovation, best practices, and excellence across our data...

  • Lead Data Engineer

    3 days ago

    Pune, Maharashtra, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineering LeaderA seasoned Data Engineer to spearhead our data strategy and drive business outcomes.Job SummaryWe are seeking an experienced Data Engineer to lead our team in driving the development, implementation, and maintenance of data engineering solutions. The successful candidate will have a strong background in data engineering principles,...

  • Lead Data Engineer

    4 weeks ago

    Pune, Maharashtra, India VY SYSTEMS PRIVATE LIMITED Full time

    Immediate to 15 days and are highly encouraged to applyExperiences : 9+ YearsLocation : PuneRelocation candidates are also welcome.Job Summary :We are looking for a highly experienced and technically proficient Lead Data Engineer with 9+ years of experience to design, build, and optimize data pipelines and platforms in a cloud-native environment. This role...

  • Lead Data Engineer

    3 days ago

    Pune, Maharashtra, India Mastercard Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Title:Lead Data Engineer Overview:OverviewWe are the global technology company behind the world's fastest payments processing network. We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless. We ensure every employee has the opportunity to be a part of something...

  • Data Engineering Lead

    7 hours ago

    Pune, Maharashtra, India beBeeDataEngineering Full time US$ 1,30,000 - US$ 1,70,000

    Job Title: Data Engineering LeadWe are seeking a highly skilled and experienced data engineering lead to design, implement, and manage large-scale data solutions using Azure technologies. The ideal candidate will have a proven track record of designing, implementing, and managing complex system integration processes focused primarily on the use of Azure SQL,...

  • Lead Data Engineer

    3 days ago

    Pune, Maharashtra, India Mastercard Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Our PurposeMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships...

  • Lead Data Engineer

    1 day ago

    Pune, Maharashtra, India Mastercard Full time US$ 1,25,000 - US$ 1,75,000 per year

    Our PurposeMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships...

  • Lead Data Engineer

    2 days ago

    Pune, Maharashtra, India MSD Full time US$ 1,50,000 - US$ 2,00,000 per year

    Job DescriptionLead Data EngineerAt our Company we are leveraging analytics and technology, as we invent for life on behalf of patients around the world. We are seeking those who have a passion for using data, analytics, and insights to drive decision making, that will allow us to tackle some of the world's greatest health threats.Within our commercial...

  • Technical Lead – Data Engineering

    10 hours ago

    Pune, Maharashtra, India Zywave Full time

    Job Description – Technical Lead (Data Engineering, TurboRater RQR: CPQ Rating)Location: Pune, IndiaWork Mode: 5 Days Work from OfficeAbout the RoleZywave is seeking a Technical Lead – Data Engineering (TurboRater RQR: CPQ Rating) with expertise in Snowflake, SQL Server, and modern data architecture principles including Medallion Architecture and Data...

  • Lead Data Engineer

    1 week ago

    Pune, Maharashtra, India TerraGiG Full time

    Job Title : Data Engineer Experience : 8-12 Years Location : Noida, Chennai & Pune Skills : Python, Pyspark, Snowflake & Redshift, AWS, DBT, Data Modeling, Airflow, SQL Key Responsibilities • Migration & Modernization • Lead the migration of data pipelines, models, and workloads from Redshift to Snowflake /Yellowbrick. • Design and...

Lead, Data Engineer

4 weeks ago

Pune, Maharashtra, India Dynamic Yield Full time
Job Description

The Mastercard Services Technology team is looking for a Lead, Data Engineer to significantly contribute to our mission of unlocking the full potential of data assets. This involves continuous innovation, eliminating friction in big data management, optimizing storage and accessibility, and enforcing robust standards and principles across both public cloud and on-premises big data environments. We're seeking a hands-on, passionate Data Engineer who is not only technically proficient in PySpark, cloud platforms, and modern data architectures but also deeply committed to learning, personal growth, and uplifting others. This role is crucial in designing and building scalable data solutions, shaping our engineering culture, and mentoring team members. If you're a builder and collaborator who loves clean data pipelines, cloud-native design, and helping teammates succeed, this is the role for you.

About Role :

As a Lead, Data Engineer, you will:

- Design and build scalable, cloud-native data platforms utilizing PySpark, Python, and cutting-edge data engineering practices.
- Mentor and guide other engineers, actively sharing knowledge, conducting code reviews, and fostering a culture of curiosity, growth, and continuous improvement within the team.
- Create robust, maintainable ETL/ELT pipelines that seamlessly integrate with diverse systems and effectively serve business-critical use cases.
- Lead by example by writing high-quality, testable code and actively participating in architecture and design discussions with a focus on long-term vision.
- Decompose complex problems into modular, efficient, and scalable components that align with both platform and product goals.
- Champion best practices in data engineering, including comprehensive testing, meticulous version control, thorough documentation, and effective performance tuning.
- Drive collaboration across teams, working closely with product managers, data scientists, and other engineers to deliver high-impact solutions.
- Support data governance and quality efforts, ensuring that data lineage, cataloging, and access management are inherently built into the platform.
- Continuously learn and apply new technologies, frameworks, and tools to enhance team productivity and improve platform reliability.
- Own and optimize cloud infrastructure components specifically related to data engineering workflows, encompassing storage, processing, and orchestration.
- Participate in architectural discussions, iteration planning, and feature sizing meetings.
- Adhere to Agile processes and actively participate in agile ceremonies.
- Demonstrate strong stakeholder management skills.

Experience & Technical Skills:

- 5+ years of hands-on experience in data engineering with strong PySpark and Python skills.
- Solid experience in designing and implementing data models, pipelines, and batch/stream processing systems.
- Proven ability to work with cloud platforms (AWS, Azure, or GCP), especially with data-related services such as S3, Glue, Data Factory, Databricks, etc.
- Strong foundation in data modeling, database design, and performance optimization.
- Understanding of modern data architectures (e.g., lakehouse, medallion) and data lifecycle management.
- Comfortable with CI/CD practices, version control (e.g., Git), and automated testing.
- Demonstrated ability to mentor and uplift junior engineers, coupled with strong communication and collaboration skills.

Education & Mindset

- Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent hands-on experience.
- Comfortable working in Agile/Scrum development environments.
- Curious, adaptable, and driven by problem-solving and continuous improvement.

Good to Have

- Experience integrating heterogeneous systems and building resilient data pipelines across cloud environments.
- Familiarity with orchestration tools (e.g., Airflow, dbt, Step Functions, etc.).
- Exposure to data governance tools and practices (e.g., Lake Formation, Purview, or Atlan).
- Experience with containerization and infrastructure automation (e.g., Docker, Terraform) is a good addition.
- Master's degree, relevant certifications (e.g., AWS Certified Data Analytics, Azure Data Engineer), or demonstrable contributions to open source/data engineering communities will be a bonus.
- Exposure to machine learning data pipelines or MLOps is a plus.