Data Engineer with Scalable Pipeline Expertise

1 week ago

Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

About Data Engineering at LTIMindtree

As a key member of our team, you will work with a global leading manufacturing client to provide an engaging product experience through best-in-class Product Information Management (PIM) implementation.

We're looking for a skilled engineer to develop scalable pipelines using Spark, design and implement robust frameworks for generating PDF reports using Python and Spark, and leverage Azure Databricks and Datalake for data processing and storage.

You'll collaborate with architects and business stakeholders to understand reporting requirements, maintain and improve existing reporting pipelines and infrastructure, and utilize Snowflake features Streams Tasks Snowpipes etc wherever needed in the development flow.

Data Engineering Key Responsibilities:

  • Develop scalable pipelines to efficiently process transform data using Spark
  • Design and develop a scalable and robust framework for generating PDF reports using Python Spark
  • Utilize Snowflake Spark SQL to perform aggregations on high volume of data
  • Develop Stored Procedures Views Indexes Triggers and Functions in Snowflake Database to maintain data and share with downstream applications in form of APIs
  • Leverage Azure Databricks and Datalake for data processing and storage
  • Develop APIs using Python's Flask framework to support front end applications
  • Collaborate with Architects and Business stakeholders to understand reporting requirements

Data Engineer Requirements:

  • Proven experience as a Data Engineer with a strong understanding of data pipelines and ETL processes
  • Proficiency in Python with experience in data manipulation libraries such as Pandas and Numpy
  • Experience with SQL Snowflake Spark for data querying and aggregations
  • Familiarity with Azure cloud services such as Data Factory Databricks and Datalake
  • Experience developing APIs using frameworks like Flask is a plus
  • Excellent communication and collaboration skills
  • Ability to work independently and manage multiple tasks effectively

Benefits:

  • Work in industry leading implementations for Tier-1 clients
  • Accelerated career growth and global exposure
  • Collaborative, inclusive work environment rooted in innovation
  • Exposure to best-in-class automation framework

LTIMindtree is an equal opportunities employer.

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:A seasoned data engineer with expertise in designing and implementing scalable data pipelines using AWS services is required to join our team.

  • Scalable Data Pipeline Specialist

    1 week ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    GCP Data Engineer - Job DescriptionDesign, develop and optimize scalable data pipelines on GCP.Implement workflow orchestration using Airflow DAGs.Collaborate with cross-functional teams in an Agile environment.Required Skills:Google Cloud Platform (GCP) - Strong experience in BigQuery, Cloud Storage, Dataflow etc.PySpark - Expertise in handling large-scale...

  • Data Engineer

    1 week ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 8,00,000 - ₹ 15,00,000

    Job DescriptionOur team is seeking a talented Data Engineer to play a key role in designing, building and maintaining scalable data pipelines using Python and PySpark. The ideal candidate will have hands-on experience with distributed data systems and a solid foundation in AWS.This is an exciting opportunity to work closely with senior engineers and product...

  • Lead/Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Data Economy Full time US$ 1,50,000 - US$ 2,00,000 per year

    We are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Azure Data Engineer ll

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Full time US$ 90,000 - US$ 1,20,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Building Scalable Data Infrastructure

    5 days ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    As a Senior Data Engineer, you will play a pivotal role in constructing and optimizing our data pipeline architecture. This critical position requires collaboration with data scientists and analysts to facilitate data-related functionalities.About the RoleThe Senior Data Engineer will design, build, and maintain highly scalable data pipelines, optimize data...

  • Aws Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Data Economy Full time US$ 1,50,000 - US$ 2,00,000 per year

    We are seeking a highly skilled and experienced Senior Data Engineer to lead the end-to-end development of complex models for compliance and supervision. The ideal candidate will have deep expertise in cloud-based infrastructure, ETL pipeline development, and financial domains, with a strong focus on creating robust, scalable, and efficient solutions.Key...

  • Data Pipeline Engineer

    5 days ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 10,00,000 - ₹ 13,00,000

    Job Title: Data Pipeline Tester We are seeking an experienced professional to test our data pipelines, ensuring seamless data flow and accurate data processing. As a key member of our team, you will play a vital role in identifying and resolving data pipeline issues, collaborating closely with developers and data engineers to implement fixes. The ideal...