Senior Data Engineer

4 weeks ago

Pune, India Timus Consulting services Full time

Job Title : Senior Data Engineer

Location : Pune

Job Type : Full-Time

IIT Graduates only

Job Description :


We are looking for a Senior Data Engineer with strong expertise in Azure Databricks, PySpark, and distributed computing to develop and optimize scalable ETL pipelines for manufacturing analytics. The role involves working with high-frequency industrial data to enable real-time and batch data Responsibilities :


- Build scalable real-time and batch processing workflows using Azure Databricks, PySpark, and Apache Spark.

- Perform data pre-processing, including cleaning, transformation, deduplication, normalization, encoding, and

scaling to ensure high-quality input for downstream analytics.

- Design and maintain cloud-based data architectures, including data lakes, lakehouses, and warehouses, following Medallion Architecture.

- Deploy and optimize data solutions on Azure (preferred), AWS, or GCP with a focus on performance, security, and scalability.

- Develop and optimize ETL/ELT pipelines for structured and unstructured data from IoT, MES, SCADA, LIMS, and ERP systems.

- Automate data workflows using CI/CD and DevOps best practices, ensuring security and compliance with industry standards

- Monitor, troubleshoot, and enhance data pipelines for high availability and reliability.

- Utilize Docker and Kubernetes for scalable data processing.

- Collaborate with automation Skills and Qualifications :


- Bachelors or Masters degree in Computer Science, Information Technology, or a related field. (IIT Graduates only)

- 4+ years of experience in data engineering, with a strong focus on cloud platforms such as Azure (preferred), AWS, or GCP

- Proficiency in PySpark, Azure Databricks, Python and Apache Spark, etc.

- Expertise in relational databases (e.g., SQL Server, PostgreSQL), time series databases (e.g. Influx DB), and NoSQL databases (e.g., MongoDB, Cassandra)

- Experience in containerization (Docker, Kubernetes).

- Strong analytical and problem-solving skills with attention to detail.

- Good to have MLOps, DevOps including model lifecycle management

- Excellent communication and collaboration skills, with a proven ability to work effectively as a team player.

- Comfortable working in a dynamic, fast-paced startup environment, adapting quickly to changing priorities and responsibilities.


(ref:hirist.tech)

  • Senior Data Engineer

    1 week ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Data Engineer

    3 weeks ago

    Pune, India Data Axle Full time

    About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Data Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Data Dynamics

    4 weeks ago

    Pune, India Data Dynamics Full time

    About the Role : We are seeking a Senior Software Engineer to join our team in Pune. As a key member of our engineering group, you will play a crucial role in the entire software development lifecycle, from initial design to hands-on development. You will work with cross-functional teams to create innovative solutions that are scalable and reliable. This...

  • Data Engineer

    3 weeks ago

    Pune, India Jash Data Sciences Full time

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you. We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India. We believe in continuous learning and...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...

  • Senior QE Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 330974NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior QE Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Senior Quality Engineer I (JavaScript)...

  • Senior Data Engineer

    6 days ago

    Pune, India Dataceria Full time

    Company: Dataceria software solutions Pvt ltd.Job Position: Senior Data engineer _snowflakeLocation: PuneTimings to align with UK and USA timingsHybrid: 3 days in NT office PuneInterview stages: 1, initial screening, 2 stages client technical interviewStart date: asapDataceria is looking for a Senior Data Engineer to join our growing Data Delivery team.This...

  • Senior Data Engineer

    6 days ago

    pune, India Dataceria Full time

    Company: Dataceria software solutions Pvt ltd.Job Position: Senior Data engineer _snowflakeLocation: PuneTimings to align with UK and USA timingsHybrid: 3 days in NT office PuneInterview stages: 1, initial screening, 2 stages client technical interviewStart date: asapDataceria is looking for a Senior Data Engineer to join our growing Data Delivery team.This...

  • Senior Data Engineer

    6 days ago

    Pune, India Dataceria Full time

    Company: Dataceria software solutions Pvt ltd.Job Position: Senior Data engineer _snowflakeLocation: PuneTimings to align with UK and USA timingsHybrid: 3 days in NT office PuneInterview stages: 1, initial screening, 2 stages client technical interviewStart date: asapDataceria is looking for a Senior Data Engineer to join our growing Data Delivery team.This...