Senior Data Engineer

2 weeks ago


Pune, Maharashtra, India USIL Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Job Title: Lead/Senior Data Engineer

Location: Pune

Job Type: Full-Time

Job Description:

We are looking for a Senior Data Engineer with strong expertise in Azure Databricks, PySpark, and distributed computing to develop and optimize scalable ETL pipelines for manufacturing analytics. The role involves working with high-frequency industrial data to enable real-time and batch data processing.

Key Responsibilities

· Build scalable real-time and batch processing workflows using Azure Databricks, PySpark, and Apache Spark.

· Perform data pre-processing, including cleaning, transformation, deduplication, normalization, encoding, and scaling to ensure high-quality input for downstream analytics.

· Design and maintain cloud-based data architectures, including data lakes, lakehouses, and warehouses, following Medallion Architecture.

· Deploy and optimize data solutions on Azure (preferred), AWS, or GCP with a focus on performance, security, and scalability.

· Develop and optimize ETL/ELT pipelines for structured and unstructured data from IoT, MES, SCADA, LIMS, and ERP systems. · Automate data workflows using CI/CD and DevOps best practices, ensuring security and compliance with industry standards

· Monitor, troubleshoot, and enhance data pipelines for high availability and reliability.

· Utilize Docker and Kubernetes for scalable data processing.

· Collaborate with automation team, data scientists and engineers to provide clean, structured data for AI/ML models.

Desired Skills and Qualifications ·

Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.

· 7+ years of experience in core data engineering, with a strong focus on cloud platforms such as Azure (preferred), AWS, or GCP · Proficiency in PySpark, Azure Databricks, Python and Apache Spark, etc.

. 2 years of team handling experience.

· Expertise in relational databases (e.g., SQL Server, PostgreSQL), time series databases (e.g. Influx DB), and NoSQL databases (e.g., MongoDB, Cassandra) · Experience in containerization (Docker, Kubernetes).

· Strong analytical and problem-solving skills with attention to detail.

· Good to have MLOps, DevOps including model lifecycle management

· Excellent communication and collaboration skills, with a proven ability to work effectively as a team player.

· Comfortable working in a dynamic, fast-paced startup environment, adapting quickly to changing priorities and responsibilities.

Interested candidate can send resume


  • Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...


  • Pune, Maharashtra, India Jet2 Travel Technologies Pvt Ltd. Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Job Title –Senior Developer - Data EngineeringJob Type –Permanent Relevant Experience – 7+yearsof experience in the field of Datawarehouse, Data Engineering, Big Data, Cloud & Analytics, Data VisualizationReports into –Team Lead - Data EngineeringJob Description:We, at Jet2 (UK's third largest airlines and the largest tour operator), have set up a...


  • Pune, Maharashtra, India Real Jobs Consulting Services Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Company DescriptionReal Jobs Consulting Services is a reputable firm in the placement domain of Gurgaon, known for providing high-class placement services. Our services include HR consultancy, placement consultancy, manpower recruitment, domestic placement, career consultancy, and work at home services. Our team of expert consultants leverages the business...

  • Senior Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Vanderlande Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job TitleSenior Data EngineerJob DescriptionIf you are passionate about unlocking the power to gain next level insights into a great variety of data, powering data driven decision making through advanced analytics and data science practises, you might have just found your perfect next career step.In this job you will have versatile responsibilities,...

  • Senior Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Principal Global Services Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    ResponsibilitiesWhat You'll do: At Principal Financial Group, we pursue excellence in all aspects of our work. As a Senior Data Engineer, you'll get the opportunity to work on innovative projects that will develop the future of our data capabilities. Your role will be vital in ensuring our data infrastructure is both resilient and innovative, enabling us to...


  • Pune, Maharashtra, India Data Direct Networks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    OverviewThis is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to...


  • Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    About Data Axle:Data Axle Inc.  has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now as an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...


  • Pune, Maharashtra, India micro1 Full time ₹ 12,00,000 - ₹ 2,50,00,000 per year

    Position: Senior Data EngineerLocation: Delhi , Pune (Hybrid)Experience: 3–8 YearsJoining: Immediate to 30 DaysJob type : Contract (Full time)Role OverviewLooking for a skilled Data Engineer with strong expertise in SQL, Python, and PySpark to design and build scalable data pipelines and solutions. You'll work with cross-functional teams to ensure...


  • Pune, Maharashtra, India Growexx Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    Growexx is seeking a Senior Data Engineer for one of its clients, with good hands-on working experience on Snowflake, SQL, Azure, Python, .NET, Angular, Cypress, etc.Key ResponsibilitiesDesigning, building, testing, and maintaining scalable data models using Snowflake.Administering Snowflake environments, monitoring system health and performance.Managing and...


  • Pune, Maharashtra, India Anchanto Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    The Role (Describe the role):Highly skilled and experienced Senior Data Engineer with AI/ML expertise to backfill Varun Teja. This role is essential to maintain continuity and leadership for our AI-driven initiatives, particularly Vantage AI, which is currently gaining significant traction across business units.The candidate must possess strong technical...