Senior data engineer

2 weeks ago

Pune, India VSquare Systems Pvt. Ltd. Full time
Job Title: Data Engineer (Azure Databricks)
Location: Pune
Job Type: Full-time
Job Description:
Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive enterprise-wide transformations and deliver efficient, scalable, and cost-effective solutions.
Highly analytical team player, with the aptitude for prioritization of needs/risks.
Has 6+ years of overall experience and 5+ years in taming Big Data using Azure Databricks.
A rich understanding of exploiting Azure resources such as Azure Data factory, Synapse, Databricks, Logic Apps, Key Vaults, Data lakes, and SQL DBs.
Fluent in performing Business Intelligence operations: Data analytics and visual analytics using MS Power BI & Tableau.
Encouraging and engaging with Team & Non-Team members in the exploration of new concepts, creating POCs, studying new technologies & certification prep.
Excellent communication & interpersonal skills with strong analytical, team building, problem-solving, and organizational capabilities.
Software Skills:
Cloud: Azure Stack - Azure Data factory, Datalake, keyvaults , Logic Apps
Data warehousing: Databricks, Synapse
Programming Language: Pyspark, Spark SQL
CI/CD: Azure Dev Ops, Git Hub
Frontend: Power BI, Tableau
PROJECTS
· Telemetry Data Engineering for UX & Product Enhancement: Engineered a telemetry data aggregation solution using Azure Event Hubs, Databricks, and Logic Apps, enabling the collection and processing of device usage metrics (battery, thermal, application performance). Implemented a robust data pipeline with ADLS Gen2 storage and Azure Data Factory to facilitate Machine Learning and Product Design teams in enhancing product quality and user experience. Contributed to customer service efficiency by integrating device history analytics, streamlining parts availability, and service readiness at HP service centers.
· Financial Data Engineering for Warranty Analysis: Developed and managed the data processing pipeline for warranty information of HP products, creating actionable consumption tables for business analytics. Enhanced data fidelity and accessibility for warranty-related decision-making by leveraging Azure services and Databricks for real-time Streaming Delta tables.
· Cloud Infrastructure Cost Optimization: Led a technical team to reduce cloud infrastructure expenses by 67%, optimizing performance, consolidating pipelines, and parameterizing runtime inputs. Spearheaded the strategic decommissioning of underutilized Databricks, Snowflake, and Synapse workspaces, migrating simple task workflows to Azure Data Factory (ADF) and eliminating the need for costly data warehousing solutions.
· GSK Attendance Analysis - Collaborated with Cisco to design an API, fetching real-time data about employees connected to the office network. Leveraged Azure Data Factory and Databricks to process data, yielding insights into global attendance patterns. Assisted GSK in real estate optimization.
· Capital Asset Management - Orchestrated the end-to-end development of CAM, a cloud-based system, leading data transformation processes and ETL flows with Azure tools.
· Finance Operations at Anheuser-Busch In Bev - Managed sensitive financial data operations. Transformed SAP data using Aecorsoft CDC and processed it through Databricks.
· Solution Development at Decision Attic for TVS Motors - Offered comprehensive technical solutions from data extraction to dashboard creation, addressing varied business domains.
Certifications:
Databricks Certified Data Engineer Associate
Databricks Certified Data Analyst Associate

  • Senior Data Engineer

    6 months ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Protection Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Senior Data Protection Engineer to join our team at NTT DATA. This is an exciting opportunity to work with a leading global innovator of business and technology services.Key Responsibilities:Implement and maintain data protection systems, ensuring high levels of security and efficiency.Configure and manage data...

  • Data Analytics Engineer

    1 week ago

    Pune, Maharashtra, India Data Dynamics Full time

    About Data Dynamics">Data Dynamics is a leading data-driven company that leverages cutting-edge technologies to drive business growth. Our team of experts collaborates with clients across various industries to deliver innovative solutions.Job Summary">We are seeking an experienced Senior Machine Learning Specialist to join our team. As a key member, you will...

  • Senior Data Scientist

    6 months ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    1 month ago

    pune, India Antal International Full time

    Senior Software Engineer - Data Engineer As a Senior Software Engineer, you will collaborate closely with the data engineering team and work on developing and maintaining data pipelines, data processing applications, and data integration solutions. You will get a chance to work with brilliant minds in the industry, work on complex use cases enabling steep...

  • Senior data engineer

    4 weeks ago

    Pune, India Antal International Full time

    Senior Software Engineer - Data Engineer As a Senior Software Engineer, you will collaborate closely with the data engineering team and work on developing and maintaining data pipelines, data processing applications, and data integration solutions. You will get a chance to work with brilliant minds in the industry, work on complex use cases enabling...

  • Senior data engineer

    4 weeks ago

    Pune, India Antal International Full time

    Senior Software Engineer - Data EngineerAs a Senior Software Engineer, you will collaborate closely with the data engineering team and work on developing and maintaining data pipelines, data processing applications, and data integration solutions. You will get a chance to work with brilliant minds in the industry, work on complex use cases enabling steep...

  • Senior Data Engineer

    1 month ago

    Pune, India Antal International Full time

    Senior Software Engineer - Data EngineerAs a Senior Software Engineer, you will collaborate closely with the data engineering team and work on developing and maintaining data pipelines, data processing applications, and data integration solutions. You will get a chance to work with brilliant minds in the industry, work on complex use cases enabling steep...

  • Data Engineer

    1 month ago

    Pune, India NTT DATA Full time

    Job Description Req ID: 297728 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Job Title Developer/ Data...

  • Senior Quality Engineer

    4 weeks ago

    Pune, India NTT DATA Full time

    Job Description Req ID: 302026 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Quality Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Senior Quality...

  • Senior Data Engineer

    1 month ago

    Pune, India Antal International Full time

    Senior Software Engineer - Data EngineerAs a Senior Software Engineer, you will collaborate closely with the data engineering team and work on developing and maintaining data pipelines, data processing applications, and data integration solutions. You will get a chance to work with brilliant minds in the industry, work on complex use cases enabling steep...

  • Senior Data Engineer

    1 month ago

    Pune, India Antal International Full time

    Senior Software Engineer - Data EngineerAs a Senior Software Engineer, you will collaborate closely with the data engineering team and work on developing and maintaining data pipelines, data processing applications, and data integration solutions. You will get a chance to work with brilliant minds in the industry, work on complex use cases enabling steep...

  • Senior Data Engineer

    1 month ago

    Pune, India Antal International Full time

    Senior Software Engineer - Data Engineer As a Senior Software Engineer, you will collaborate closely with the data engineering team and work on developing and maintaining data pipelines, data processing applications, and data integration solutions. You will get a chance to work with brilliant minds in the industry, work on complex use cases enabling steep...

  • Data Scientist

    6 months ago

    Pune, Maharashtra, India Data Dynamics Full time

    **Objectives of this role**: - Collaborate with product design and engineering teams to develop an understanding of needs. - Research and devise innovative statistical models for data analysis. - Build innovative models and integrate them in our product. - Communicate findings to all stakeholders. - Keep current with technical and industry...

  • Senior Network Engineer and Technical Innovator

    1 month ago

    Pune, Maharashtra, India NTT DATA Full time

    About the RoleNTT DATA is seeking a highly skilled Senior Network Engineer to join our team. As a key member of our network management services, you will be responsible for ensuring the smooth operation of our clients' IT infrastructure.Your Day at NTT DATAThe role of a Networking Managed Services Engineer (L2) involves proactively monitoring, identifying,...

  • Senior Data Engineer

    4 weeks ago

    pune, India RS Consulting Full time

    Job Title: Senior Data Engineer | Data Engineer Location: Pune Experience Level: 3 - 9 Years Company Type: AI/ML startup Salary Range: Up to 30 LPA (Max) commensurate with experience and skills. No. of Position Open: 10 Please apply only if you are comfortable working with Early stage startup. Qualifications: 3+ years of experience in Data Engineering,...

  • Principal Data Architect

    3 weeks ago

    Pune, Maharashtra, India Data Axle Full time

    About Data Axle:Data Axle Inc. is a 50-year-old industry leader in data, marketing solutions, sales, and research in the US.We have set up a strategic global centre of excellence in Pune, delivering mission-critical data services to our global customers powered by our proprietary cloud-based technology platform and leveraging our proprietary business &...

  • Senior Data Engineer

    3 weeks ago

    Pune, Maharashtra, India PubMatic Full time

    Join PubMatic as a Senior Data Engineer and be part of our team developing cutting-edge data analytics solutions. We are looking for an experienced professional to join our engineering team.About the RoleWe are seeking a skilled Senior Data Engineer to lead the development of our data analytics platform. The ideal candidate will have experience in big data...

  • Senior data engineer

    4 weeks ago

    Pune, India RS Consulting Full time

    Job Title: Senior Data Engineer | Data EngineerLocation: PuneExperience Level: 3 - 9 YearsCompany Type: AI/ML startupSalary Range: Up to 30 LPA (Max) commensurate with experience and skills.No. of Position Open: 10Please apply only if you are comfortable working with Early stage startup.Qualifications:3+ years of experience in Data Engineering, with a...

  • Senior Data Engineer

    4 weeks ago

    pune, India RS Consulting Full time

    Job Title: Senior Data Engineer | Data EngineerLocation:PuneExperience Level:3 - 9 YearsCompany Type:AI/ML startupSalary Range: Up to 30 LPA (Max) commensurate with experience and skills.No. of Position Open: 10Please apply only if you are comfortable working with Early stage startup.Qualifications:3+ years of experience in Data Engineering, with a strong...