Senior Data Engineer

1 month ago

Pune, India VSquare Systems Pvt. Ltd. Full time

Job Title: Data Engineer (Azure Databricks)

Location: Pune

Job Type: Full-time

Job Description:

Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive enterprise-wide transformations and deliver efficient, scalable, and cost-effective solutions.

  • Highly analytical team player, with the aptitude for prioritization of needs/risks.
  • Has 6+ years of overall experience and 5+ years in taming Big Data using Azure Databricks.
  • A rich understanding of exploiting Azure resources such as Azure Data factory, Synapse, Databricks, Logic Apps, Key Vaults, Data lakes, and SQL DBs.
  • Fluent in performing Business Intelligence operations: Data analytics and visual analytics using MS Power BI & Tableau.
  • Encouraging and engaging with Team & Non-Team members in the exploration of new concepts, creating POCs, studying new technologies & certification prep.
  • Excellent communication & interpersonal skills with strong analytical, team building, problem-solving, and organizational capabilities.

Software Skills:

Cloud: Azure Stack - Azure Data factory, Datalake, keyvaults , Logic Apps

Data warehousing: Databricks, Synapse

Programming Language: Pyspark, Spark SQL

CI/CD: Azure DevOps, GitHub

Frontend: Power BI, Tableau

PROJECTS

· Telemetry Data Engineering for UX & Product Enhancement: Engineered a telemetry data aggregation solution using Azure Event Hubs, Databricks, and Logic Apps, enabling the collection and processing of device usage metrics (battery, thermal, application performance). Implemented a robust data pipeline with ADLS Gen2 storage and Azure Data Factory to facilitate Machine Learning and Product Design teams in enhancing product quality and user experience. Contributed to customer service efficiency by integrating device history analytics, streamlining parts availability, and service readiness at HP service centers.

· Financial Data Engineering for Warranty Analysis: Developed and managed the data processing pipeline for warranty information of HP products, creating actionable consumption tables for business analytics. Enhanced data fidelity and accessibility for warranty-related decision-making by leveraging Azure services and Databricks for real-time Streaming Delta tables.

· Cloud Infrastructure Cost Optimization: Led a technical team to reduce cloud infrastructure expenses by 67%, optimizing performance, consolidating pipelines, and parameterizing runtime inputs. Spearheaded the strategic decommissioning of underutilized Databricks, Snowflake, and Synapse workspaces, migrating simple task workflows to Azure Data Factory (ADF) and eliminating the need for costly data warehousing solutions.

· GSK Attendance Analysis - Collaborated with Cisco to design an API, fetching real-time data about employees connected to the office network. Leveraged Azure Data Factory and Databricks to process data, yielding insights into global attendance patterns. Assisted GSK in real estate optimization.

· Capital Asset Management - Orchestrated the end-to-end development of CAM, a cloud-based system, leading data transformation processes and ETL flows with Azure tools.

· Finance Operations at Anheuser-Busch InBev - Managed sensitive financial data operations. Transformed SAP data using Aecorsoft CDC and processed it through Databricks.

· Solution Development at DecisionAttic for TVS Motors - Offered comprehensive technical solutions from data extraction to dashboard creation, addressing varied business domains.

Certifications:

  • Senior Data Engineer

    7 months ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Data Analytics Engineer

    3 weeks ago

    Pune, Maharashtra, India Data Dynamics Full time

    About Data Dynamics">Data Dynamics is a leading data-driven company that leverages cutting-edge technologies to drive business growth. Our team of experts collaborates with clients across various industries to deliver innovative solutions.Job Summary">We are seeking an experienced Senior Machine Learning Specialist to join our team. As a key member, you will...

  • Senior Data Scientist

    7 months ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Software Engineer Lead

    2 weeks ago

    Pune, Maharashtra, India Data Labs Full time

    Job Title: Senior Software Engineer LeadWe are seeking an experienced Senior Software Engineer Lead to join our team at Data Labs. This is a full-time position based in Pune.About the Role:As a Senior Software Engineer Lead, you will be responsible for leading the frontend development team and collaborating with the backend team to deliver high-quality...

  • Data Scientist

    6 months ago

    Pune, Maharashtra, India Data Dynamics Full time

    **Objectives of this role**: - Collaborate with product design and engineering teams to develop an understanding of needs. - Research and devise innovative statistical models for data analysis. - Build innovative models and integrate them in our product. - Communicate findings to all stakeholders. - Keep current with technical and industry...

  • Senior data engineer

    2 weeks ago

    Pune, India ZettaMine Labs Pvt. Ltd. Full time

    Hello, Greeting From Zetta Mine!!!! Job Title: Senior Data Engineer (Spark-Scala Expert) Experience Level: 6+ Years Job Summary: We are looking for a highly skilled and motivated Senior Data Engineer with strong expertise in Apache Spark and Scala programming. The ideal candidate should have 6+ years of overall experience in big data...

  • Senior Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Where U Elevate Full time

    Job Title: Senior Data EngineerWe are looking for an experienced Senior Data Engineer to join our team at Where U Elevate. As a senior engineer, you will play a key role in designing and implementing large-scale data processing systems that meet our customers' needs.About the Company:Where U Elevate is a leading provider of data engineering services. We are...

  • Senior Snowflake Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Nutanxt Technologies Full time

    Job OverviewNutaNXT Technologies is a cutting-edge software product engineering services provider specializing in data-first products using Snowflake, AI/ML, and cloud technologies.We are seeking an experienced Senior Data Engineer to join our growing Snowflake Data Cloud Practice. As a Senior Data Engineer, you will be responsible for identifying business...

  • Senior Data Engineer

    1 month ago

    Pune, Maharashtra, India PubMatic Full time

    Join PubMatic as a Senior Data Engineer and be part of our team developing cutting-edge data analytics solutions. We are looking for an experienced professional to join our engineering team.About the RoleWe are seeking a skilled Senior Data Engineer to lead the development of our data analytics platform. The ideal candidate will have experience in big data...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Talent B Full time

    Talent B is seeking a Senior Data Engineer to join our team. This role involves designing, developing, and deploying scalable data pipelines and applications using Python and PySpark.

  • Senior .NET Software Engineer

    4 weeks ago

    Pune, Maharashtra, India NTT DATA Services Full time

    Job SummaryWe are seeking a highly skilled Senior .NET Software Engineer to join our team in Pune, India. The successful candidate will be responsible for designing, developing, and implementing robust software solutions using .NET technologies.Key Responsibilities:Design and develop complex software applications using .NET C# and Azure servicesCollaborate...

  • Senior Data Engineer

    3 months ago

    Pune, India KONE Full time

    Senior Lead Data Engineer Artificial Intelligence and generative AI are taking the world by storm. More and more value is being delivered from data, both internally in companies as well as externally to their customers. KONE is in the forefront of this development in our quest to deliver more value to our customers with our digital services offering....

  • Senior Data Engineering Lead

    2 weeks ago

    Pune, Maharashtra, India Sampoorna Consultants Pvt. Ltd Full time

    Job Title: Senior Data Engineering LeadSampoorna Consultants Pvt. Ltd is looking for a highly skilled Senior Data Engineering Lead to lead our data engineering team. If you have a strong background in data engineering, data quality, and data validation, and experience with data processing concepts like mapping documents and complex data relationships, we...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Consulting Pandits Full time

    We are looking for an experienced SENIOR DATA ENGINEER to join our team at Consulting Pandits. As a key member of our data engineering group, you will be responsible for designing, developing, and maintaining data pipelines and architectures that meet the complex needs of our clients.The ideal candidate will have a deep understanding of data warehousing...

  • Senior Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Synechron Full time

    Job Title: Senior Big Data EngineerEstimated Salary: ₹1,500,000 - ₹2,000,000 per annumAt Synechron, we are looking for a highly skilled Senior Big Data Engineer to join our team. The ideal candidate will have a solid understanding of big data technologies and be able to design and implement scalable data solutions using AWS services.About the Role:We are...

  • Senior Data Migration Engineer

    2 weeks ago

    Pune, Maharashtra, India Nixcel Software Full time

    Senior Data Migration Engineer Job Description:Nixcel Software is looking for a highly skilled Senior Data Migration Engineer to join our Data Migration team. As a senior member of our team, you will be responsible for designing, developing, and implementing data migration plans to migrate and integrate data from various sources into...

  • Senior Data Solutions Engineer

    23 hours ago

    Pune, Maharashtra, India Luxoft Full time

    About the RoleLuxoft is seeking a highly skilled Senior Data Solutions Engineer to join our team. As a key member of our engineering team, you will be responsible for designing and implementing data models and solutions that meet the needs of our clients.The ideal candidate will have a strong background in software engineering, data modeling, and experience...

  • Senior Data Engineering Specialist

    3 weeks ago

    Pune, Maharashtra, India Where U Elevate Full time

    Job OverviewWe are seeking an experienced Senior Data Engineering Specialist to join our team at Where U Elevate. As a key member of our data engineering team, you will play a crucial role in designing and implementing scalable data solutions that drive business growth.

  • Senior Data Engineer

    2 weeks ago

    Pune, India ZettaMine Labs Pvt. Ltd. Full time

    Hello, Greeting From ZettaMine!!!! Job Title: Senior Data Engineer (Spark-Scala Expert) Experience Level: 6+ Years Job Summary: We are looking for a highly skilled and motivated Senior Data Engineer with strong expertise in Apache Spark and Scala programming. The ideal candidate should have 6+ years of overall experience in big data...

  • Senior Data Engineer

    2 months ago

    Pune, India Rocket Software Full time

    Job Description Summary:The Data and Analytics team at Rocket Software is responsible for delivering systems, tools, processes, and capabilities used to equip teams with the data and insights they need to make informed decisions. The Senior Data Engineer is responsible for the design and development of a functional area, domain, or platform within our...