Data Engineer

1 month ago


delhi, India VSquare Systems Pvt. Ltd. Full time
Job Title: Data Engineer (Azure Databricks)
Location: Bangalore / Hybrid
Job Type: Full-time
Job Description:
Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive enterprise-wide transformations and deliver efficient, scalable, and cost-effective solutions.
Highly analytical team player, with the aptitude for prioritization of needs/risks.
Has 6+ years of overall experience and 5+ years in taming Big Data using Azure Databricks.
A rich understanding of exploiting Azure resources such as Azure Data factory, Synapse, Databricks, Logic Apps, Key Vaults, Data lakes, and SQL DBs.
Fluent in performing Business Intelligence operations: Data analytics and visual analytics using MS Power BI & Tableau.
Encouraging and engaging with Team & Non-Team members in the exploration of new concepts, creating POCs, studying new technologies & certification prep.
Excellent communication & interpersonal skills with strong analytical, team building, problem-solving, and organizational capabilities.
Software Skills:
Cloud: Azure Stack - Azure Data factory, Datalake, keyvaults , Logic Apps
Data warehousing: Databricks, Synapse
Programming Language: Pyspark, Spark SQL
CI/CD: Azure DevOps, GitHub
Frontend: Power BI, Tableau
PROJECTS
· Telemetry Data Engineering for UX & Product Enhancement: Engineered a telemetry data aggregation solution using Azure Event Hubs, Databricks, and Logic Apps, enabling the collection and processing of device usage metrics (battery, thermal, application performance). Implemented a robust data pipeline with ADLS Gen2 storage and Azure Data Factory to facilitate Machine Learning and Product Design teams in enhancing product quality and user experience. Contributed to customer service efficiency by integrating device history analytics, streamlining parts availability, and service readiness at HP service centers.
· Financial Data Engineering for Warranty Analysis: Developed and managed the data processing pipeline for warranty information of HP products, creating actionable consumption tables for business analytics. Enhanced data fidelity and accessibility for warranty-related decision-making by leveraging Azure services and Databricks for real-time Streaming Delta tables.
· Cloud Infrastructure Cost Optimization: Led a technical team to reduce cloud infrastructure expenses by 67%, optimizing performance, consolidating pipelines, and parameterizing runtime inputs. Spearheaded the strategic decommissioning of underutilized Databricks, Snowflake, and Synapse workspaces, migrating simple task workflows to Azure Data Factory (ADF) and eliminating the need for costly data warehousing solutions.
· GSK Attendance Analysis - Collaborated with Cisco to design an API, fetching real-time data about employees connected to the office network. Leveraged Azure Data Factory and Databricks to process data, yielding insights into global attendance patterns. Assisted GSK in real estate optimization.
· Capital Asset Management - Orchestrated the end-to-end development of CAM, a cloud-based system, leading data transformation processes and ETL flows with Azure tools.
· Finance Operations at Anheuser-Busch InBev - Managed sensitive financial data operations. Transformed SAP data using Aecorsoft CDC and processed it through Databricks.
· Solution Development at DecisionAttic for TVS Motors - Offered comprehensive technical solutions from data extraction to dashboard creation, addressing varied business domains.
Certifications:
Databricks Certified Data Engineer Associate
Databricks Certified Data Analyst Associate

  • Delhi, India NTT DATA Full time

    The role of Critical Facilities Maintenance Engineer is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This position performs hands-on operations and maintenance which includes all physical and administrative operations tasks, service, and...

  • Data Engineer

    3 days ago


    delhi, India JRD Systems Full time

    Role : Data Engineer - AWS and Oracle ExpertJob Summary:We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong focus on AWS and Oracle technologies. The Data Engineer will be responsible for...

  • Data Engineer

    4 days ago


    delhi, India SMARTBORN SOFTWARE CONSULTING PVT.LTD. Full time

    Role DescriptionThis is a full-time hybrid role as a Data Engineer at SMARTBORN SOFTWARE CONSULTING PVT.LTD. The Data Engineer will be responsible for day-to-day tasks related to data engineering, including data modeling, Extract Transform Load (ETL) development, data warehousing, and data analytics. The role is based in Bengaluru, with flexibility for some...

  • Data Engineer

    3 weeks ago


    Delhi, India ValueLabs Full time

    Experience -6+YearsPrimary Skills -ADF, SQL Server, Databricks NoteBooks, Data Pipelines, SPROCs, Data Warehouse, Databricks DataLakeSecondary Skills -PowerBl, Data modelingNotice Period - Immediate - 15 daysJob Description:The Data Engineer is responsible for designing, developing, and maintaining data pipelines and data warehouses to support the...

  • Data Engineer

    3 weeks ago


    delhi, India Joveo Full time

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across Joveo. You will also be working closely with Data Analysts, Data Scientists, and...

  • Data Engineer

    6 days ago


    delhi, India Straive Full time

    Job Role- AWS Data Engineer Experience- 4 to 6 yearsMode- RemoteThe Data Engineering team is looking for a Data Engineer with experience in building modern data platforms from the ground up. The successful candidate will build and maintain cloud-centric data processing capabilities that unleash the value of the data assets to gain competitive advantage in...

  • Data Engineer

    3 weeks ago


    delhi, India ValueLabs Full time

    Experience - 6+YearsPrimary Skills - ADF, SQL Server, Databricks NoteBooks, Data Pipelines, SPROCs, Data Warehouse, Databricks DataLakeSecondary Skills - PowerBl, Data modelingNotice Period - Immediate - 15 daysJob Description: The Data Engineer is responsible for designing, developing, and maintaining data pipelines and data warehouses to support the...

  • Data Engineer

    3 weeks ago


    Delhi, India Straive Full time

    Job Role- AWS Data EngineerExperience- 4 to 6 yearsMode- RemoteThe Data Engineering team is looking for a Data Engineer with experience in building modern data platforms from the ground up. The successful candidate will build and maintain cloud-centric data processing capabilities that unleash the value of the data assets to gain competitive advantage in the...

  • Data Engineer

    4 weeks ago


    Delhi, India ValueLabs Full time

    Role:Data Engineer with AWSExperience:5-9 yearsNotice Period:Immediate - 10 daysLocation:HyderabadWe are seeking a highly skilled Data Engineer to join our dynamic team.Job DescriptionKey Responsibilities:Develop and maintain data models, data flow diagrams, and other documentation to support the organization's data architecture.Collaborate with...

  • Data Engineer

    1 week ago


    Delhi, India Infomatics Corp Full time

    Position Overview: We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure and systems. You will collaborate closely with cross-functional teams to ensure the reliability, scalability, and efficiency of our data...

  • Data Engineer

    3 days ago


    delhi, India D2N Solutions Full time

    Company DescriptionD2N Solutions is a talent and solutions provider based in Hyderabad. Our team consists of enthusiastic experts in recruitment, compliance, finance, and marketing who understand the challenges faced by both clients and candidates in today's employment climate. We offer all-inclusive support to our clients and candidates, focusing on their...

  • Data Engineer

    1 week ago


    delhi, India NAB Full time

    Consultant - Data Engineer role exists to ensure the delivery of the Right data to the Right customer at the Right time and at the Right Cost using the Right tools and the Right Technology on NAB’s target state Marketing Platforms.You will enable the move, flow and processing of reusable data assets in the Technology and Enterprise Operations space for...

  • Data Engineers

    4 weeks ago


    Delhi, India Cubiccode Digital Media LLP Full time

    We are searching for an accountable, multitalented data engineer to facilitate the operations of our data scientists. The data engineer will be responsible for employing machine learning techniques to create and sustain structures that allow for the analysis of data while remaining familiar with dominant programming and deployment strategies in the...

  • Data Engineer

    3 days ago


    delhi, India EliteRecruitments Full time

    We are hiring data engineers in Pune/Bangalore with global consulting. They are looking for data engineers with 5+ years of relevant experience.Technical and professional skills:We are looking for a flexible, fast learning, technically strong Data Engineer. Expertise is required in the following fields:Proficient in Cloud Services –AzureBuild ETL and data...

  • Data Engineer

    1 week ago


    delhi, India UNO Digital Bank Full time

    Overview:We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. Overall, you’ll strive for efficiency by aligning data systems with business goals.To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data from...

  • Data Engineer

    4 weeks ago


    delhi, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    2 weeks ago


    Delhi, India Numentica LLC Full time

    Job DescriptionThis is a remote position.As a Salesforce Data Engineer , you will be responsible for designing and implementing data pipelines to extract, transform, and load (ETL) Salesforce data. You will collaborate closely with clients to understand their data needs and requirements, and develop customized solutions to normalize, cleanse, and fine-tune...

  • Data Engineer

    14 hours ago


    Delhi, India BizFirst Full time

    Job DescriptionJob Title: Data EngineerCompany: Client of BizFirstLocation: Crystal City/Alexandria, VA (Onsite requirement: 3 days per week)Employment Type: Full-time W-2 EmployeeContract Length: 5 yearsSecurity Clearance: Secret clearance required; TS/SCI clearance preferredIntroductionBizFirst is assisting our client in recruiting a Data Engineer. Our...

  • Data Engineer

    2 days ago


    delhi, India Aspire Systems Full time

    Data Engineer (Google Cloud Platform)Exp: 5 - 9 YearsLocation: Chennai / BengaluruNotice Period: Immediate - 30 DaysRequirementsFluency in SQL, Shell and PythonKnowledge of building and maintaining data pipelines (e.g. Airflow, Control-M, Autosys)Experience in big data technologies (Hadoop, Google BigQuery or similar)Experience in Cloud technologies...

  • Data Engineer

    3 weeks ago


    Delhi, India Cayian India Pvt Limited Full time

    Job DescriptionCayian is a global IT and business service provider that delivers consultancy, capability, and system integration services to our partners. Our unique partner model is optimised to accelerate delivery, continuously improve quality, and drive business growth. Find out more about ushere.The roleAs aData Engineer, you will be a part of our Data...