Data Engineer

1 month ago

Delhi, India VSquare Systems Pvt. Ltd. Full time

Job Title: Data Engineer (Azure Databricks)

Location: Bangalore / Hybrid

Job Type: Full-time

Job Description:

Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive enterprise-wide transformations and deliver efficient, scalable, and cost-effective solutions.

Highly analytical team player, with the aptitude for prioritization of needs/risks.
Has 6+ years of overall experience and 5+ years in taming Big Data using Azure Databricks.
A rich understanding of exploiting Azure resources such as Azure Data factory, Synapse, Databricks, Logic Apps, Key Vaults, Data lakes, and SQL DBs.
Fluent in performing Business Intelligence operations: Data analytics and visual analytics using MS Power BI & Tableau.
Encouraging and engaging with Team & Non-Team members in the exploration of new concepts, creating POCs, studying new technologies & certification prep.
Excellent communication & interpersonal skills with strong analytical, team building, problem-solving, and organizational capabilities.

Software Skills:

Cloud: Azure Stack - Azure Data factory, Datalake, keyvaults , Logic Apps
Data warehousing: Databricks, Synapse
Programming Language: Pyspark, Spark SQL
CI/CD: Azure DevOps, GitHub
Frontend: Power BI, Tableau

PROJECTS
· Telemetry Data Engineering for UX & Product Enhancement: Engineered a telemetry data aggregation solution using Azure Event Hubs, Databricks, and Logic Apps, enabling the collection and processing of device usage metrics (battery, thermal, application performance). Implemented a robust data pipeline with ADLS Gen2 storage and Azure Data Factory to facilitate Machine Learning and Product Design teams in enhancing product quality and user experience. Contributed to customer service efficiency by integrating device history analytics, streamlining parts availability, and service readiness at HP service centers.

· Financial Data Engineering for Warranty Analysis: Developed and managed the data processing pipeline for warranty information of HP products, creating actionable consumption tables for business analytics. Enhanced data fidelity and accessibility for warranty-related decision-making by leveraging Azure services and Databricks for real-time Streaming Delta tables.

· Cloud Infrastructure Cost Optimization: Led a technical team to reduce cloud infrastructure expenses by 67%, optimizing performance, consolidating pipelines, and parameterizing runtime inputs. Spearheaded the strategic decommissioning of underutilized Databricks, Snowflake, and Synapse workspaces, migrating simple task workflows to Azure Data Factory (ADF) and eliminating the need for costly data warehousing solutions.

· GSK Attendance Analysis - Collaborated with Cisco to design an API, fetching real-time data about employees connected to the office network. Leveraged Azure Data Factory and Databricks to process data, yielding insights into global attendance patterns. Assisted GSK in real estate optimization.

· Capital Asset Management - Orchestrated the end-to-end development of CAM, a cloud-based system, leading data transformation processes and ETL flows with Azure tools.

· Finance Operations at Anheuser-Busch InBev - Managed sensitive financial data operations. Transformed SAP data using Aecorsoft CDC and processed it through Databricks.

· Solution Development at DecisionAttic for TVS Motors - Offered comprehensive technical solutions from data extraction to dashboard creation, addressing varied business domains.

Certifications:
Databricks Certified Data Engineer Associate
Databricks Certified Data Analyst Associate

  • Operations Specialist

    4 weeks ago

    Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Operations Specialist

    4 weeks ago

    Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • ▷ (25/05/2024) Operations Specialist

    4 weeks ago

    Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Operations Specialist

    2 days ago

    Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Operations Specialist

    2 days ago

    Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Snowflake Data Engineer

    2 days ago

    Delhi, Delhi, India Lapis Data Analytics Full time

    Company DescriptionLapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...

  • Snowflake Data Engineer

    4 weeks ago

    delhi, India Lapis Data Analytics Full time

    Company DescriptionLapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...

  • Digital Engineering Sr. Engineer

    2 days ago

    Delhi, Delhi, India NTT DATA Full time

    Job DescriptionReq ID:273690NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India...

  • Digital Engineering Sr. Engineer

    2 days ago

    Delhi, Delhi, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India...

  • QA Engineer

    1 month ago

    delhi, India Data Unveil Full time

    Position Title: QA EngineerLevel: Mid-LevelLocation: Hyderabad, Telangana.Hire Type: Full TimeStart Date: ImmediateMinimum 3+ years of QA experience in data projects.Collaborate with the Development/Business teams to understand the requirements.Analyzing Business Requirements/cases and developing/managing the positive/negative test scenarios cases.Ability to...

  • Digital Engineering Sr. Engineer

    2 days ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID:273690NTT DATA Services is looking for a Digital Engineering Sr. Engineer to join their team in Delhi, India.Responsibilities: Manage and maintain the Appworx/UC4 batch scheduling system Create and modify job schedules as required Monitor job execution and ensure accuracy and timeliness Troubleshoot any issues during job execution Collaborate with...

  • Software Engineer

    2 days ago

    Delhi, Delhi, India NTT DATA Full time

    Job DescriptionReq ID:283993NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Software Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Work closely with the...

  • Digital Engineering Sr. Engineer

    2 weeks ago

    New Delhi, India NTT DATA Full time

    Job DescriptionReq ID:273690NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India...

  • Digital Engineering Sr. Engineer

    3 weeks ago

    New Delhi, India NTT DATA Full time

    Job DescriptionReq ID:273690NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India...

  • Data Engineer

    1 month ago

    delhi, India JRD Systems Full time

    Role : Data Engineer - AWS and Oracle ExpertJob Summary:We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong focus on AWS and Oracle technologies. The Data Engineer will be responsible for...

  • Software Engineer

    2 days ago

    Delhi, Delhi, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Software Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Work closely with the Senior...

  • Sr Specialist, Data Solutions

    1 month ago

    delhi, India Liberty Data Analytics Full time

    Senior Specialist, Data SolutionsProvides, builds, and maintains data solutions to meet the needs of the enterprise. Helps ensure those solutions can be scaled appropriately. Under minimal to no direction, works within broad limits and authority on highly complex assignments requiring specialized knowledge. Viewed as senior resource in given field for...

  • Data Engineer

    2 days ago

    Delhi, Delhi, India Aprisity Technologies Full time

    We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals.To succeed in this data engineering position, you should have...

  • Data Engineer

    2 days ago

    Delhi, India Lingaro Full time

    Role: Data Engineer – Lead ConsultantLocation: IndiaAbout Lingaro:Lingaro Group is the end-to-end data services partner to global brands and enterprises. We lead our clients through their data journey, from strategy through development to operations and adoption, helping them to realize the full value of their data.Since 2008, Lingaro has been recognized...

  • Digital Engineering Sr. Engineer

    2 days ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Responsibilities:- Manage and...