Data Engineer

1 week ago

Delhi, India VSquare Systems Pvt. Ltd. Full time
Job Title: Data Engineer (Azure Databricks)

Location: Bangalore / Hybrid

Job Type: Full-time

Job Description:

Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive enterprise-wide transformations and deliver efficient, scalable, and cost-effective solutions.

- Highly analytical team player, with the aptitude for prioritization of needs/risks.- Has 6+ years of overall experience and 5+ years in taming Big Data using Azure Databricks.- A rich understanding of exploiting Azure resources such as Azure Data factory, Synapse, Databricks, Logic Apps, Key Vaults, Data lakes, and SQL DBs.- Fluent in performing Business Intelligence operations: Data analytics and visual analytics using MS Power BI & Tableau.- Encouraging and engaging with Team & Non-Team members in the exploration of new concepts, creating POCs, studying new technologies & certification prep.- Excellent communication & interpersonal skills with strong analytical, team building, problem-solving, and organizational capabilities.

Software Skills:

Cloud: Azure Stack - Azure Data factory, Datalake, keyvaults , Logic Apps

Data warehousing: Databricks, Synapse

Programming Language: Pyspark, Spark SQL

CI/CD: Azure DevOps, GitHub

Frontend: Power BI, Tableau

PROJECTS

· Telemetry Data Engineering for UX & Product Enhancement: Engineered a telemetry data aggregation solution using Azure Event Hubs, Databricks, and Logic Apps, enabling the collection and processing of device usage metrics (battery, thermal, application performance). Implemented a robust data pipeline with ADLS Gen2 storage and Azure Data Factory to facilitate Machine Learning and Product Design teams in enhancing product quality and user experience. Contributed to customer service efficiency by integrating device history analytics, streamlining parts availability, and service readiness at HP service centers.

· Financial Data Engineering for Warranty Analysis: Developed and managed the data processing pipeline for warranty information of HP products, creating actionable consumption tables for business analytics. Enhanced data fidelity and accessibility for warranty-related decision-making by leveraging Azure services and Databricks for real-time Streaming Delta tables.

· Cloud Infrastructure Cost Optimization: Led a technical team to reduce cloud infrastructure expenses by 67%, optimizing performance, consolidating pipelines, and parameterizing runtime inputs. Spearheaded the strategic decommissioning of underutilized Databricks, Snowflake, and Synapse workspaces, migrating simple task workflows to Azure Data Factory (ADF) and eliminating the need for costly data warehousing solutions.

· GSK Attendance Analysis - Collaborated with Cisco to design an API, fetching real-time data about employees connected to the office network. Leveraged Azure Data Factory and Databricks to process data, yielding insights into global attendance patterns. Assisted GSK in real estate optimization.

· Capital Asset Management - Orchestrated the end-to-end development of CAM, a cloud-based system, leading data transformation processes and ETL flows with Azure tools.

· Finance Operations at Anheuser-Busch InBev - Managed sensitive financial data operations. Transformed SAP data using Aecorsoft CDC and processed it through Databricks.

· Solution Development at DecisionAttic for TVS Motors - Offered comprehensive technical solutions from data extraction to dashboard creation, addressing varied business domains.

Certifications:

- Databricks Certified Data Engineer Associate- Databricks Certified Data Analyst Associate

  • Lead data engineer

    4 days ago

    Delhi, India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...

  • AWS Data Engineer

    1 week ago

    delhi, India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    2 weeks ago

    delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • AWS Data Engineer

    3 months ago

    Delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • Aws data engineer

    7 days ago

    Delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • Senior Data Engineer

    3 weeks ago

    Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full time

    About Eucloid Data SolutionsEucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. We offer bespoke, full stack and data-driven approach to solve highly complex and large-scale business problems for some of the biggest Fortune 500...

  • Senior Data Engineer

    3 weeks ago

    Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full time

    About the Role:Eucloid Data Solutions Pvt Ltd is seeking a highly skilled Senior Data Engineer to join our Data Platform team. The successful candidate will have hands-on expertise in Databricks and will be responsible for designing and building data infrastructure to support various business applications.Key Responsibilities:Design, implementation, and...

  • Security Engineer

    2 weeks ago

    Delhi, Delhi, India NTT DATA Full time

    OverviewThe Security Managed Services Engineer (L2) plays a vital role in ensuring the security of clients' infrastructures and systems under a managed service model. This role involves proactive monitoring, identifying, investigating, and resolving technical incidents and problems to restore service to clients.ResponsibilitiesSecurity Monitoring:...

  • Security Engineer

    2 weeks ago

    Delhi, Delhi, India NTT DATA Full time

    Job OverviewNTT DATA is seeking a skilled Security Engineer to join our Managed Services team. As a Security Engineer, you will be responsible for providing proactive monitoring, identifying, investigating, and resolving technical incidents and problems to ensure the security infrastructure and systems of our clients remain operational.Key...

  • Senior Cybersecurity Engineer

    3 weeks ago

    Delhi, Delhi, India NTT DATA Full time

    About the RoleWe are seeking a skilled Security Managed Services Engineer to join our team. As a seasoned engineer, you will be responsible for providing proactive incident resolution and technical problem-solving to our clients.Your Key ResponsibilitiesConduct daily threat hunting to identify advanced threats.Analyze log sources to identify potential...

  • Senior Security Engineer

    2 weeks ago

    Delhi, Delhi, India NTT DATA Full time

    Job OverviewThe Security Managed Services Engineer (L2) at NTT DATA plays a critical role in ensuring the security and integrity of our clients' infrastructure and systems. As a key member of our managed services team, this individual will be responsible for providing proactive monitoring, identifying, investigating, and resolving technical incidents and...

  • Service Delivery Field Support Engineer

    1 month ago

    Delhi, Delhi, India NTT DATA Full time

    Job OverviewNTT DATA is seeking a highly motivated and detail-oriented Service Delivery Field Support Engineer to join our team. As a key member of our support team, you will be responsible for providing technical support to clients, ensuring that their infrastructure is configured, installed, and operational.Key Responsibilities:Ensure that client...

  • MS Engineer L3

    1 month ago

    Delhi, Delhi, India NTT DATA Full time

    Job DescriptionMake a Difference with NTT DATANTT DATA is a leading global innovator of business and technology services, serving 75% of the Fortune Global 100. We're committed to helping clients innovate, optimize, and transform for long-term success. As a seasoned Managed Services Cross Technology Engineer (L3), you'll play a critical role in providing...

  • Data Engineer

    4 weeks ago

    Delhi, India Implere Technolgies Pvt Ltd Full time

    Role DescriptionThis is a full-time remote role for a Data Engineer at Implere Technologies Pvt Ltd. The Data Engineer will be responsible for tasks such as data engineering, data modeling, ETL processes, data warehousing, and data analytics on a day-to-day basis.QualificationsData Engineering and Data Modeling skillsExperience in ETL (Extract Transform...

  • Data engineer

    2 weeks ago

    Delhi, India Ryden Global Full time

    We're #hiring #Data Engineers for our USA based client at offshore in India (must support afternoon shift in IST).Role DescriptionThis is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics on a...

  • Data Engineer

    4 weeks ago

    Delhi, India Implere Technolgies Pvt Ltd Full time

    Role DescriptionThis is a full-time remote role for a Data Engineer at Implere Technologies Pvt Ltd. The Data Engineer will be responsible for tasks such as data engineering, data modeling, ETL processes, data warehousing, and data analytics on a day-to-day basis.QualificationsData Engineering and Data Modeling skillsExperience in ETL (Extract Transform...

  • Data Engineer

    6 days ago

    delhi, India Ryden Global Full time

    We're #hiring #DataEngineers for our USA based client at offshore in India (must support afternoon shift in IST). Role Description This is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics on a...

  • Data Engineer

    5 days ago

    delhi, India Ryden Global Full time

    We're #hiring #DataEngineers for our USA based client at offshore in India (must support afternoon shift in IST).Role DescriptionThis is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics on a...

  • Data Engineer

    2 days ago

    delhi, India Ryden Global Full time

    We‘re #hiring #DataEngineers for our USA based client at offshore in India (must support afternoon shift in IST). Role Description This is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics on a...

  • Data Engineer

    4 weeks ago

    Delhi, India Ryden Global Full time

    We're #hiring #DataEngineers for our USA based client at offshore in India (must support afternoon shift in IST).Role DescriptionThis is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics on a...