▷ [Immediate Start] Data Engineer (Azure Databricks)

3 weeks ago

Delhi, India VSquare Systems Pvt. Ltd. Full time
Job Title: Data Engineer (Azure Databricks)

Location: Bangalore / Hybrid

Job Type: Full-time

Job Description:

Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive enterprise-wide transformations and deliver efficient, scalable, and cost-effective solutions.

- Highly analytical team player, with the aptitude for prioritization of needs/risks.- Has 6+ years of overall experience and 5+ years in taming Big Data using Azure Databricks.- A rich understanding of exploiting Azure resources such as Azure Data factory, Synapse, Databricks, Logic Apps, Key Vaults, Data lakes, and SQL DBs.- Fluent in performing Business Intelligence operations: Data analytics and visual analytics using MS Power BI & Tableau.- Encouraging and engaging with Team & Non-Team members in the exploration of new concepts, creating POCs, studying new technologies & certification prep.- Excellent communication & interpersonal skills with strong analytical, team building, problem-solving, and organizational capabilities.

Software Skills:

Cloud: Azure Stack - Azure Data factory, Datalake, keyvaults , Logic Apps

Data warehousing: Databricks, Synapse

Programming Language: Pyspark, Spark SQL

CI/CD: Azure DevOps, GitHub

Frontend: Power BI, Tableau

PROJECTS

· Telemetry Data Engineering for UX & Product Enhancement: Engineered a telemetry data aggregation solution using Azure Event Hubs, Databricks, and Logic Apps, enabling the collection and processing of device usage metrics (battery, thermal, application performance). Implemented a robust data pipeline with ADLS Gen2 storage and Azure Data Factory to facilitate Machine Learning and Product Design teams in enhancing product quality and user experience. Contributed to customer service efficiency by integrating device history analytics, streamlining parts availability, and service readiness at HP service centers.

· Financial Data Engineering for Warranty Analysis: Developed and managed the data processing pipeline for warranty information of HP products, creating actionable consumption tables for business analytics. Enhanced data fidelity and accessibility for warranty-related decision-making by leveraging Azure services and Databricks for real-time Streaming Delta tables.

· Cloud Infrastructure Cost Optimization: Led a technical team to reduce cloud infrastructure expenses by 67%, optimizing performance, consolidating pipelines, and parameterizing runtime inputs. Spearheaded the strategic decommissioning of underutilized Databricks, Snowflake, and Synapse workspaces, migrating simple task workflows to Azure Data Factory (ADF) and eliminating the need for costly data warehousing solutions.

· GSK Attendance Analysis - Collaborated with Cisco to design an API, fetching real-time data about employees connected to the office network. Leveraged Azure Data Factory and Databricks to process data, yielding insights into global attendance patterns. Assisted GSK in real estate optimization.

· Capital Asset Management - Orchestrated the end-to-end development of CAM, a cloud-based system, leading data transformation processes and ETL flows with Azure tools.

· Finance Operations at Anheuser-Busch InBev - Managed sensitive financial data operations. Transformed SAP data using Aecorsoft CDC and processed it through Databricks.

· Solution Development at DecisionAttic for TVS Motors - Offered comprehensive technical solutions from data extraction to dashboard creation, addressing varied business domains.

Certifications:

- Databricks Certified Data Engineer Associate- Databricks Certified Data Analyst Associate

  • Azure Data Engineer

    5 days ago

    Delhi, India Amicus Technology Full time

    This position is responsible for designing, implementing, and managing Azure-based solutions for medium-sized global enterprises.ROLES AND RESPONSIBILITIES:- Designing, developing, and testing Azure-based applications and services that meet business and technical requirements.- To work in capacity of Azure Databricks, ADF and .net developer.- Should have...

  • [Immediate Start] Azure Data Engineer

    4 weeks ago

    Delhi, India YALLO Retail Full time

    Role Type: ContractLocation: RemoteDuration: 6 monthsStart: ASAPAs an Azure Data Engineer, you will play a crucial role in designing, developing, and maintaining data engineering solutions on the Azure cloud platform. You will collaborate with cross-functional teams to understand data requirements, architect scalable data pipelines, and ensure the integrity...

  • Data Engineer

    2 months ago

    delhi, India VSquare Systems Pvt. Ltd. Full time

    Job Title: Data Engineer (Azure Databricks)Location: Bangalore / HybridJob Type: Full-timeJob Description:Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive...

  • Data Engineer

    1 week ago

    Delhi, India VSquare Systems Pvt. Ltd. Full time

    Job Title: Data Engineer (Azure Databricks)Location: Bangalore / HybridJob Type: Full-timeJob Description:Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive...

  • Data Engineer

    3 weeks ago

    delhi, India The Ksquare Group Full time

    RequirementsBachelor's degree in computer science, information technology, or a related field.Prior experience with data lakes and data warehouses, working knowledge with dimensional modeling is must.Demonstrate advanced understanding in data engineering practices, Including ETL/ELT, data integrations, reusable data pipelines,data management methods.Advanced...

  • Architect : Big Data

    2 weeks ago

    Delhi, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Azure Data Engineer

    6 days ago

    delhi, India Quadrant Technologies Full time

    Title: Azure Data EngineerEducational Qualification: BE/B.Tech/MS/MCA/M.ech or equivalentExperience : 3.5- 7 yearsExcellent communication and problem-solving skillsStrong analytical skills in understanding business requirementsJob Description for an Immediate Requirement:This is a full-time role for a Data Engineer located in Hyderabad with Quadrant...

  • Architect : Big Data / Ml

    1 month ago

    Delhi, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Azure Data Engineer

    1 week ago

    Delhi, India Quantzig Full time

    About Quantzig:Quantzig is a global analytics & advisory firm with offices in the US, UK, Canada, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is built and...

  • Solutions Architect

    1 month ago

    Delhi Cantonment, Delhi, Delhi, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Azure Data Engineer

    2 weeks ago

    delhi, India Amicus Technology Full time

    This position is responsible for designing, implementing, and managing Azure-based solutions for medium-sized global enterprises.ROLES AND RESPONSIBILITIES:Designing, developing, and testing Azure-based applications and services that meet business and technical requirements.To work in capacity of Azure Databricks, ADF and .net developer.Should have...

  • Azure Data Engineer

    4 weeks ago

    delhi, India YALLO Retail Full time

    Role Type: ContractLocation: RemoteDuration: 6 monthsStart: ASAPAs an Azure Data Engineer, you will play a crucial role in designing, developing, and maintaining data engineering solutions on the Azure cloud platform. You will collaborate with cross-functional teams to understand data requirements, architect scalable data pipelines, and ensure the...

  • Architect : Big Data (Digital Natives / Enterprise)

    1 month ago

    Delhi, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Azure Databricks Pyspark Developer

    1 month ago

    delhi, India Tredence Inc. Full time

    MUST HAVE• Minimum of 4 to 8 years of Azure DE experience.• In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc.• Experience in collaborating with business stakeholders to identify and meet data requirements• Experience in using Azure services and tools to ingest, egress, and transform data from...

  • Architect : Big Data

    1 week ago

    New Delhi, India Databricks Full time

    As aSolutions Architect(Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be atechnical advisorinternally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible...

  • Azure Data Engineer

    1 month ago

    Delhi, India YALLO Retail Full time

    Role Type:ContractLocation:RemoteDuration:6monthsStart:ASAPAs an Azure Data Engineer, you will play a crucial role in designing, developing, and maintaining data engineering solutions on the Azure cloud platform. You will collaborate with cross-functional teams to understand data requirements, architect scalable data pipelines, and ensure the integrity and...

  • Azure Data Engineer

    3 weeks ago

    delhi, India Direct Client Full time

    Azure Data Engineer - Fivetran or Snowflake SpecialistBengaluru, Data & AnalyticsJOB DESCRIPTION1. Design, develop, and deploy data pipelines and workflows using Fivetran or Snowflake on the Azure platform.2. Collaborate with business stakeholders to gather data requirements and translate them into technical specifications and Configure and customize...

  • Architect : Big Data

    2 weeks ago

    New Delhi, India Databricks Full time

    As a Solutions Architect (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible...

  • Architect : Big Data

    2 weeks ago

    new delhi, India Databricks Full time

    As a Solutions Architect (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible...

  • Senior Azure Data Engineer

    1 week ago

    delhi, India Adecco Full time

    Find your next role with Adecco! We are currently recruiting for Senior Azure Data Engineer for our leading client based out of Hyderabad, Bangalore, Pune (India)Role: Senior Azure Data EngineerYears of Experience: 5+ YearsLocation: Hyderabad, Bangalore, Pune (India).Notice Period: - Immediate to 30 DaysJob Description: -Expertise in data ingestion,...