Data Engineering Azure databricks

2 weeks ago

Delhi, India EXL Full time

Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders.Responsibilities:- Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.- Create the data integration and data diagram documentation.- Lead the data validation, UAT and regression test for new data asset creation.- Create and maintain data models, including schema design and optimization.- Create and manage data pipelines that automate the flow of data, ensuring data quality and consistency.Qualifications and Skills:- Strong knowledge on Python and Pyspark- Expectation is to have ability to write Pyspark scripts for developing data workflows.- Strong knowledge on SQL, Hadoop, Hive, Azure, Databricks and Greenplum- Expectation is to write SQL to query metadata and tables from different data management system such as, Oracle, Hive, Databricks and Greenplum.- Familiarity with big data technologies like Hadoop, Spark, and distributed computing frameworks.- Expectation is to use Hue and run Hive SQL queries, schedule Apache Oozie jobs to automate the data workflows.- Good working experience of communicating with the stakeholders and collaborate effectively with the business team for data testing.- Expectation is to have strong problem-solving and troubleshooting skills.- Expectation is to establish comprehensive data quality test cases, procedures and implement automated data validation processes.- Degree in Data Science, Statistics, Computer Science or other related fields or an equivalent combination of education and experience.- 4-7 years of experience in Data Engineer.- Proficiency in programming languages commonly used in data engineering, such as Python, Pyspark, SQL.- Experience in Azure cloud computing platform, such as developing ETL processes using Azure Data Factory, big data processing and analytics with Azure Databricks.- Strong communication, problem solving and analytical skills with the ability to do time management and multi-tasking with attention to detail and accuracy.

  • Azure Data Engineer – Databricks

    2 weeks ago

    New Delhi, India Tata Consultancy Services Full time

    Role:Azure Data Engineer – Databricks Location: PAN INDIA Experience: 6 to 8 Years Required Technical Skill Set** Data Lake architecture, Azure Services – ADLS, ADF, Azure Databricks, Synapse Must-Have**Build the solution for optimal extraction, transformation, and loading of data from a wide variety of data sources using Azure data ingestion and...

  • Data Engineer – Databricks

    3 weeks ago

    New Delhi, India Capgemini Engineering Full time

    Data Engineer – Databricks & PySparkLocation: BangaloreExperience: 6–9 yearsChoosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in helping leading Consumer Products and Retail Services (CPRS) organizations unlock the...

  • Data Engineering Azure databricks

    4 weeks ago

    New Delhi, India EXL Full time

    Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders.Responsibilities:- Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes. - Create the data integration and data diagram documentation....

  • Azure Data Engineer – Databricks

    5 days ago

    New Delhi, India Tata Consultancy Services Full time

    Role: Azure Data Engineer – DatabricksLocation: PAN INDIAExperience: 6 to 8 YearsRequired Technical Skill Set**Data Lake architecture, Azure Services – ADLS, ADF, Azure Databricks, SynapseMust-Have**- Build the solution for optimal extraction, transformation, and loading of data from a wide variety of data sources using Azure data ingestion and...

  • Data Engineer | Azure + Databricks

    3 weeks ago

    New Delhi, India Xebia Full time

    Job Opportunity – Data Engineer | Azure + DatabricksLocation: Bangalore (Whitefield) | Hybrid (3 days office/week)Experience: 6+ yearsNotice Period: Immediate to 2 weeks – only apply if you can join earlyAbout the Role:We are looking for a skilled Data Engineer to join our team, working on end-to-end data engineering and data science use cases. The ideal...

  • Data Engineer | Azure + Databricks

    2 weeks ago

    New Delhi, India Xebia Full time

    Job Opportunity – Data Engineer | Azure + DatabricksLocation:Bangalore (Whitefield) | Hybrid (3 days office/week) Experience:6+ years Notice Period:Immediate to 2 weeks – only apply if you can join earlyAbout the Role: We are looking for a skilledData Engineerto join our team, working onend-to-end data engineering and data science use cases . The ideal...

  • Azure Databricks Engineer

    4 weeks ago

    Delhi, India Tata Consultancy Services Full time

    Role : Azure Databricks EngineerRequired Technical Skill Set : Azure Databricks,PysparkExperience : 4 to 10 yearsLocation : Hyderabad, Kolkata, Noida, Chennai & BengaluruJob Description :Desired Competencies (Technical/Behavioral Competency)Must-Have :-1. Azure Data Bricks (Python)2. Pyspark3. ADLS4. complex problem solving skill.Good-to-Have :-Azure...

  • Azure Databricks Data Engineer

    7 days ago

    New Delhi, India Tata Consultancy Services Full time

    Greetings from TCS!!!Job Role: Azure Databricks Data Engineer Desired Experience: 5-8 Years Job Location: BengaluruJob Description:Minimum 5+ years of development experience in Azure. Must have “Data Warehouse / Data Lake” development experience. Must have “Azure Data Factory (ADF) & Azure SQL DB” Must have “Azure Data Bricks” experience using...

  • Senior Azure Databricks Engineer

    4 weeks ago

    New Delhi, India MLAI Digital Private Ltd. Full time

    Company DescriptionMLAI_Digital is a GenAI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.Offices in US(ohio),Singapore(PTE), Malaysia , Indiaand Australia(MEL)Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial TransactionsRole...

  • Azure Databricks Admin

    7 days ago

    Delhi, India Greymatter Innovationz Full time

    Greymatter Innovationz helps you stay digitally relevant across domains, technologies, and skillsets, every day. We are looking for: Azure Databricks Admin Location: Anywhere in India/ Bangalore preferred Duration: FTE Databricks Platform Support and capability enhancement: • Provide technical support for Databricks, addressing issues related to...