Azure Big Data Engineer

2 weeks ago


Bengaluru, India Tiger Analytics Full time

Location- Chennai, Bangalore & Hyderabad

As an Azure BDE Senior Data Engineer, you will

  • the design and implementation of data management (Data Lake / Lakehouse/ Data Mesh) solution on the Azure cloud using PaaS services,
  • with Architects in brainstorming, design patterns, doing POCs, implementation of the solution adhering to the defined architecture and standards.
  • collaborate with a team of data engineers in designing frameworks, pipelines for ingestion, integration, data quality, deriving metrics for serving layer.
  • requirements analysis, design, delegating work, creating code templates, troubleshooting, performing code review and deployments.
  • with a team of business domain experts, data scientists and application developers to develop solutions.
  • and learn new technologies for creative business problem solving and mentor a team of Data Engineers.

Skillset expectation:

  • hands-on experience in implementing data lake using technologies such as Databricks Spark, Data Factory, Azure Data Lake
  • programming skills in Python/Scala, Pyspark, SQL
  • in implementing complex design for data ingestion, data transformation, handling batch, micro-batch, streaming pipelines, event-driven processing, deriving metrics, applying data harmonization, building data marts and aggregate layers.
  • to understand data (attributes, metrics), relate to reporting/analytical use-cases of various business functions at a high-level and include those nuances in the design for scalability, availability.
  • in analyzing code, modularized design, coding best practices, code review, test strategies, code review, troubleshooting and performance optimization.
  • with Architect in implementing governance layer to manage data quality, data catalog, data lineage and data security.
  • in setting up consumption layer and serving data assets in a secure way for BI reporting, Adhoc analytics, DS/ML use-cases and external users.
  • to upskill, experiment quickly for creating POCs / Prototypes when evaluating new features, design patterns, adopting open-source frameworks and building custom solution.
  • to integrate DevOps, CI-CD branching strategies, deployments for code components developed in Data factory, Databricks, Functions etc.,
  • 6+years of technical experience with at least 4 years on MS Azure and Big data technologies.



  • Bengaluru, India Wissen Infotech Full time

    Hi All,Greeting from Wissen!!Wissen Infotech is hiring Senior Azure Big Data Engineer, below are the details.Role: Senior Azure Big Data EngineerExperience: 8-12yearsWork Location: BangaloreMode of work: HybridNotice period: Immediate - 2weeksMandatory Skills: Azure SQL/T-SQL, Azure Data Factory, Data Bricks, Synapse , SparkCore, PySpark, Scala, Hive, Hbase,...


  • Bengaluru, India Wissen Infotech Full time

    Hi All, Greeting from Wissen!! Wissen Infotech is hiring Senior Azure Big Data Engineer, below are the details. Role: Senior Azure Big Data Engineer Experience: 8-12years Work Location: Bangalore Mode of work: Hybrid Notice period: Immediate - 2weeks Mandatory Skills: Azure SQL/T-SQL, Azure Data Factory, Data Bricks, Synapse , SparkCore, PySpark, Scala,...


  • Bengaluru, India Wissen Infotech Full time

    Hi All,Greeting from Wissen!!Wissen Infotech is hiring Senior Azure Big Data Engineer, below are the details.Role: Senior Azure Big Data EngineerExperience: 8-12yearsWork Location: BangaloreMode of work: HybridNotice period: Immediate - 2weeksMandatory Skills: Azure SQL/T-SQL, Azure Data Factory, Data Bricks, Synapse , SparkCore, PySpark, Scala, Hive, Hbase,...


  • Bengaluru, India Tiger Analytics Full time

    Location- Chennai, Bangalore & HyderabadAs an Azure BDE Senior Data Engineer, you will- the design and implementation of data management (Data Lake / Lakehouse/ Data Mesh) solution on the Azure cloud using PaaS services,- with Architects in brainstorming, design patterns, doing POCs, implementation of the solution adhering to the defined architecture and...


  • Bengaluru, India Tiger Analytics Full time

    Location- Chennai, Bangalore & HyderabadAs an Azure BDE Senior Data Engineer, you willthe design and implementation of data management (Data Lake / Lakehouse/ Data Mesh) solution on the Azure cloud using PaaS services,with Architects in brainstorming, design patterns, doing POCs, implementation of the solution adhering to the defined architecture and...


  • Bengaluru, India Tiger Analytics Full time

    Location- Chennai, Bangalore & Hyderabad As an Azure BDE Senior Data Engineer, you will the design and implementation of data management (Data Lake / Lakehouse/ Data Mesh) solution on the Azure cloud using PaaS services, with Architects in brainstorming, design patterns, doing POCs, implementation of the solution adhering to the defined architecture and...


  • Bengaluru, India Tiger Analytics Full time

    Location- Chennai, Bangalore & HyderabadAs an Azure BDE Senior Data Engineer, you willthe design and implementation of data management (Data Lake / Lakehouse/ Data Mesh) solution on the Azure cloud using PaaS services,with Architects in brainstorming, design patterns, doing POCs, implementation of the solution adhering to the defined architecture and...


  • Bengaluru, India Global Pharma Tek Full time

    REQ – – REFQAzure Big Data SpecialistNo Industrial Layout Hosur Road Koramangala, Bengaluru, inFull-timeLegal Entity: Bosch Global Software Technologies Private LimitedCompany DescriptionBosch Global Software Technologies Private Limitedis a % owned subsidiary of Robert Bosch GmbH, one of the world's leading global supplier of technology and services,...


  • Bengaluru, India Global Pharma Tek Full time

    REQ – – REFQ Azure Big Data Specialist No Industrial Layout Hosur Road Koramangala, Bengaluru, in Full-time Legal Entity: Bosch Global Software Technologies Private Limited Company Description Bosch Global Software Technologies Private Limited is a % owned subsidiary of Robert Bosch GmbH, one of the world's leading global supplier of...

  • Big Data Engineer

    1 month ago


    Bengaluru, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with various...

  • Big Data Engineer

    3 weeks ago


    Bengaluru, India Hexaware Technologies Full time

    DescriptionData Engineer:Primary : ADF, SQLSeconday : Databricks, Pyspark / Scala, CICD, Data Security, encryptionResponsibilities:•Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned.•Provide support in defining the scope and sizing of the work.•Working closely with various enterprise architects,...


  • Bengaluru, India Onward Technologies Full time

    Onward Technologies is looking for Senior Azure Big Data EngineerThe RoleYou will be responsible for :Developing scripts to process structured and unstructured data.Recommending, developing and implementing ways to improve data reliability, efficiency and quality.Supporting translation of data business needs into technical system requirements.Working with...

  • Azure data engineer

    1 month ago


    Bengaluru, India LTIMindtree Full time

    • Experience in Synapase with pyspark. • Knowledge of Big Data pipelines/Data Engineering. • Working Knowledge on MSBI stack on Azure. • Working Knowledge on Azure Data factory, Azure Data Lake and Azure Data lake storage. • Hands-on in Visualization like PowerBI. • Implement end-end data pipelines using cosmos/Azure Data factory. • Should have...

  • Azure data engineer

    1 month ago


    Bengaluru, India LTIMindtree Full time

    • Experience in Synapase with pyspark. • Knowledge of Big Data pipelines/Data Engineering. • Working Knowledge on MSBI stack on Azure. • Working Knowledge on Azure Data factory, Azure Data Lake and Azure Data lake storage. • Hands-on in Visualization like PowerBI. • Implement end-end data pipelines using cosmos/Azure Data factory. • Should have...

  • Azure data engineer

    1 month ago


    Bengaluru, India LTIMindtree Full time

    • Experience in Synapase with pyspark. • Knowledge of Big Data pipelines/Data Engineering. • Working Knowledge on MSBI stack on Azure. • Working Knowledge on Azure Data factory, Azure Data Lake and Azure Data lake storage. • Hands-on in Visualization like PowerBI. • Implement end-end data pipelines using cosmos/Azure Data factory. • Should have...


  • Bengaluru, India Saaki Argus & Averil Consulting Full time

    About the Client:Our client is focused on AI and Analytics.Skills and Qualifications:Bachelors or Masters degree in computer science or equivalent4 to 9 years of total IT experience with 2+ years in big data engineering and Microsoft AzureHands on experience in SQL, python and Spark (pyspark), Big Data.Experience in Azure Databricks, Azure Data...


  • Bengaluru, India Snaphunt Full time

    The OfferWork within a company with a solid track record of successWork alongside & learn from best in class talentExcellent career development opportunitiesThe JobYou will be responsible for :Developing scripts to process structured and unstructured data.Recommending, developing and implementing ways to improve data reliability, efficiency and...

  • Big Data Engineer

    1 day ago


    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: May 14, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESResponsibilities:· Strong experience ofminimum 5+ years in Snowflake & Snowpipehaving over all 9 to 12...

  • Big Data Engineer

    11 hours ago


    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: May 16, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESResponsibilities:· Strong experience ofminimum 5+ years in Snowflake & Snowpipehaving over all 9 to 12...


  • Bengaluru, India Snaphunt Full time

    The OfferWork within a company with a solid track record of successWork alongside & learn from best in class talentExcellent career development opportunitiesThe Job You will be responsible for : Developing scripts to process structured and unstructured data.Recommending, developing and implementing ways to improve data reliability, efficiency and...