Azure Big Data Engineer

3 weeks ago

bangalore, India Tiger Analytics Full time
Location- Chennai, Bangalore & Hyderabad
As an Azure BDE Senior Data Engineer, you will
the design and implementation of data management (Data Lake / Lakehouse/ Data Mesh) solution on the Azure cloud using PaaS services,
with Architects in brainstorming, design patterns, doing POCs, implementation of the solution adhering to the defined architecture and standards.
collaborate with a team of data engineers in designing frameworks, pipelines for ingestion, integration, data quality, deriving metrics for serving layer.
requirements analysis, design, delegating work, creating code templates, troubleshooting, performing code review and deployments.
with a team of business domain experts, data scientists and application developers to develop solutions.
and learn new technologies for creative business problem solving and mentor a team of Data Engineers.
Skillset expectation:
hands-on experience in implementing data lake using technologies such as Databricks Spark, Data Factory, Azure Data Lake
programming skills in Python/Scala, Pyspark, SQL
in implementing complex design for data ingestion, data transformation, handling batch, micro-batch, streaming pipelines, event-driven processing, deriving metrics, applying data harmonization, building data marts and aggregate layers.
to understand data (attributes, metrics), relate to reporting/analytical use-cases of various business functions at a high-level and include those nuances in the design for scalability, availability.
in analyzing code, modularized design, coding best practices, code review, test strategies, code review, troubleshooting and performance optimization.
with Architect in implementing governance layer to manage data quality, data catalog, data lineage and data security.
in setting up consumption layer and serving data assets in a secure way for BI reporting, Adhoc analytics, DS/ML use-cases and external users.
to upskill, experiment quickly for creating POCs / Prototypes when evaluating new features, design patterns, adopting open-source frameworks and building custom solution.
to integrate DevOps, CI-CD branching strategies, deployments for code components developed in Data factory, Databricks, Functions etc.,
6+years of technical experience with at least 4 years on MS Azure and Big data technologies.

  • Azure Big Data Engineer

    3 weeks ago

    bangalore, India Tiger Analytics Full time

    Job Description Tiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, our + tribe is solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a team-first mindset. Headquartered in Silicon Valley, you’ll find our...

  • Azure Big Data Architect

    3 weeks ago

    bangalore, India Tiger Analytics Full time

    Job Description Tiger Analytics is a global analytics consulting firm. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modeled around expertise and mutual respect with a team first mindset. Working at Tiger, you’ll be at the heart of this AI revolution. You’ll work...

  • Azure Big Data Specialist

    2 months ago

    bangalore, India Global Pharma Tek Full time

    REQ – – REFQ Azure Big Data Specialist No Industrial Layout Hosur Road Koramangala, Bengaluru, in Full-time Legal Entity: Bosch Global Software Technologies Private Limited Company Description Bosch Global Software Technologies Private Limited is a % owned subsidiary of Robert Bosch GmbH, one of the world's leading global...

  • Publicis Sapient

    1 month ago

    bangalore, India Publicis Sapient Full time

    Job Description : As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation &...

  • Big Data Engineer

    2 months ago

    bangalore, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with...

  • Big Data Engineer

    3 weeks ago

    bangalore, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with...

  • Thoucentric - Azure Data Engineer - Big Data Technologies

    4 weeks ago

    Bangalore, Karnataka, India Thoucentric Technology Pvt. Ltd. Full time

    Job Description :Roles & Responsibilities :- Implement robust data pipeline using Microsoft Stack.- Create reusable and scalable data pipelines.- Development and deployment of new data platforms.- Leverage Azure BI services for development of Big Data Platforms.- Work closely with the Product Owners and Architects to develop Azure Data Platforms.- Work with...

  • Thoucentric - Azure Data Engineer - Big Data Technologies

    3 weeks ago

    Bangalore, India Thoucentric Technology Pvt. Ltd. Full time

    Job Description : Roles & Responsibilities : - Implement robust data pipeline using Microsoft Stack. - Create reusable and scalable data pipelines. - Development and deployment of new data platforms. - Leverage Azure BI services for development of Big Data Platforms. - Work closely with the Product Owners and Architects to develop Azure Data Platforms....

  • Thoucentric - Azure Data Engineer - Big Data Technologies

    4 weeks ago

    bangalore, India Thoucentric Technology Pvt. Ltd. Full time

    Job Description : Roles & Responsibilities : - Implement robust data pipeline using Microsoft Stack. - Create reusable and scalable data pipelines. - Development and deployment of new data platforms. - Leverage Azure BI services for development of Big Data Platforms. - Work closely with the Product Owners and Architects to develop Azure Data Platforms....

  • Thoucentric - Azure Data Engineer - Big Data Technologies

    4 weeks ago

    Bangalore, India Thoucentric Technology Pvt. Ltd. Full time

    Job Description : Roles & Responsibilities : - Implement robust data pipeline using Microsoft Stack. - Create reusable and scalable data pipelines. - Development and deployment of new data platforms. - Leverage Azure BI services for development of Big Data Platforms. - Work closely with the Product Owners and Architects to develop Azure Data Platforms....

  • Thoucentric - Azure Data Engineer - Big Data Technologies

    3 weeks ago

    Bangalore, Karnataka, India Thoucentric Technology Pvt. Ltd. Full time

    Job Description :Roles & Responsibilities :- Implement robust data pipeline using Microsoft Stack.- Create reusable and scalable data pipelines.- Development and deployment of new data platforms.- Leverage Azure BI services for development of Big Data Platforms.- Work closely with the Product Owners and Architects to develop Azure Data Platforms.- Work with...

  • Azure Data Engineer/Senior Azure Data Engineer

    2 months ago

    bangalore, India Saaki Argus & Averil Consulting Full time

    About the Client: Our client is focused on AI and Analytics. Skills and Qualifications: Bachelors or Masters degree in computer science or equivalent 4 to 9 years of total IT experience with 2+ years in big data engineering and Microsoft Azure Hands on experience in SQL, python and Spark (pyspark), Big Data. Experience in Azure Databricks, Azure...

  • Senior Azure Big Data Engineer

    2 months ago

    bangalore, India Onward Technologies Full time

    Onward Technologies is looking for Senior Azure Big Data Engineer The Role You will be responsible for : Developing scripts to process structured and unstructured data. Recommending, developing and implementing ways to improve data reliability, efficiency and quality. Supporting translation of data business needs into technical system requirements....

  • Senior Azure Big Data Engineer

    2 months ago

    bangalore, India Snaphunt Full time

    The Offer Work within a company with a solid track record of success Work alongside & learn from best in class talent Excellent career development opportunities The Job You will be responsible for : Developing scripts to process structured and unstructured data. Recommending, developing and implementing ways to improve data reliability, efficiency and...

  • Senior Azure Big Data Engineer

    3 weeks ago

    bangalore, India Onward Technologies Full time

    Onward Technologies is looking for Senior Azure Big Data Engineer The Role You will be responsible for : Developing scripts to process structured and unstructured data. Recommending, developing and implementing ways to improve data reliability, efficiency and quality. Supporting translation of data business needs into technical system requirements....

  • Senior Azure Big Data Engineer

    3 weeks ago

    bangalore, India Snaphunt Full time

    The Offer Work within a company with a solid track record of success Work alongside & learn from best in class talent Excellent career development opportunities The Job You will be responsible for : Developing scripts to process structured and unstructured data. Recommending, developing and implementing ways to improve data reliability, efficiency and...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’...

  • Azure Data Architect/ Data Engineer with Databricks

    2 months ago

    bangalore, India MNC Full time

    Hi AllUrgent hiring for Azure Data Architect/ Data Engineer with Databricks with MNC for Pan India :Experience: 5 - 12 YrsJob Title Azure Data engineer with DatabricksRelevant Experience &Experience Required(in Yrs) 6+ yearsKey words to search inresume Azure Data Services, and Data BricksTechnical/Functional Skills -MUST HAVE SKILLS · The Engineer with...

  • Big Data Engineer

    4 weeks ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: June 02, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    4 weeks ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 30, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...