Azure Big Data Engineer

3 weeks ago


bangalore, India Tiger Analytics Full time

Job Description

Tiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, our + tribe is solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a team-first mindset. Headquartered in Silicon Valley, you’ll find our delivery centers across the globe and offices in multiple cities across India, the US, UK, Canada, and Singapore, including a
substantial remote global workforce.We’re Great Place to Work-Certified™. Working at Tiger Analytics, you’ll be at the heart of an AI revolution. You’ll work with teams that push the boundaries of what is possible and build solutions that energize and inspire. Job Title: Azure Big Data Engineer Chennai | Hyderabad|Bangalore Curious about the role?What your typical day would look like? As a Big Data Engineer (Azure) , you will build and learn about a variety of analytics solutions & platforms, data lakes, modern data platforms, data fabric solutions, etc. using different Open Source, Big Data, and Cloud technologies on Microsoft Azure. On a typical day, you might● Design and build scalable & metadata-driven data ingestion pipelines (For Batch and Streaming Datasets)● Conceptualize and execute high-performance data processing for structured and unstructured data, and data
harmonization● Schedule, orchestrate, and validate pipelines● Design exception handling and log monitoring for debugging● Ideate with your peers to make tech stack and tools-related decisions● Interact and collaborate with multiple teams (Consulting/Data Science & App Dev) and various stakeholders to meet deadlines, to bring Analytical Solutions to life. What do we expect? ● 4 to 9 years of total IT experience with 2+ years in big data engineering and Microsoft Azure● Experience in implementing Data Lake with technologies like Azure Data Factory (ADF), PySpark, Databricks, ADLS,
Azure SQL Database● A comprehensive foundation with working knowledge of Azure Synapse Analytics, Event Hub & Streaming
Analytics, Cosmos DB, and Purview● A passion for writing high-quality code and the code should be modular, scalable, and free of bugs (debugging
skills in SQL, Python, or Scala/Java).● Enthuse to collaborate with various stakeholders across the organization and take complete ownership of
 deliverables.● Experience in using big data technologies like Hadoop, Spark, Airflow, NiFi, Kafka, Hive, Neo4J, Elastic Search● Adept understanding of different file formats like Delta Lake, Avro, Parquet, JSON, and CSV● Good knowledge of building and designing REST APIs with real-time experience working on Data Lake or
Lakehouse projects.● Experience in supporting BI and Data Science teams in consuming the data in a secure and governed manner● Certifications like Data Engineering on Microsoft Azure (DP-) or Databricks Certified Developer (DE) are
valuable addition. You are important to us, let’s stay connected Every individual comes with a different set of skills and qualities so even if you don’t tick all the boxes for the role today we urge you to apply as there might be a suitable/unique role for you tomorrow.We are an equal-opportunity employer. Our diverse and inclusive culture and values guide us to listen, trust,respect, and encourage people to grow the way they desire.Note: The designation will be commensurate with expertise and experience. Compensation packages are among the best in the industry.Job Requirement Mandatory : Azure Data Factory (ADF), PySpark, Databricks, ADLS, Azure SQL Database Optional: Azure Synapse Analytics, Event Hub & Streaming Analytics, Cosmos DB and Purview. Strong programming, unit testing & debugging skills in SQL, Python or Scala/Java. Some experience of using big data technologies like Hadoop, Spark, Airflow, NiFi, Kafka, Hive, Neo4J, Elastic
Search. Good Understanding of different file formats like Delta Lake, Avro, Parquet, JSON and CSV. Experience of working in Agile projects and following DevOps processes with technologies like Git, Jenkins & Azure DevOps. Good to have: Experience of working on Data Lake & Lakehouse projects Experience of building REST services and implementing service-oriented architectures. Experience of supporting BI and Data Science teams in consuming the data in a secure and governed manner. Certifications like Data Engineering on Microsoft Azure (DP-) or Databricks Certified Developer (DE)

  • bangalore, India Tiger Analytics Full time

    Location- Chennai, Bangalore & HyderabadAs an Azure BDE Senior Data Engineer, you willthe design and implementation of data management (Data Lake / Lakehouse/ Data Mesh) solution on the Azure cloud using PaaS services,with Architects in brainstorming, design patterns, doing POCs, implementation of the solution adhering to the defined architecture and...


  • bangalore, India Tiger Analytics Full time

    Job Description Tiger Analytics is a global analytics consulting firm. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modeled around expertise and mutual respect with a team first mindset. Working at Tiger, you’ll be at the heart of this AI revolution. You’ll work...


  • bangalore, India Global Pharma Tek Full time

    REQ – – REFQ Azure Big Data Specialist No Industrial Layout Hosur Road Koramangala, Bengaluru, in Full-time Legal Entity: Bosch Global Software Technologies Private Limited Company Description Bosch Global Software Technologies Private Limited is a % owned subsidiary of Robert Bosch GmbH, one of the world's leading global...

  • Publicis Sapient

    4 weeks ago


    bangalore, India Publicis Sapient Full time

    Job Description : As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation &...

  • Big Data Engineer

    2 months ago


    bangalore, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with...

  • Big Data Engineer

    3 weeks ago


    bangalore, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with...


  • bangalore, India Saaki Argus & Averil Consulting Full time

    About the Client: Our client is focused on AI and Analytics. Skills and Qualifications: Bachelors or Masters degree in computer science or equivalent 4 to 9 years of total IT experience with 2+ years in big data engineering and Microsoft Azure Hands on experience in SQL, python and Spark (pyspark), Big Data. Experience in Azure Databricks, Azure...


  • Bangalore, India Thoucentric Technology Pvt. Ltd. Full time

    Job Description : Roles & Responsibilities : - Implement robust data pipeline using Microsoft Stack. - Create reusable and scalable data pipelines. - Development and deployment of new data platforms. - Leverage Azure BI services for development of Big Data Platforms. - Work closely with the Product Owners and Architects to develop Azure Data Platforms....


  • Bangalore, India Thoucentric Technology Pvt. Ltd. Full time

    Job Description : Roles & Responsibilities : - Implement robust data pipeline using Microsoft Stack. - Create reusable and scalable data pipelines. - Development and deployment of new data platforms. - Leverage Azure BI services for development of Big Data Platforms. - Work closely with the Product Owners and Architects to develop Azure Data Platforms....


  • Bangalore, Karnataka, India Thoucentric Technology Pvt. Ltd. Full time

    Job Description :Roles & Responsibilities :- Implement robust data pipeline using Microsoft Stack.- Create reusable and scalable data pipelines.- Development and deployment of new data platforms.- Leverage Azure BI services for development of Big Data Platforms.- Work closely with the Product Owners and Architects to develop Azure Data Platforms.- Work with...


  • bangalore, India Thoucentric Technology Pvt. Ltd. Full time

    Job Description : Roles & Responsibilities : - Implement robust data pipeline using Microsoft Stack. - Create reusable and scalable data pipelines. - Development and deployment of new data platforms. - Leverage Azure BI services for development of Big Data Platforms. - Work closely with the Product Owners and Architects to develop Azure Data Platforms....


  • Bangalore, Karnataka, India Thoucentric Technology Pvt. Ltd. Full time

    Job Description :Roles & Responsibilities :- Implement robust data pipeline using Microsoft Stack.- Create reusable and scalable data pipelines.- Development and deployment of new data platforms.- Leverage Azure BI services for development of Big Data Platforms.- Work closely with the Product Owners and Architects to develop Azure Data Platforms.- Work with...


  • bangalore, India Snaphunt Full time

    The Offer Work within a company with a solid track record of success Work alongside & learn from best in class talent Excellent career development opportunities The Job You will be responsible for : Developing scripts to process structured and unstructured data. Recommending, developing and implementing ways to improve data reliability, efficiency and...


  • bangalore, India Onward Technologies Full time

    Onward Technologies is looking for Senior Azure Big Data Engineer The Role You will be responsible for : Developing scripts to process structured and unstructured data. Recommending, developing and implementing ways to improve data reliability, efficiency and quality. Supporting translation of data business needs into technical system requirements....


  • bangalore, India Onward Technologies Full time

    Onward Technologies is looking for Senior Azure Big Data Engineer The Role You will be responsible for : Developing scripts to process structured and unstructured data. Recommending, developing and implementing ways to improve data reliability, efficiency and quality. Supporting translation of data business needs into technical system requirements....


  • bangalore, India Snaphunt Full time

    The Offer Work within a company with a solid track record of success Work alongside & learn from best in class talent Excellent career development opportunities The Job You will be responsible for : Developing scripts to process structured and unstructured data. Recommending, developing and implementing ways to improve data reliability, efficiency and...


  • bangalore, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’...


  • bangalore, India MNC Full time

    Hi AllUrgent hiring for Azure Data Architect/ Data Engineer with Databricks with MNC for Pan India :Experience: 5 - 12 YrsJob Title Azure Data engineer with DatabricksRelevant Experience &Experience Required(in Yrs) 6+ yearsKey words to search inresume Azure Data Services, and Data BricksTechnical/Functional Skills -MUST HAVE SKILLS · The Engineer with...

  • Big Data Engineer

    1 month ago


    bangalore, India Infogain Full time

    Big Data Engineer (Senior) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 24, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES · Strong experience of overall 9 to 12 years of experience as a data...

  • Big Data Engineer

    4 weeks ago


    bangalore, India Infogain Full time

    Big Data Engineer (Senior) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 26, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES · Strong experience of overall 9 to 12 years of experience as a data...