Senior Azure Data Engineering Manager

3 weeks ago


Bangalore, Karnataka, India OSBIndia Private Limited Full time

Experience Requirements :

- Overall 12-15 years of IT experience preferably in Data and Analytics implementation.

- 7-8 years of Data engineering (Both On-prem and Azure) delivery experience including Architecture / analysis / development / configuration/ deployment.

- 4-5 years of implementation experience in Azure Data engineering projects.

- Mandatory to have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end Big Data solutions on Azure Cloud.

- Expert in Python/SQL/SparkSQL/PySpark.

- Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, Datra bricks, perview and Azure App Service is required.

- Extensive hands-on experience implementing data migration and data processing using Azure services: Serverless Architecture, Azure Storage, Azure SQL DB/DW, Data Factory, Azure Stream Analytics, Azure Analysis Service, Databricks Azure Data Catalog, Cosmos Db, Azure Functions, ARM Templates, Azure DevOps, CI/CD etc.

- Expert in at least one distributed data processing framework: Spark (Core, Streaming, SQL), Storm or Flink, etc.

- Expert in distributed messaging and ingestion frameworks (Kafka, Pulsar, Pub/Sub, etc) and good to know traditional ETL tools like Informatica, SSIS, etc.

- Should have worked on any NoSQL solutions like Mongo DB, Cassandra, HBase, Cosmos DB etc, or Cloud-based NoSQL offerings like DynamoDB, Big Table, etc.

- Good Exposure in development with CI / CD pipelines.

- Knowledge of containerization, orchestration, and Kubernetes engine would be an added advantage.

- Designing and building of data pipelines using API ingestion and Streaming ingestion methods.

- Knowledge in Azure Databricks, Azure IoT, Azure HDInsight + Spark, Azure Stream Analytics, Power BI is desirable.

- Strong problem solving and troubleshooting skills.

- Experience in working in a fast-paced agile environment.

- Proven experience in People management, hiring and capability building.

- Strong experience in common data warehouse modelling principles including Kimball, Inmon.

- Experience with data visualization tools such as Power BI.

- Experience in Streaming and batch architecture (e.g, Kafka, Kafka streams, Spark, Flink).

Knowledge Requirements :

- Excellent understanding of data technologies landscape/ecosystem (Both On-prem and Cloud).

- Detailed knowledge of Software development and Application Architecture is essential.

- Detailed knowledge of SQL (Structured Query Language) programming is essential.

- Proven experience in business and technical problem-solving skills is essential.

- Proven ability to build, manage and foster a team-oriented environment.

- Proven ability to work creatively and analytically in a problem-solving environment.

- Excellent communication (written and oral) and interpersonal skills.

- Excellent leadership and management skills.

- Excellent organizational, multi-tasking, and time-management skills.

(ref:hirist.tech)
  • Senior Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Syscort Full time

    Job Title : Senior Data Engineer. Timeline : Immediate only. Experience : 8+Years. Location : Bangalore.Mandatory Required Qualification : - Strong proficiency in Azure services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Storage, etc. - Expertise in DevOps and CI/CD implementation. - Excellent Communication Skills. In This...

  • Senior Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    Job Description :We are seeking a highly skilled Senior Data Engineer with extensive experience in Azure Data Factory (ADF) and Snowflake. The ideal candidate will have a strong background in data warehousing, ETL processes, and cloud platforms, particularly Azure. The role involves working with US-based clients and requires excellent technical and...


  • Bangalore, Karnataka, India xanika infotech Full time

    Position : Senior Data Engineer-ADFExperience : 8+ YearsLocation : Bangalore-Kalyan NagarMode : Work from officeEducation : Bachelor's/Master's in Computer's or :8+ years of Hands-on experience in SQL and 5+ yrs of experience in ADF to manipulate data, implement database-driven solutions, build applications and data integration.As an architect we...

  • Senior Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India HAD Recruitment Services Full time

    Responsibilities :- Design, develop, and maintain robust data pipelines and architectures on the Azure platform.- Utilize Azure Data Services (Azure Data Factory, Azure SQL Database, Azure Data Lake) to extract, transform, and load (ETL) data from various sources.- Create and optimize data pipelines for efficient data ingestion, processing, and analysis.-...

  • Senior Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India SARVAJITH INFOTECH Full time

    Role : Senior Data Engineer. Experience : 6 yrs to 8 yrsLocation : Bangalore Candidates OnlyWork : HybridJob Description :Here is a list of mandatory skills based1. Azure Data Services :- Azure Data Factory- Azure SQL Database- Azure Data Lake(4-5 years' hands-on project experience)2. Power BI (PBI) :(4-5 years' hands-on project experience)3. Data...

  • Senior Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India MonoSpear Technologies Pvt Ltd Full time

    Senior Data Engineer :- 9+ years' work experience and bachelor's degree in Information Science, Computer Science, Mathematics, Statistics or a quantitative discipline in science, business, or social science.- Hands-on engineer who is curious about technology, should be able to quickly adopt to change and one who understands the technologies...

  • Azure Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Softpath Technologies LLC Full time

    Job Description :In your role as an Azure Data Engineer, you will be responsible for expanding and optimising data and pipeline architectures, and for optimising data collection and flow across functional teams. Your responsibilities include assisting software developers, database architects, data analysts, and data scientists with data initiatives and...

  • Azure Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking an experienced Azure Data Engineer to join our team. Job Title : Azure Data EngineerLocation : : 3+ Years The ideal candidate will have 3+ years of hands-on experience in Azure data services, including Azure Databricks, Azure Data Factory, Azure SQL, and Azure Data Lake. You will be responsible for designing, developing, and maintaining...

  • Data Engineer

    2 weeks ago


    Bangalore, Karnataka, India Element Infomatics Pvt. Ltd. Full time

    Position : Data Engineer Job Description :- Develop and maintain data pipelines using ADF for data extraction, transformation, and loading (ETL).- Manage data warehousing solutions on Azure, optimizing storage and performance.- Utilize Azure services like Azure Data Factory and Azure Databricks or snowflake for data processing.- Create and maintain data...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Luytens Technology Solutions Pvt. Ltd. Full time

    Job Summary : A purposeful Azure Data Engineer with over 5-7 years of experience in designing, developing, implementing, and optimizing data solutions on Microsoft Azure. Proven expertise in leveraging Azure services for ETL processes, data warehousing and analytics, ensuring optimal performance and scalability. Skills :- Azure Services: Azure SQL Database,...


  • Bangalore, Karnataka, India INSIGHT IND Full time

    Position : Azure Data FactoryMode : work from officeLocation : Bangalore-Kalyan NagarJob Description : 8+ years of hands-on experience in structured query language (SQL) and 5+ yrs of experience in ADF to manipulate data, implement database-driven solutions, build applications and data integration. As an architect we expect minimum of 2 to 3 end to end...

  • Data Engineer

    2 weeks ago


    Bangalore, Karnataka, India Recruitment Consulting firm Full time

    About the Role :We are looking for 6 Senior Data Analysts & Data Engineers at the Consultant level who are experienced with Python, Databricks, Computer Vision, SQL, and Azure. You will work on cutting-edge data engineering and analytics projects, helping build and optimize data pipelines, developing IoT integration solutions, and working with Azure Cloud...


  • Bangalore, Karnataka, India Newbies Staffing Full time

    Position Title : Senior Data EngineerExperience : 5+ YearsReporting to : Senior Vice President of Global TechnologyEducation : B.E/B.Tech (CS/IT/Data Science)Location : BangaloreWork Hours : 3PM to 12 AMEssential Duties and Responsibilities :- Design, develop, and maintain high-quality, secure data pipelines and processes to manage and transform data...


  • Bangalore, Karnataka, India HyrEzy Talent Solutions Full time

    Role : Senior Windows EngineerLocation : BangaloreWork mode : Hybrid (2-3 Days- Work from office)Working Hours : 5:00 PM IST to 2:00 AM IST (aligning with EST hours till 4:30 PM)Experience : 10-12 yearsMandatory : 10+ years of experience as a Windows Engineer or in a similar role, with a strong focus on managing Windows environments, Azure, Active Directory,...


  • Bangalore, Karnataka, India Krishna Global Services Pvt. Ltd Full time

    Skill Name : Purview Developer. Experience : 4-9 yrs. Job Location : PAN India. - 5+ years of experience as a software developer or data engineer. - Hands-on experience with Microsoft Purview (formerly Azure Information Protection and Microsoft Cloud App Security). - Proficient in C#, PowerShell, and Azure Resource Manager templates. - Strong understanding...

  • Data Engineer

    1 day ago


    Bangalore, Karnataka, India Allime Tech Solutions Full time

    Role : Data Engineer. Experience : 6 to 8Yrs. Location : Bangalore. Notice Period : Immediate Joiner. Skill : - Design, build, and maintain data pipelines using Azure Data Factory, Databricks, Snowflake, and PySpark. - Develop and implement data transformation and cleansing techniques to ensure data quality and reliability. - Collaborate with...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India PyjamaHR Full time

    Key Responsibilities : - Design and deliver scalable data solutions using Azure Data services. - Develop and implement data ingestion and transformation pipelines for large-scale environments. - Build data solutions using a wide range of tools and Azure services. - Collaborate on proof-of-concept development and production implementation. - Meet tight...


  • Bangalore/Bengaluru, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled Senior Data Engineer with a passion for working with large-scale data systems. The ideal candidate will have extensive experience in designing, developing, and maintaining robust data pipelines, with a strong focus on Azure services and technologies.Job Title : Senior Data EngineerLocation : Bangalore (Work from...

  • Infiniti Research

    3 weeks ago


    Bangalore, Karnataka, India Infiniti Research Limited Full time

    Company : Quantzig Analytics. Location : Kadubeesanahalli, Bangalore. Experience : 6+ years minimum is required. Notice : Preferably 0 to 30days. Job Description : - Seeking a self-driven professional with a strong ownership mentality and the ability to work independently without constant guidance. - The ideal candidate will have an agile mindset, capable...

  • Azure Data Engineer

    2 weeks ago


    Bangalore, Karnataka, India Blue Silicon Infotech Private Limited Full time

    Job Description :- We are looking for candidate with 3+ years of experience in a Data Engineer role and has attained bachelor's degree in technology and has experienced with Agile/Scrum development process and methodologies.- Experience as a Data Engineer with strong track record of designing and implementing data solutions.Lead the design and...