Senior Azure Data Engineering Manager
2 months ago
Experience Requirements :
- Overall 12-15 years of IT experience preferably in Data and Analytics implementation.
- 7-8 years of Data engineering (Both On-prem and Azure) delivery experience including Architecture / analysis / development / configuration/ deployment.
- 4-5 years of implementation experience in Azure Data engineering projects.
- Mandatory to have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end Big Data solutions on Azure Cloud.
- Expert in Python/SQL/SparkSQL/PySpark.
- Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, Datra bricks, perview and Azure App Service is required.
- Extensive hands-on experience implementing data migration and data processing using Azure services: Serverless Architecture, Azure Storage, Azure SQL DB/DW, Data Factory, Azure Stream Analytics, Azure Analysis Service, Databricks Azure Data Catalog, Cosmos Db, Azure Functions, ARM Templates, Azure DevOps, CI/CD etc.
- Expert in at least one distributed data processing framework: Spark (Core, Streaming, SQL), Storm or Flink, etc.
- Expert in distributed messaging and ingestion frameworks (Kafka, Pulsar, Pub/Sub, etc) and good to know traditional ETL tools like Informatica, SSIS, etc.
- Should have worked on any NoSQL solutions like Mongo DB, Cassandra, HBase, Cosmos DB etc, or Cloud-based NoSQL offerings like DynamoDB, Big Table, etc.
- Good Exposure in development with CI / CD pipelines.
- Knowledge of containerization, orchestration, and Kubernetes engine would be an added advantage.
- Designing and building of data pipelines using API ingestion and Streaming ingestion methods.
- Knowledge in Azure Databricks, Azure IoT, Azure HDInsight + Spark, Azure Stream Analytics, Power BI is desirable.
- Strong problem solving and troubleshooting skills.
- Experience in working in a fast-paced agile environment.
- Proven experience in People management, hiring and capability building.
- Strong experience in common data warehouse modelling principles including Kimball, Inmon.
- Experience with data visualization tools such as Power BI.
- Experience in Streaming and batch architecture (e.g, Kafka, Kafka streams, Spark, Flink).
Knowledge Requirements :
- Excellent understanding of data technologies landscape/ecosystem (Both On-prem and Cloud).
- Detailed knowledge of Software development and Application Architecture is essential.
- Detailed knowledge of SQL (Structured Query Language) programming is essential.
- Proven experience in business and technical problem-solving skills is essential.
- Proven ability to build, manage and foster a team-oriented environment.
- Proven ability to work creatively and analytically in a problem-solving environment.
- Excellent communication (written and oral) and interpersonal skills.
- Excellent leadership and management skills.
- Excellent organizational, multi-tasking, and time-management skills.
-
Senior Data Engineer
2 months ago
Bangalore, Karnataka, India Syscort Full timeJob Title : Senior Data Engineer. Timeline : Immediate only. Experience : 8+Years. Location : Bangalore.Mandatory Required Qualification : - Strong proficiency in Azure services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Storage, etc. - Expertise in DevOps and CI/CD implementation. - Excellent Communication Skills. In This...
-
Senior Data Engineer
2 months ago
Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full timeJob Description :We are seeking a highly skilled Senior Data Engineer with extensive experience in Azure Data Factory (ADF) and Snowflake. The ideal candidate will have a strong background in data warehousing, ETL processes, and cloud platforms, particularly Azure. The role involves working with US-based clients and requires excellent technical and...
-
Senior Data Engineer
1 month ago
Bangalore, Karnataka, India xanika infotech Full timePosition : Senior Data Engineer-ADFExperience : 8+ YearsLocation : Bangalore-Kalyan NagarMode : Work from officeEducation : Bachelor's/Master's in Computer's or :8+ years of Hands-on experience in SQL and 5+ yrs of experience in ADF to manipulate data, implement database-driven solutions, build applications and data integration.As an architect we...
-
Senior Data Engineer
2 months ago
Bangalore, Karnataka, India HAD Recruitment Services Full timeResponsibilities :- Design, develop, and maintain robust data pipelines and architectures on the Azure platform.- Utilize Azure Data Services (Azure Data Factory, Azure SQL Database, Azure Data Lake) to extract, transform, and load (ETL) data from various sources.- Create and optimize data pipelines for efficient data ingestion, processing, and analysis.-...
-
Senior Data Engineer
2 months ago
Bangalore, Karnataka, India SARVAJITH INFOTECH Full timeRole : Senior Data Engineer. Experience : 6 yrs to 8 yrsLocation : Bangalore Candidates OnlyWork : HybridJob Description :Here is a list of mandatory skills based1. Azure Data Services :- Azure Data Factory- Azure SQL Database- Azure Data Lake(4-5 years' hands-on project experience)2. Power BI (PBI) :(4-5 years' hands-on project experience)3. Data...
-
Senior Data Engineer
2 months ago
Bangalore, Karnataka, India MonoSpear Technologies Pvt Ltd Full timeSenior Data Engineer :- 9+ years' work experience and bachelor's degree in Information Science, Computer Science, Mathematics, Statistics or a quantitative discipline in science, business, or social science.- Hands-on engineer who is curious about technology, should be able to quickly adopt to change and one who understands the technologies...
-
Azure Data Engineer
2 months ago
Bangalore, Karnataka, India Softpath Technologies LLC Full timeJob Description :In your role as an Azure Data Engineer, you will be responsible for expanding and optimising data and pipeline architectures, and for optimising data collection and flow across functional teams. Your responsibilities include assisting software developers, database architects, data analysts, and data scientists with data initiatives and...
-
Azure Data Engineer
2 months ago
Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full timeWe are seeking an experienced Azure Data Engineer to join our team. Job Title : Azure Data EngineerLocation : : 3+ Years The ideal candidate will have 3+ years of hands-on experience in Azure data services, including Azure Databricks, Azure Data Factory, Azure SQL, and Azure Data Lake. You will be responsible for designing, developing, and maintaining...
-
Data Engineer
1 month ago
Bangalore, Karnataka, India Element Infomatics Pvt. Ltd. Full timePosition : Data Engineer Job Description :- Develop and maintain data pipelines using ADF for data extraction, transformation, and loading (ETL).- Manage data warehousing solutions on Azure, optimizing storage and performance.- Utilize Azure services like Azure Data Factory and Azure Databricks or snowflake for data processing.- Create and maintain data...
-
Data Engineer
2 months ago
Bangalore, Karnataka, India Luytens Technology Solutions Pvt. Ltd. Full timeJob Summary : A purposeful Azure Data Engineer with over 5-7 years of experience in designing, developing, implementing, and optimizing data solutions on Microsoft Azure. Proven expertise in leveraging Azure services for ETL processes, data warehousing and analytics, ensuring optimal performance and scalability. Skills :- Azure Services: Azure SQL Database,...
-
Azure Data Factory Engineer
1 month ago
Bangalore, Karnataka, India INSIGHT IND Full timePosition : Azure Data FactoryMode : work from officeLocation : Bangalore-Kalyan NagarJob Description : 8+ years of hands-on experience in structured query language (SQL) and 5+ yrs of experience in ADF to manipulate data, implement database-driven solutions, build applications and data integration. As an architect we expect minimum of 2 to 3 end to end...
-
Senior Windows Engineer
2 months ago
Bangalore, Karnataka, India HyrEzy Talent Solutions Full timeRole : Senior Windows EngineerLocation : BangaloreWork mode : Hybrid (2-3 Days- Work from office)Working Hours : 5:00 PM IST to 2:00 AM IST (aligning with EST hours till 4:30 PM)Experience : 10-12 yearsMandatory : 10+ years of experience as a Windows Engineer or in a similar role, with a strong focus on managing Windows environments, Azure, Active Directory,...
-
Senior Data Engineer
1 month ago
Bangalore, Karnataka, India Newbies Staffing Full timePosition Title : Senior Data EngineerExperience : 5+ YearsReporting to : Senior Vice President of Global TechnologyEducation : B.E/B.Tech (CS/IT/Data Science)Location : BangaloreWork Hours : 3PM to 12 AMEssential Duties and Responsibilities :- Design, develop, and maintain high-quality, secure data pipelines and processes to manage and transform data...
-
Data Engineer
4 weeks ago
Bangalore, Karnataka, India Allime Tech Solutions Full timeRole : Data Engineer. Experience : 6 to 8Yrs. Location : Bangalore. Notice Period : Immediate Joiner. Skill : - Design, build, and maintain data pipelines using Azure Data Factory, Databricks, Snowflake, and PySpark. - Develop and implement data transformation and cleansing techniques to ensure data quality and reliability. - Collaborate with...
-
Data Engineer
2 months ago
Bangalore, Karnataka, India PyjamaHR Full timeKey Responsibilities : - Design and deliver scalable data solutions using Azure Data services. - Develop and implement data ingestion and transformation pipelines for large-scale environments. - Build data solutions using a wide range of tools and Azure services. - Collaborate on proof-of-concept development and production implementation. - Meet tight...
-
Infiniti Research
2 months ago
Bangalore, Karnataka, India Infiniti Research Limited Full timeCompany : Quantzig Analytics. Location : Kadubeesanahalli, Bangalore. Experience : 6+ years minimum is required. Notice : Preferably 0 to 30days. Job Description : - Seeking a self-driven professional with a strong ownership mentality and the ability to work independently without constant guidance. - The ideal candidate will have an agile mindset, capable...
-
Azure Data Engineer
1 month ago
Bangalore, Karnataka, India Blue Silicon Infotech Private Limited Full timeJob Description :- We are looking for candidate with 3+ years of experience in a Data Engineer role and has attained bachelor's degree in technology and has experienced with Agile/Scrum development process and methodologies.- Experience as a Data Engineer with strong track record of designing and implementing data solutions.Lead the design and...
-
Senior Data Engineer
1 month ago
Bangalore/Bengaluru, Karnataka, India Squareroot Consulting Pvt Ltd Full timeWe are seeking a highly skilled Senior Data Engineer with a passion for working with large-scale data systems. The ideal candidate will have extensive experience in designing, developing, and maintaining robust data pipelines, with a strong focus on Azure services and technologies.Job Title : Senior Data EngineerLocation : Bangalore (Work from...
-
Elucidata - Senior Software Engineer - Azure DevOps
2 months ago
Bangalore, Karnataka, India Elucidata Corporation Full timeAbout the Role :We are looking for an experienced Snowflake + Azure Data & DevOps Engineer to join our innovative team. The ideal candidate will have 5 to 6 years of experience in managing and optimizing data solutions, integrating Snowflake and Azure environments, and implementing DevOps practices. This role requires a blend of data engineering and DevOps...
-
Data Engineer
1 month ago
Bangalore, Karnataka, India upGrad Full timeAzure Databricks & Snowflake Data Engineer.Location : Pan India.Employment Type : Full-time.Experience : 6 to 12 years.Notice Period : Immediate to 15 days only.Job Description :We are looking for an experienced Kafka Streaming with Azure Databricks & Snowflake Data Engineer to join our growing team.The successful candidate will be responsible for designing,...