Azure DataBricks Data Engineer
1 week ago
Responsibilities : -
- An Azure Data Engineer is responsible for designing, building, and maintaining the data infrastructure for an organization using Azure cloud services.
- This includes creating data pipelines, integrating data from various sources, and implementing data security and privacy measures.
- The Azure Data Engineer will also be responsible for monitoring and troubleshooting data flows and optimizing data storage and processing for performance and cost efficiency.
Mandatory Skills : -
- Bachelors or higher degree in Computer Science or a related discipline; or equivalent (minimum 7 years work experience).
- At least 4+ years of consulting or client service delivery experience on Azure
- At least 4+ years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases such as SQL server and data warehouse solutions such as Azure Synapse
- Extensive experience providing practical direction with using Azure Native services.
- Extensive hands-on experience implementing data ingestion, ETL and data processing using Azure services: ADLS, Azure Data Factory, Azure Functions, Azure Logic App Synapse/DW, Azure SQL DB, Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, Databricks, Cosmo DB etc.
- Minimum of 4+ years of hands-on experience in Azure and Big Data technologies such as Java, Python, SQL, ADLS/Blob, PySpark and SparkSQL , Databricks, HD Insight and live streaming technologies such as EventHub, Azure Stream Analytics etc.
- Well versed in DevSecOps and CI/CD deployments
- Cloud migration methodologies and processes including tools like Azure Data Factory, Data Migration Service, etc.
- Minimum of 4+ years of RDBMS experience
- Experience in using Big Data File Formats and compression techniques.
- Experience working with Developer tools such as Azure DevOps, Visual Studio Team Server, Git, Jenkins, etc.
- Experience with private and public cloud architectures, pros/cons, and migration considerations.
-
Azure Databricks Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Onebridge Full time ₹ 8,00,000 - ₹ 24,00,000 per yearOnebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...
-
Azure Databricks Engineer
2 weeks ago
Bengaluru, Karnataka, India krtrimaIQ Cognitive Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearPosition: Azure Databricks EngineerCompany: KrtrimaIQ Cognitive SolutionsLocation: Bangalore (Hybrid / Remote)Experience: 4–8 YearsCertifications: Microsoft Certified – Azure Data Engineer Associate (DP-203) (Mandatory)About KrtrimaIQ Cognitive Solutions:At KrtrimaIQ, we are a next-generation AI & Data Engineering company enabling enterprises...
-
Data Engineer- 1
2 weeks ago
Bengaluru, Karnataka, India Databricks PySpark Full time ₹ 8,00,000 - ₹ 24,00,000 per yearPosition: Senior Data Engineer We are seeking an experienced Senior Data Engineer to design and implement high-performance data pipelines, ensuring the smooth flow of large datasets across systems. In this role, you will leverage your expertise in Databricks, Pyspark, and ETL design to build efficient data solutions. You will also contribute to...
-
Senior Engineer Azure Databricks
2 weeks ago
Bengaluru, Karnataka, India Ahvi Infotech Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per yearPosition: Senior Engineer Azure databricksOverall IT experience: 6 to 9 yearsPrimary Skills: Azure Databricks, PySpark, SQLSecondary Skills: ADF/Azure Data factoryWork Location: Bengaluru/HyderabadMode of work: Hybrid Notice Period: 0 to 30 Days Experience & Expertise:Total Experience: 6 to 9 years in Cloud Data Engineering.Azure Databricks & PySpark:...
-
Azure Databricks Sr Engineer
2 weeks ago
Bengaluru, Karnataka, India AVE-Promagne Business Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per yearNotice Period: Immediate to 30 Days (Preferred)Job Summary:We are seeking a skilled Azure Data Engineer to join our growing data team. The ideal candidate will have hands-on experience with Azure Data Factory, Databricks, PySpark, and SQL, and will contribute to designing and implementing scalable, secure, and high-performance data solutions on Microsoft...
-
Azure Databricks
1 week ago
Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per yearPosition: Lead - Azure DatabricksOverall IT experience: 8 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse Secondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, HyderabadNotice Period: 0 to 30 Days Essential experience:Experience in building ETL / data warehouse transformation processes Direct...
-
Azure Databricks Engineer
2 weeks ago
Bengaluru, Karnataka, India Embee Software Pvt Ltd Full time ₹ 8,00,000 - ₹ 24,00,000 per yearAzure Data Bricks Engineer Job Description : - Solution Development And Implementation - Design, develop, and deploy robust analytics solutions leveraging the Microsoft platform (e., Azure Data Factory, Azure Synapse Analytics, SQL Server, Power BI, Microsoft Fabric) and Databricks. - Build scalable and high-performance data pipelines and...
-
Databricks Data Engineer
6 days ago
Bengaluru, Karnataka, India Informica Solutions` Full time ₹ 6,00,000 - ₹ 12,00,000 per yearWe are looking for a developer passionate about building scalable, cloud-native data platforms and delivering mission-critical data flows. You will collaborate with cross-functional teams across engineering and data science, owning pipelines end-to-end from ingestion to production deployment. Key Responsibilities Design & build ETL/ELT pipelines using...
-
Azure Databricks Developer
1 week ago
Bengaluru, Karnataka, India Growel Softech Pvt. Ltd. Full time ₹ 5,00,000 - ₹ 15,00,000 per yearDescription : About the Role : We are seeking a skilled DataBricks Developer to design, develop, and optimize data pipelines and workflows within the Azure Databricks environment. The ideal candidate will have strong expertise in PySpark, Python, and SQL, with hands-on experience building scalable and efficient data processing solutions.Key...
-
Azure Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Changeleaders Consulting Full time ₹ 10,000 - ₹ 60,000 per yearWell versed in Azure Data Engineering: Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse, Databricks, SQL Database etc.Hands-on experience in programming languages like Python/Pyspark and SQL