Azure Databricks, Data Factory and SQL
1 day ago
Skill: Databricks
Experience: 6 to 13 years
Location: Bhubaneswar
Job description
Responsibilities:
- Designing, building, and deploying data pipelines and workflows using Databricks.
- Developing and optimizing Apache Spark applications for data processing and analytics.
- Integrating Databricks with various data sources and platforms.
- Implementing data quality checks and monitoring processes.
- Managing and configuring the Databricks environment, including clusters and notebooks.
- Troubleshooting and resolving issues related to Databricks performance and functionality.
- Collaborating with data scientists and analysts to implement machine learning models.
- Staying up-to-date with the latest Databricks features and best practices.
Qualifications:
- Strong proficiency in Python or Scala programming languages.
- Experience with Apache Spark and big data processing frameworks.
- Knowledge of cloud platforms like AWS, Azure, or GCP.
- Familiarity with data warehousing and ETL processes.
- Understanding of machine learning concepts and algorithms.
- Strong problem-solving and analytical skills.
Additional Skills (depending on the specific role):
- Experience with Databricks Delta Lake or MLflow.
- Knowledge of infrastructure as code (IaC) tools like Terraform.
- Familiarity with CI/CD pipelines for data and machine learning workflows.
- Experience with containerization technologies like Docker.
-
Azure Databricks, Data Factory and SQL
1 day ago
Chennai, Tamil Nadu, India Cognizant Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob SummaryWe are seeking an experienced Architect with 8 to 12 years of experience to join our team. The ideal candidate will have expertise in Azure SQL DB Azure Synapse DataWarehouse Azure Functions Azure Data Lake Store Azure DevOps TSQL and Azure Data Factory. Experience in Investment Banking Operations and Brokerage is a plus. This hybrid role requires...
-
Azure Data Factory with Python
6 days ago
Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Title: - Azure Data Factory with PythonLocation: - KolkataJob Type 3 days from office (Hybrid)Must Have SkillsMinimum 6 to 9 years of experienceHands on experience with Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure Analysis Services, Blob Storage, Databricks/Spark, Azure SQL DW/Synapse, and Azure functions.In-depth knowledge of...
-
Azure Databricks + Pyspark
1 day ago
Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 20,00,000 per yearAzure DatabricksLocation - Hyderabad / Experience - 9 to 12 YearsJob Summary8plus years of technical and development experience3 plus years of Experience with Azure Data Factory Azure Synapse and DatabricksExperience with ETL SQL PySparkExperience managing cloud applications (Managing network security is a plus)Experience with git repositories and release...
-
Databricks
1 day ago
Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 8,00,000 - ₹ 15,00,000 per yearJob descriptionAzure Databricks + PysparkLocation - CoimbatoreExpereince - 6 to 8 YearsExperience with Azure Data Bricks, Data FactoryExperience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE AnalyticsExperience in Python/Pyspark/Scala/Hive Programming.Experience with Azure Databricks/ADBExperience with building CI/CD...
-
Senior Data Engineer- Azure Databricks
1 day ago
Chennai, Tamil Nadu, India InfoCepts Full time ₹ 12,00,000 - ₹ 36,00,000 per yearPosition: Data Engineer- Azure DatabricksPurpose of the Position:To design, build, and optimize scalable data pipelines and solutions using Azure Databricks and related technologies, enabling Zodiac Maritime to make faster, data-driven decisions as part of its data transformation journey.Proficiency in data integration techniques, ETL processes and data...
-
Databricks Architect
3 days ago
Chennai, Tamil Nadu, India NotionMindz Technology LLP Full time ₹ 20,00,000 - ₹ 25,00,000 per yearRole:Databricks ArchitectDesignation:Data ArchitectExperience:7–10 yearsLocation:ChennaiAbout the role:We're looking for aDatabricks Architectto design, build, and optimize data pipelines and large-scale integrations for enterprise-grade data environments. The ideal candidate will bring strong experience inAzure Databricks, Data Factory, and SQL-based data...
-
Azure Databricks Engineer
5 days ago
Chennai, Tamil Nadu, India Capgemini Full time ₹ 6,00,000 - ₹ 18,00,000 per yearChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...
-
Azure Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob descriptionRole: Azure Data EngineerExperience: 3-5 YearsSkill set:Pyspark / Scala Spark, Python, Azure Databricks and Azure Data Factory Roles and Responsibilities: Should have programming skills with the ability to write optimized and reusable high-quality code. Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark,...
-
Azure Data Bricks Engineer
1 day ago
Chennai, Tamil Nadu, India CARBYNETECH Full time ₹ 9,00,000 - ₹ 12,00,000 per yearDevelop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows ADF data Ingestion and Integration with other services Azure Databricks: Experience in Big Data components such as Kafka, Spark SQL, Dataframes, HIVE DB etc...
-
Azure Data Engineer
6 days ago
Chennai, Tamil Nadu, India D2KSS SOFTWARE SERVICES PRIVATE LIMITED Full time ₹ 8,00,000 - ₹ 24,00,000 per yearIndustry & Sector:IT services and enterprise data engineering — delivering cloud-native analytics, ETL/ELT pipelines, and modern data platform implementations on Microsoft Azure for large enterprise customers. This is an on-site, hands-on engineering role supporting strategic data modernization initiatives across business domains.Primary Job TitleSenior...