Azure Databricks, Data Factory and SQL
3 days ago
Skill: Databricks
Experience: 6 to 13 years
Location: Bhubaneswar
Job description
Responsibilities:
- Designing, building, and deploying data pipelines and workflows using Databricks.
- Developing and optimizing Apache Spark applications for data processing and analytics.
- Integrating Databricks with various data sources and platforms.
- Implementing data quality checks and monitoring processes.
- Managing and configuring the Databricks environment, including clusters and notebooks.
- Troubleshooting and resolving issues related to Databricks performance and functionality.
- Collaborating with data scientists and analysts to implement machine learning models.
- Staying up-to-date with the latest Databricks features and best practices.
Qualifications:
- Strong proficiency in Python or Scala programming languages.
- Experience with Apache Spark and big data processing frameworks.
- Knowledge of cloud platforms like AWS, Azure, or GCP.
- Familiarity with data warehousing and ETL processes.
- Understanding of machine learning concepts and algorithms.
- Strong problem-solving and analytical skills.
Additional Skills (depending on the specific role):
- Experience with Databricks Delta Lake or MLflow.
- Knowledge of infrastructure as code (IaC) tools like Terraform.
- Familiarity with CI/CD pipelines for data and machine learning workflows.
- Experience with containerization technologies like Docker.
-
Azure Databricks, Data Factory and SQL
3 days ago
Chennai, Tamil Nadu, India Cognizant Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob SummaryWe are seeking an experienced Architect with 8 to 12 years of experience to join our team. The ideal candidate will have expertise in Azure SQL DB Azure Synapse DataWarehouse Azure Functions Azure Data Lake Store Azure DevOps TSQL and Azure Data Factory. Experience in Investment Banking Operations and Brokerage is a plus. This hybrid role requires...
-
Azure Data Factory with Python
7 days ago
Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Title: - Azure Data Factory with PythonLocation: - KolkataJob Type 3 days from office (Hybrid)Must Have SkillsMinimum 6 to 9 years of experienceHands on experience with Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure Analysis Services, Blob Storage, Databricks/Spark, Azure SQL DW/Synapse, and Azure functions.In-depth knowledge of...
-
Developer - Azure Data Factory
23 hours ago
Chennai, Tamil Nadu, India ANRGI TECH Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob Title: Developer Azure Data FactoryWork Location: Chennai, TNNotice Period: 0- 20 DaysSkill RequiredAzure Data FactoryExperience Range: 8-10 YearsRelevant years of experience in ADF, ADB, azure has to be 5 years and plus.Must-HaveJob Description:Azure Data Factory, SQL- Advance, SSIS, Data Bricks, SDFSAzure Data Factory (ADF) pipelines and PolybaseGood...
-
Azure Data Factory Developer
7 days ago
Chennai, Tamil Nadu, India Phygital Insights Full time ₹ 8,00,000 - ₹ 24,00,000 per yearFull time|Work From OfficeThis Position is Currently OpenDepartment / Category:DEVELOPERListed on Sep 18, 2025Work Location:CHENNAIJob Descritpion of Azure Data Factory Developer8 to 10 Years Relevant ExperienceAbout the RoleWe're looking for a skilled Azure Data Engineer with strong expertise in Azure Data Factory (ADF), Azure Databricks (ADB), and the...
-
Chennai, Tamil Nadu, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per yearExperience with Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL Key ResponsibilitiesDesign and build ETL/ELT pipelines to ingest, transform, and load data from clinical, omics, research, and operational sources.Optimize performance and scalability of data flows using tools like Apache Spark, Databricks, or AWS Glue.Collaborate with domain experts...
-
Azure data factory,Azure
1 week ago
Chennai, Tamil Nadu, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per yearYears of Exp- 6 to 8 YearsShift time-UK Shift timeBillrate- Ieyond this range)Primary Skillset-Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL,Azure SynapseExperience with Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL Key ResponsibilitiesDesign and build ETL/ELT pipelines to ingest, transform, and load data from clinical, omics,...
-
Chennai, Tamil Nadu, India Risk Resources LLP Full time ₹ 15,00,000 - ₹ 25,00,000 per yearOverview: The Data Engineer is a crucial member of our data team, responsible for designing, building, and maintaining robust data infrastructure. Utilizing platforms such as Databricks and Azure Data Factory, this role focuses on creating efficient data pipelines and managing large datasets for analysis. By employing tools like PySpark and SQL, the Data...
-
Databricks Architect
3 days ago
Chennai, Tamil Nadu, India NotionMindz Technology LLP Full time ₹ 20,00,000 - ₹ 25,00,000 per yearRole:Databricks ArchitectDesignation:Data ArchitectExperience:7–10 yearsLocation:ChennaiAbout the role:We're looking for aDatabricks Architectto design, build, and optimize data pipelines and large-scale integrations for enterprise-grade data environments. The ideal candidate will bring strong experience inAzure Databricks, Data Factory, and SQL-based data...
-
Azure Data Factory,Azure
1 week ago
Chennai, Tamil Nadu, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJD:Experience with Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL Key ResponsibilitiesDesign and build ETL/ELT pipelines to ingest, transform, and load data from clinical, omics, research, and operational sources.Optimize performance and scalability of data flows using tools like Apache Spark, Databricks, or AWS Glue.Collaborate with domain...
-
Azure Databricks Lead
2 days ago
Chennai, Tamil Nadu, India GIG Consultants Full time ₹ 15,00,000 - ₹ 25,00,000 per yearDescription : Key Responsibilities : - Lead the design, development, and optimization of large-scale data solutions using Azure Databricks, Azure Data Factory (ADF), and Azure Synapse Analytics. - Architect and implement efficient ETL/ELT pipelines for ingesting, transforming, and processing structured and unstructured data. - Develop...