Azure Databricks, Data Factory and SQL

1 day ago


Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Skill: Databricks

Experience: 6 to 13 years

Location: Bhubaneswar

Job description

Responsibilities:

  • Designing, building, and deploying data pipelines and workflows using Databricks.
  • Developing and optimizing Apache Spark applications for data processing and analytics.
  • Integrating Databricks with various data sources and platforms.
  • Implementing data quality checks and monitoring processes.
  • Managing and configuring the Databricks environment, including clusters and notebooks.
  • Troubleshooting and resolving issues related to Databricks performance and functionality.
  • Collaborating with data scientists and analysts to implement machine learning models.
  • Staying up-to-date with the latest Databricks features and best practices.

Qualifications:

  • Strong proficiency in Python or Scala programming languages.
  • Experience with Apache Spark and big data processing frameworks.
  • Knowledge of cloud platforms like AWS, Azure, or GCP.
  • Familiarity with data warehousing and ETL processes.
  • Understanding of machine learning concepts and algorithms.
  • Strong problem-solving and analytical skills.

Additional Skills (depending on the specific role):

  • Experience with Databricks Delta Lake or MLflow.
  • Knowledge of infrastructure as code (IaC) tools like Terraform.
  • Familiarity with CI/CD pipelines for data and machine learning workflows.
  • Experience with containerization technologies like Docker.


  • Chennai, Tamil Nadu, India Cognizant Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryWe are seeking an experienced Architect with 8 to 12 years of experience to join our team. The ideal candidate will have expertise in Azure SQL DB Azure Synapse DataWarehouse Azure Functions Azure Data Lake Store Azure DevOps TSQL and Azure Data Factory. Experience in Investment Banking Operations and Brokerage is a plus. This hybrid role requires...


  • Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: - Azure Data Factory with PythonLocation: - KolkataJob Type 3 days from office (Hybrid)Must Have SkillsMinimum 6 to 9 years of experienceHands on experience with Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure Analysis Services, Blob Storage, Databricks/Spark, Azure SQL DW/Synapse, and Azure functions.In-depth knowledge of...


  • Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Azure DatabricksLocation - Hyderabad / Experience - 9 to 12 YearsJob Summary8plus years of technical and development experience3 plus years of Experience with Azure Data Factory Azure Synapse and DatabricksExperience with ETL SQL PySparkExperience managing cloud applications (Managing network security is a plus)Experience with git repositories and release...

  • Databricks

    1 day ago


    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 8,00,000 - ₹ 15,00,000 per year

    Job descriptionAzure Databricks + PysparkLocation - CoimbatoreExpereince - 6 to 8 YearsExperience with Azure Data Bricks, Data FactoryExperience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE AnalyticsExperience in Python/Pyspark/Scala/Hive Programming.Experience with Azure Databricks/ADBExperience with building CI/CD...


  • Chennai, Tamil Nadu, India InfoCepts Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Position: Data Engineer- Azure DatabricksPurpose of the Position:To design, build, and optimize scalable data pipelines and solutions using Azure Databricks and related technologies, enabling Zodiac Maritime to make faster, data-driven decisions as part of its data transformation journey.Proficiency in data integration techniques, ETL processes and data...


  • Chennai, Tamil Nadu, India NotionMindz Technology LLP Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role:Databricks ArchitectDesignation:Data ArchitectExperience:7–10 yearsLocation:ChennaiAbout the role:We're looking for aDatabricks Architectto design, build, and optimize data pipelines and large-scale integrations for enterprise-grade data environments. The ideal candidate will bring strong experience inAzure Databricks, Data Factory, and SQL-based data...


  • Chennai, Tamil Nadu, India Capgemini Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...

  • Azure Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job descriptionRole: Azure Data EngineerExperience: 3-5 YearsSkill set:Pyspark / Scala Spark, Python, Azure Databricks and Azure Data Factory Roles and Responsibilities: Should have programming skills with the ability to write optimized and reusable high-quality code. Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark,...


  • Chennai, Tamil Nadu, India CARBYNETECH Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows ADF data Ingestion and Integration with other services Azure Databricks: Experience in Big Data components such as Kafka, Spark SQL, Dataframes, HIVE DB etc...

  • Azure Data Engineer

    6 days ago


    Chennai, Tamil Nadu, India D2KSS SOFTWARE SERVICES PRIVATE LIMITED Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Industry & Sector:IT services and enterprise data engineering — delivering cloud-native analytics, ETL/ELT pipelines, and modern data platform implementations on Microsoft Azure for large enterprise customers. This is an on-site, hands-on engineering role supporting strategic data modernization initiatives across business domains.Primary Job TitleSenior...