Spark, Scala, Azure Synapse

13 hours ago


Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Key skills: Azure SQL, AZURE Synapse, Spark

Experience: 6 to 13 years

Location: Bhubaneswar

Job Description:

  • Solution Design and Development:
  • Collaborate with business stakeholders and data architects to understand data requirements and design scalable and efficient solutions using Azure Synapse Analytics.
  • Develop and implement data pipelines, data warehouses, and ETL processes to integrate data from various sources into Azure Synapse Analytics.
  • Query Optimization:
  • Optimize SQL queries and data processing workflows to ensure optimal performance and responsiveness of Azure Synapse Analytics.
  • Integration:
  • Integrate Azure Synapse Analytics with other Azure services, such as Azure Data Factory, Azure Databricks, and Power BI, to create end-to-end data solutions.
  • Monitoring and Troubleshooting:
  • Implement monitoring solutions to track system performance, data quality, and job completion status. Troubleshoot and resolve issues promptly.
  • Security and Compliance:
  • Implement and enforce security measures to protect sensitive data. Ensure compliance with data governance and regulatory requirements.
  • Documentation:
  • Create and maintain comprehensive documentation for all developed solutions, including data models, ETL processes, and system configurations.
  • Collaboration:
  • Collaborate with cross-functional teams, including data scientists, analysts, and business users, to understand their requirements and deliver effective solutions.
  • Continuous Learning:
  • Stay updated on the latest Azure Synapse Analytics features and best practices. Continuously enhance skills and knowledge to drive innovation and improvement.


  • Chennai, Tamil Nadu, India Cognizant Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key skills: Azure SQL, AZURE Synapse, SparkExperience: 6 to 13 yearsLocation: KolkataJob Description:Solution Design and Development:Collaborate with business stakeholders and data architects to understand data requirements and design scalable and efficient solutions using Azure Synapse Analytics.Develop and implement data pipelines, data warehouses, and...

  • Azure Synapse

    1 day ago


    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    Role - Azure Synapse Analytics Required Technical Skill Set** ADF Synapse ADB Python SQL DevOps Git VStudio ADLS 2 and SSIS and SSRS Good to have Technical Skill Set Power Bi architecture and integration with Synapse Analytics and SQL Server Desired Experience Range** 8-12 Years Location of Requirement Chennai, , Bangalore, Desired Competencies...

  • Spark Scala Python

    1 week ago


    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job SummaryJoin our dynamic team as a Developer where you will leverage your expertise in Spark Scala Python and SparkSQL to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to enhance data processing capabilities. Your contributions will directly impact our companys growth and societal...


  • Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    Dear Candidates,Greetings from TCS!!!!TCS is looking for Spark Scala DeveloperExperience: 6-8 yearsLocation: ChennaiMUST HAVE SKILLS:Data Engineer Design and develop scalable and efficient solutions using Spark, Scala, Python, Airflow.Good code and configuration spark knowledge (at least 1 or 2 profiles should be very good at spark configuration and cluster...

  • Databricks+Spark

    9 hours ago


    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: - Databricks+SparkLocation: - KolkataMust Have SkillsMinimum 6 to 9 years of experienceHands on experience with Azure Databricks, Spark, Azure SQL DW/Synapse, and Azure functions.In-depth knowledge of relational database design, data warehousing and dimensional data modeling conceptsWorking experience with Python, Spark,.

  • Scala Lead Engineer

    6 days ago


    Chennai, Tamil Nadu, India Techominds Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Summary:Skills: Lead Data Eng with Scala, Spark, Pyspark & DatabricksJob Title: Data Engineer (Scala, Spark, Pyspark, Databricks)Location: ChennaiResponsibilities:Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.Implement ETL (Extract, Transform, Load) processes for various data...


  • Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: - Azure Data Factory with PythonLocation: - KolkataJob Type 3 days from office (Hybrid)Must Have SkillsMinimum 6 to 9 years of experienceHands on experience with Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure Analysis Services, Blob Storage, Databricks/Spark, Azure SQL DW/Synapse, and Azure functions.In-depth knowledge of...


  • Chennai, Tamil Nadu, India Suzva Software Technologies Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Work Mode- Work From Office -ChennaiShift time-UK Shift timeBillrate- Ieyond this range)Primary Skillset-Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL,Azure SynapseNo of Position-2 JD:Experience with Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL Key ResponsibilitiesDesign and build ETL/ELT pipelines to ingest, transform, and load...


  • Chennai, Tamil Nadu, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Years of Exp- 6 to 8 YearsShift time-UK Shift timeBillrate- Ieyond this range)Primary Skillset-Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL,Azure SynapseExperience with Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL Key ResponsibilitiesDesign and build ETL/ELT pipelines to ingest, transform, and load data from clinical, omics,...


  • Chennai, Tamil Nadu, India CARBYNETECH Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows ADF data Ingestion and Integration with other services Azure Databricks: Experience in Big Data components such as Kafka, Spark SQL, Dataframes, HIVE DB etc...