Spark, Scala, Azure Synapse

1 day ago


Chennai, Tamil Nadu, India Cognizant Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Key skills: Azure SQL, AZURE Synapse, Spark

Experience: 6 to 13 years

Location: Kolkata

Job Description:

  1. Solution Design and Development:
  2. Collaborate with business stakeholders and data architects to understand data requirements and design scalable and efficient solutions using Azure Synapse Analytics.
  3. Develop and implement data pipelines, data warehouses, and ETL processes to integrate data from various sources into Azure Synapse Analytics.
  4. Query Optimization:
  5. Optimize SQL queries and data processing workflows to ensure optimal performance and responsiveness of Azure Synapse Analytics.
  6. Integration:
  7. Integrate Azure Synapse Analytics with other Azure services, such as Azure Data Factory, Azure Databricks, and Power BI, to create end-to-end data solutions.
  8. Monitoring and Troubleshooting:
  9. Implement monitoring solutions to track system performance, data quality, and job completion status. Troubleshoot and resolve issues promptly.
  10. Security and Compliance:
  11. Implement and enforce security measures to protect sensitive data. Ensure compliance with data governance and regulatory requirements.
  12. Documentation:
  13. Create and maintain comprehensive documentation for all developed solutions, including data models, ETL processes, and system configurations.
  14. Collaboration:
  15. Collaborate with cross-functional teams, including data scientists, analysts, and business users, to understand their requirements and deliver effective solutions.
  16. Continuous Learning:
  17. Stay updated on the latest Azure Synapse Analytics features and best practices. Continuously enhance skills and knowledge to drive innovation and improvement.


  • Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key skills: Azure SQL, AZURE Synapse, SparkExperience: 6 to 13 yearsLocation: BhubaneswarJob Description:Solution Design and Development:Collaborate with business stakeholders and data architects to understand data requirements and design scalable and efficient solutions using Azure Synapse Analytics.Develop and implement data pipelines, data warehouses, and...

  • BigData- Spark/Scala

    2 weeks ago


    Chennai, Tamil Nadu, India Prodapt Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Overview Big Data, Spark Scala strong  Responsibilities Big Data, Spark Scala strong  Requirements Big Data, Spark Scala strong 

  • Spark Scala Python

    1 week ago


    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job SummaryJoin our dynamic team as a Developer where you will leverage your expertise in Spark Scala Python and SparkSQL to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to enhance data processing capabilities. Your contributions will directly impact our companys growth and societal...

  • Databricks+Spark

    1 day ago


    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: - Databricks+SparkLocation: - KolkataMust Have SkillsMinimum 6 to 9 years of experienceHands on experience with Azure Databricks, Spark, Azure SQL DW/Synapse, and Azure functions.In-depth knowledge of relational database design, data warehousing and dimensional data modeling conceptsWorking experience with Python, Spark,.


  • Chennai, Tamil Nadu, India BNP Paribas Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Position Purpose The Senior Spark Developer will be responsible for integrating and maintaining the Quantexa platform, a spark based software provided by a UK fintech, into our existing systems to enhance our anti-money laundering capabilities. This role requires a deep expertise in Spark development, as well as an ability to analyze and understand...

  • Scala Lead Engineer

    6 days ago


    Chennai, Tamil Nadu, India Techominds Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Summary:Skills: Lead Data Eng with Scala, Spark, Pyspark & DatabricksJob Title: Data Engineer (Scala, Spark, Pyspark, Databricks)Location: ChennaiResponsibilities:Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.Implement ETL (Extract, Transform, Load) processes for various data...


  • Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: - Azure Data Factory with PythonLocation: - KolkataJob Type 3 days from office (Hybrid)Must Have SkillsMinimum 6 to 9 years of experienceHands on experience with Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure Analysis Services, Blob Storage, Databricks/Spark, Azure SQL DW/Synapse, and Azure functions.In-depth knowledge of...


  • Chennai, Tamil Nadu, India CARBYNETECH Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows ADF data Ingestion and Integration with other services Azure Databricks: Experience in Big Data components such as Kafka, Spark SQL, Dataframes, HIVE DB etc...

  • Azure Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job descriptionRole: Azure Data EngineerExperience: 3-5 YearsSkill set:Pyspark / Scala Spark, Python, Azure Databricks and Azure Data Factory Roles and Responsibilities: Should have programming skills with the ability to write optimized and reusable high-quality code. Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark,...


  • Chennai, Tamil Nadu, India NTek Software Solutions Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Title: Data EngineerExperience:4+ YearsLocation:BengaluruClient:IXLY TechnologiesEmployment Type:Full-timeJob Summary:IXLY Technologies is seeking an experiencedData Engineerwith strong hands-on expertise inMicrosoft FabricandAzure Synapse Analytics. The ideal candidate will be responsible for building, optimizing, and maintaining scalable data pipelines...