Azure Data Engineer

1 day ago

Chennai, Tamil Nadu, India Covenant Consultants Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Azure Databricks

Role Overview:

We are seeking a highly skilled Azure Databricks Developer with relevant years of experience in Azure Cloud services and hands-on expertise with Databricks, Azure data factory,ADB, Python, and PySpark. The ideal candidate will be responsible for designing, implementing, and optimizing data processing pipelines and will play a critical role in our data engineering projects.

Key Responsibilities:

Data Engineering:

  • Design, develop, and optimize large-scale data processing pipelines using Azure Databricks, Azure data factory,etc.
  • Implement complex data transformations and processing workflows with PySpark.
  • Develop and maintain scalable data architecture and pipelines to support various data projects.

Azure Cloud Services:

  • Utilize various Azure services such as Azure Data Factory, Azure Data Lake Storage, and Azure Synapse Analytics to build end-to-end data solutions.
  • Monitor, troubleshoot, and optimize Azure cloud resources and Databricks clusters for performance and cost-efficiency.

Data Integration:

  • Integrate data from multiple sources and ensure data consistency and integrity.
  • Develop and implement data validation and quality checks.

Collaboration:

  • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Participate in agile development processes and contribute to continuous improvement practices.

Documentation and Reporting:

  • Document data workflows, architecture, and processes for knowledge sharing and maintenance.
  • Generate reports and visualizations to communicate insights and progress to stakeholders.

Required Skills and Experience:

Technical Skills:

  • Strong experience with Azure Databricks , Azure data factory,etc and PySpark.
  • Proficiency in Python programming, with a focus on data processing and manipulation.
  • Experience with Azure services such as Azure Data Factory, Azure Data Lake Storage, and Azure Synapse Analytics.
  • Solid understanding of data warehousing concepts and ETL processes.
  • Familiarity with CI/CD practices and tools for data pipelines.

Professional Experience:

  • Rel years of hands-on experience in data engineering and cloud-based data processing.
  • Proven track record of working with large-scale data systems and distributed computing.
  • Experience in performance tuning and optimization of data processing jobs.

Soft Skills:

  • Excellent problem-solving skills and attention to detail.
  • Strong communication skills to collaborate effectively with cross-functional teams.
  • Ability to work independently and manage multiple tasks in a dynamic environment.

  • Azure Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India D2KSS SOFTWARE SERVICES PRIVATE LIMITED Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Industry & Sector:IT services and enterprise data engineering — delivering cloud-native analytics, ETL/ELT pipelines, and modern data platform implementations on Microsoft Azure for large enterprise customers. This is an on-site, hands-on engineering role supporting strategic data modernization initiatives across business domains.Primary Job TitleSenior...

  • Data Engineer(Azure)

    2 weeks ago

    Chennai, Tamil Nadu, India Photon Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Position:  Data Engineer Location:  Chennai/Banglore/Hyderabad/Trivandrum, PST Timing Job Summary  We are seeking a Data Engineer to work on a Generative AI initiative to join our team. The ideal candidate will have a deep understanding of data modeling, data schemas and has developed ETLs from various sources eensuring high data availability, fault...

  • Azure Data engineer

    3 days ago

    Chennai, Tamil Nadu, India Arizon Digital USA - Digital Commerce Experts Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionArizon Digital is a one-stop shop for e-commerce, enabling organizations to develop and optimize e-commerce sites efficiently. We help businesses choose the right technology, platforms, and processes to achieve success. With our cross-industry knowledge and technological expertise, we create customized solutions that meet all success...

  • Data Engineer

    5 days ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...

  • Data Engineer

    5 days ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Data Engineer – Chennai Build the foundation of data intelligence — design, develop, and optimize data pipelines that power AI-driven insights. Location: Chennai, India Experience: 2–3 years in data engineering or data-driven product development Role Overview As a Data Engineer, you will be responsible for building and...

  • Azure Data Engineer

    5 days ago

    Chennai, Tamil Nadu, India VCM LOGISTICS PRIVATE LIMITED Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Greeting from Ashra Technologieswe are hiringRole: Data Engineer(Azure+AWS)Exp: 7+YearsLocations: Pune,Chennai,Mumbai,BangaloreMandatory : -• Technical Expertise:• Proficiency in Azure services such as Azure Data Factory, Azure Functions, Databricks, SQL Database.• Strong knowledge of programming languages like Python and SQL.• Cloud Development:•...

  • Azure Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India ResourceTree Global Services Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Years of Experience: 5Job Description: We are seeking a skilled and experienced Senior Azure Developer to join our team As part of the team, you will be involved in implementing ongoing and new initiatives for our company. If you love learning, thinking strategically, innovating,and helping others, this job is for youPrimary Skills: ADF,DatabricksSecondary...

  • Senior Azure Data Engineer

    1 day ago

    Chennai, Tamil Nadu, India MindBrain Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title:Azure Data Tech Lead / Sr. Azure Data EngineerExperience:6–8 YearsLocation:Chennai (Work from Office)Shift:UK ShiftPrimary SkillsAzure Data FactoryAzure ServicesPythonPySparkDatabricksSQLAzure SynapseJob DescriptionWe are looking for an experiencedAzure Data Tech Lead / Sr. Azure Data Engineerwith strong expertise in cloud-based data engineering...

  • Azure Data Engineer

    5 days ago

    Chennai, Tamil Nadu, India DataEngine Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Hiring for Azure Data EngineerExperience: 8+ yearsLocation: Chennai, Hyderabad, BangaloreNotice Period: Immediate to 30 daysKey ResponsibilitiesData Pipelines: Build pipelines for raw data ingestion and orchestration using Azure Data Factory (ADF) and DatabricksData Transformation: Develop and maintain innovative Azure solutions, perform transformation using...

  • Azure Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India ResourceTree Global Services Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Years of Experience : 5 Job Description : We are looking for a skilled and experienced Senior Azure Developer to join our team As part of the team, you will be involved in the implementation of the ongoing and new initiatives for our company. If you love learning, thinking strategically, innovating, and helping others, this job is for you Primary...