Data Engineer

3 weeks ago

Madurai, India HCLTech Full time

Azure Senior Data Engineer with Azure Data Factory (ADF), Azure Databricks, SQL, Python

Location: Madurai

Experience: 3 to 8 years


Job Summary

The Senior Developer will be responsible for developing and maintaining solutions using Azure Data Factory (ADF), Azure Databricks, SQL, and Python. The primary objectives includes building and optimizing data pipelines for efficient data processing and analysis.


Key Responsibilities

1. Develop and implement end-to-end data pipelines using azure data factory (ADF) and azure databricks to extract, transform, and load data.

2. Write complex SQL queries to retrieve and manipulate data from databases.

3. Utilize python for scripting and automation tasks related to data processing and analysis.

4. Troubleshoot and resolve issues related to data pipelines and data quality.


Skill Requirements

1. Strong understanding of azure data factory (ADF) for building and managing data pipelines.

2. Experience with azure databricks for big data processing and analytics.

3. Strong SQL skills for querying and manipulating data in relational databases.

4. Solid knowledge of python programming language for data manipulation and automation.

5. Understanding of data integration concepts and ETL processes..


Certifications: Azure Data Engineer Associate or Microsoft Certified: Azure Data & AI Associate certification is a plus.

  • Data Engineer

    4 weeks ago

    Madurai, Tamil Nadu, India Bahwan CyberTek Full time

    Job Title: Data Engineer – Google Cloud Platform (GCP) Job Summary We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data solutions on Google Cloud Platform. The ideal candidate will be proficient in GCP services like Pub/Sub, Dataflow, Cloud Storage, and BigQuery, with a...

  • Data Engineer

    3 weeks ago

    Madurai, India Peoplefy Full time

    Responsibilities:Lead the design and development of scalable data pipelines using AWS (Glue, Redshift, Athena) Drive architecture decisions for data systems that support business analytics and application features Build end-to-end solutions, including backend APIs and, where applicable, simple UI components Orchestrate workflows using Airflow or equivalent...

  • Data Engineer

    3 weeks ago

    Madurai, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks, Job Summary The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business...

  • Data engineer

    4 weeks ago

    Madurai, India Canopus Infosystems - A CMMI Level 3 Company Full time

    Position: Data EngineerExperience: 2+ YearsLocation: RemoteJoining: Immediate Joiners PreferredAbout the Role:We are looking for a skilled Data Engineer with strong Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization. The ideal candidate should be capable of building data pipelines, performing...

  • Data Engineer

    3 weeks ago

    Madurai, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks, Job Summary The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business...

  • Data Engineer

    3 weeks ago

    Madurai, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks,Job SummaryThe Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements...

  • Data Engineer

    2 weeks ago

    Madurai, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks, Job Summary The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business...

  • Data Engineer

    2 weeks ago

    Madurai, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks,Job SummaryThe Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements...

  • Data Engineer

    6 days ago

    Madurai, Tamil Nadu, India Pinnacle Infotech Full time ₹ 8,00,000 - ₹ 15,00,000 per year

    Company OverviewPinnacle Infotech values inclusive growth in an agile, diverse environment. With 30+ years of global experience, 3,400+ experts completed 15,000+ projects across 43+ countries for 5,000+ clients. Join us for rapid advancement, cutting-edge training, and impactful global projects. Embrace E.A.R.T.H. values, celebrate uniqueness, and drive...

  • AWS Data Engineer

    6 days ago

    Madurai, Tamil Nadu, India Techmango Technology Services Private Limited Full time ₹ 80,00,000 - ₹ 2,40,00,000 per year

    About TechMango:Founded in 2014, TechMango Technology Services is a leading software development company with a strong focus on emerging technologies. Our primary goal is to deliver strategic solutions that align with our business partners' technological needs.We specialize in providing custom software solutions using the best available technologies,...