Data Engineer

6 days ago

Madurai, India HCLTech Full time

Azure Data Lead with Azure Data Factory (ADF),Azure Databricks,


Job Summary

The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements and align with best practices. (1.) Key Responsibilities

1. Lead and manage end-to-end data engineering projects using azure data factory, azure databricks, sql, oracle pl/sql, and python.

2. Collaborate with stakeholders to gather and understand requirements for data pipelines and analytics solutions.

3. Design and develop etl processes, data models, and data integration solutions.

4. Provide technical guidance and mentorship to the team members.

5. Ensure data quality, data governance, and data security standards are maintained throughout the project lifecycle.

6. Troubleshoot and optimize data pipelines and processes for performance and efficiency.

7. Stay updated on the latest trends and technologies in data engineering and contribute to continuous improvement efforts.


Skill Requirements

1. Proficiency in azure data factory (adf) and azure databricks for building and managing data pipelines.

2. Strong experience with sql and oracle pl/sql for data querying and manipulation.

3. Advanced programming skills in python for scripting and data processing tasks.

4. Knowledge of data modeling, data warehousing concepts, and database design principles.

5. Ability to work in a collaborative team environment and communicate effectively with stakeholders.

6. Strong analytical and problem-solving skills with attention to detail.

7. Experience in data visualization tools and techniques is a plus.

  • Data Engineer

    2 weeks ago

    Madurai, Tamil Nadu, India Bahwan CyberTek Full time

    Job Title: Data Engineer – Google Cloud Platform (GCP) Job Summary We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data solutions on Google Cloud Platform. The ideal candidate will be proficient in GCP services like Pub/Sub, Dataflow, Cloud Storage, and BigQuery, with a...

  • Data Engineer

    6 days ago

    Madurai, India Peoplefy Full time

    Responsibilities:Lead the design and development of scalable data pipelines using AWS (Glue, Redshift, Athena) Drive architecture decisions for data systems that support business analytics and application features Build end-to-end solutions, including backend APIs and, where applicable, simple UI components Orchestrate workflows using Airflow or equivalent...

  • Data Engineer

    6 days ago

    Madurai, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks, Job Summary The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business...

  • Data Engineer

    5 days ago

    Madurai, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks,Job SummaryThe Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements...

  • Data Engineer

    1 week ago

    Madurai, India HCLTech Full time

    Azure Senior Data Engineer with Azure Data Factory (ADF), Azure Databricks, SQL, PythonLocation: MaduraiExperience: 3 to 8 yearsJob SummaryThe Senior Developer will be responsible for developing and maintaining solutions using Azure Data Factory (ADF), Azure Databricks, SQL, and Python. The primary objectives includes building and optimizing data pipelines...

  • Data Engineer

    1 week ago

    madurai, India HCLTech Full time

    Azure Senior Data Engineer with Azure Data Factory (ADF), Azure Databricks, SQL, PythonLocation: MaduraiExperience: 3 to 8 yearsJob SummaryThe Senior Developer will be responsible for developing and maintaining solutions using Azure Data Factory (ADF), Azure Databricks, SQL, and Python. The primary objectives includes building and optimizing data pipelines...

  • Data engineer

    2 weeks ago

    Madurai, India Canopus Infosystems - A CMMI Level 3 Company Full time

    Position: Data EngineerExperience: 2+ YearsLocation: RemoteJoining: Immediate Joiners PreferredAbout the Role:We are looking for a skilled Data Engineer with strong Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization. The ideal candidate should be capable of building data pipelines, performing...

  • Data Engineer

    6 days ago

    Madurai, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks,Job SummaryThe Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements...

  • Data Engineer

    4 days ago

    Madurai, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks,Job SummaryThe Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements...

  • Senior Data Engineer

    1 week ago

    Madurai, India Manuh Technologies Full time

    Required Qualifications5+ years of professional experience in data engineering, data science engineering, or related fields.Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing.Proven expertise as a Data Modeler (conceptual, logical, and physical...