Data Engineer

3 weeks ago

Coimbatore, India Coders Brain Technology Private Limited Full time

Job Description :


We are looking for an experienced Data Engineer with expertise in modern data engineering tools and platforms. The ideal candidate will have strong proficiency in AWS, Azure, Databricks, Apache Airflow, PySpark, and Python, with a proven track record of building and maintaining scalable data pipelines and solutions. This role requires hands-on experience with cloud platforms and a deep understanding of data processing, orchestration, and analytics.

Key Responsibilities :

1. Data Pipeline Development :

- Design, build, and maintain scalable and robust data pipelines using tools like Databricks, Airflow, and PySpark.

- Implement ETL/ELT processes to ensure seamless data ingestion, transformation, and delivery.

- Integrate data from diverse sources into cloud-based data lakes and warehouses.

2. Cloud Data Solutions :

- Leverage AWS and Azure cloud platforms to design and deploy data solutions.

- Optimize data storage and processing on cloud-native platforms for performance and cost efficiency.

3. Data Analytics and Processing :

- Implement batch and real-time data processing pipelines.

- Enable advanced analytics and machine learning by preparing high-quality datasets.

4. Monitoring and Optimization :

- Monitor data pipelines and workflows to ensure reliability and performance.

- Debug and resolve issues, ensuring data accuracy and consistency.

- Continuously optimize workflows for scalability and efficiency.

5. Collaboration :

- Work closely with data scientists, analysts, and other stakeholders to understand requirements.

- Translate business needs into technical solutions and deliver actionable insights.

Technical Skills and Qualifications

Core Technologies :

- Expertise in Databricks, PySpark, and Python for data engineering tasks.

- Proficiency in workflow orchestration tools like Apache Airflow.

Cloud Platforms :

- Hands-on experience with AWS (e.g., S3, Redshift, Glue, EMR).

- Experience with Azure (e.g., Azure Data Factory, Synapse Analytics).

Data Management :

- Strong understanding of data warehousing concepts and best practices.

- Knowledge of data modeling, schema design, and performance tuning.

Other Skills :

- Familiarity with modern DevOps practices and CI/CD pipelines.

- Experience with monitoring tools and frameworks.

Soft Skills :

- Excellent problem-solving and analytical skills.

- Strong collaboration and communication abilities.

- Detail-oriented with a focus on data quality and consistency.

- Ability to manage multiple tasks in a fast-paced environment.

Preferred Qualifications :

- Experience with other orchestration tools or frameworks.

- Exposure to machine learning workflows and MLOps.

- Certification in AWS or Azure data services is a plus.

(ref:hirist.tech)

  • Senior Data Scientist

    1 month ago

    Coimbatore, India Wavicle Data Solutions Full time

    Job Title: Senior Data ScientistWe are seeking a highly skilled Senior Data Scientist with expertise in Generative AI, machine learning, and advanced data science techniques to join our dynamic team. This role involves collaborating with cross-functional teams to develop and deploy scalable AI solutions, driving innovation and business...

  • Senior data scientist

    1 month ago

    Coimbatore, India Wavicle Data Solutions Full time

    Job Title: Senior Data ScientistWe are seeking a highly skilled Senior Data Scientist with expertise in Generative AI, machine learning, and advanced data science techniques to join our dynamic team. This role involves collaborating with cross-functional teams to develop and deploy scalable AI solutions, driving innovation and business...

  • Senior data scientist

    4 weeks ago

    Coimbatore, India Wavicle Data Solutions Full time

    Job Title: Senior Data Scientist We are seeking a highly skilled Senior Data Scientist with expertise in Generative AI, machine learning, and advanced data science techniques to join our dynamic team. This role involves collaborating with cross-functional teams to develop and deploy scalable AI solutions, driving innovation and business outcomes. ...

  • Wavicle Data Solutions | Senior Data Scientist | coimbatore

    1 month ago

    coimbatore, India Wavicle Data Solutions Full time

    Job Title: Senior Data Scientist We are seeking a highly skilled Senior Data Scientist with expertise in Generative AI, machine learning, and advanced data science techniques to join our dynamic team. This role involves collaborating with cross-functional teams to develop and deploy scalable AI solutions, driving innovation and business outcomes....

  • Wavicle Data Solutions | Senior Data Scientist | coimbatore

    1 month ago

    coimbatore, India Wavicle Data Solutions Full time

    Job Title: Senior Data ScientistWe are seeking a highly skilled Senior Data Scientist with expertise in Generative AI, machine learning, and advanced data science techniques to join our dynamic team. This role involves collaborating with cross-functional teams to develop and deploy scalable AI solutions, driving innovation and business...

  • Senior Data Scientist

    1 month ago

    Coimbatore, India Wavicle Data Solutions Full time

    Job Title: Senior Data Scientist We are seeking a highly skilled Senior Data Scientist with expertise in Generative AI, machine learning, and advanced data science techniques to join our dynamic team. This role involves collaborating with cross-functional teams to develop and deploy scalable AI solutions, driving innovation and business outcomes....

  • Senior Data Scientist

    1 month ago

    Coimbatore, India Wavicle Data Solutions Full time

    Job Title: Senior Data ScientistWe are seeking a highly skilled Senior Data Scientist with expertise in Generative AI, machine learning, and advanced data science techniques to join our dynamic team. This role involves collaborating with cross-functional teams to develop and deploy scalable AI solutions, driving innovation and business...

  • Senior Data Scientist

    1 month ago

    Coimbatore, India Wavicle Data Solutions Full time

    Job Title: Senior Data ScientistWe are seeking a highly skilled Senior Data Scientist with expertise in Generative AI, machine learning, and advanced data science techniques to join our dynamic team. This role involves collaborating with cross-functional teams to develop and deploy scalable AI solutions, driving innovation and business...

  • Data Engineer

    3 weeks ago

    Coimbatore, Tamil Nadu, India LION AND ELEPHANTS Full time

    Job Title: Data Engineer.Contract Type: Contract Role (Duration: 3 months).Notice Period: Immediate Joiners are Preferred.Experience Required: 5-7 years.Working Hours: US Shift.Company OverviewLion and Elephants is a leading organization that specializes in big data processing and analysis. We are seeking a skilled Data Engineer to join our team and...

  • Big Data Engineer

    3 weeks ago

    Coimbatore, Tamil Nadu, India Sumeru Consultancy Services Full time

    Job DescriptionA skilled Data Engineer with a strong background in Information Technology/Computer Science Engineering is required at Sumeru Consultancy Services. This role involves designing, building, and managing data infrastructure and pipelines, as well as conducting analysis work to provide insights that guide strategic decisions.Salary Range:$120,000...

  • Data Engineer

    2 months ago

    Coimbatore, India Sumeru Consultancy Services Full time

    Qualification :- Bachelor's or Master's degree in Information Technology/Computer Science Engineering - 5-10 years of experience as Data Engineer- Experience in designing, building, and managing data infrastructure and pipelines, as well as conducting analysis work to provide insights that will guide strategic decisions.Mandatory Skills :- Strong...

  • Data Engineer

    1 week ago

    Coimbatore, India Sumeru Consultancy Services Full time

    Qualification : - Bachelor's or Master's degree in Information Technology/Computer Science Engineering - 5-10 years of experience as Data Engineer- Experience in designing, building, and managing data infrastructure and pipelines, as well as conducting analysis work to provide insights that will guide strategic decisions.Mandatory Skills : -...

  • Big Data Engineer

    2 weeks ago

    Coimbatore, Tamil Nadu, India The Art of Living HR Full time

    About the JobWe are seeking an experienced Data Engineer to join our team at The Art of Living HR. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data management systems to support our business growth.Key Responsibilities:Design and implement data architectures to meet business requirementsDevelop and...

  • Data Engineering Expert

    1 month ago

    Coimbatore, Tamil Nadu, India Sumeru Consultancy Services Full time

    Job Description:Sumeru Consultancy Services is seeking a highly skilled Data Engineer to join our team. This role will be responsible for designing, building, and maintaining large-scale data management systems that meet the business requirements of our clients.As a Senior Data Infrastructure Specialist, you will play a critical role in developing and...

  • Data Engineer

    4 weeks ago

    Coimbatore, India Trantor Full time

    Experience Required - 4-10 years of experience as Data Engineer Location - Coimbatore (Onsite) Description ● Experience in designing, building, and managing data infrastructure and pipelines, as well as conducting analysis work to provide insights that will guide strategic decisions. Mandatory Skills ● Strong proficiency in SQL and Python for data...

  • Data Engineer

    3 weeks ago

    Coimbatore, India Trantor Full time

    Experience Required - 4-10 years of experience as Data EngineerLocation - Coimbatore (Onsite)Description● Experience in designing, building, and managing data infrastructure and pipelines, aswell as conducting analysis work to provide insights that will guide strategic decisions.Mandatory Skills● Strong proficiency in SQL and Python for data analysis,...

  • Senior Data Engineer

    1 month ago

    Coimbatore, India USV PRIVATE LIMITED Full time

    Overview:As a Senior Data Engineer, you will play a pivotal role in designing, implementing, and maintaining the data infrastructure of our organization. You will be responsible for developing robust data pipelines, optimizing data workflows, and ensuring the reliability and scalability of our data systems. Collaboration with cross-functional teams including...

  • Data Engineering Leader

    1 week ago

    Coimbatore, Tamil Nadu, India Trantor Full time

    We are seeking a skilled Data Engineer to join our team at Trantor in Coimbatore, India. The salary for this position is ₹1,200,000 per annum.Job DescriptionData Engineers play a crucial role in designing and maintaining scalable data management systems that meet business requirements and industry practices. We are looking for an individual who can design,...

  • Senior Data Engineer

    3 months ago

    Coimbatore, India Deloitte Full time

    Hi, We are looking for Candidates who are having experience in Data Bricks Engineer Along with any cloud experience. Experience Required: 7- 14 Year sLocation: Coimbatore, Tamil Nadu, Indi a Responsibiliti esDesign, develop, and optimize data workflows and notebooks using Databricks to ingest, transform, and load data from various sources into the data...

  • Senior data engineer

    3 months ago

    Coimbatore, India Deloitte Full time

    Hi, We are looking for Candidates who are having experience in Data Bricks Engineer Along with any cloud experience. Experience Required: 7- 14 Year s Location: Coimbatore, Tamil Nadu, Indi a Responsibiliti es Design, develop, and optimize data workflows and notebooks using Databricks to ingest, transform, and load data from various sources into the...