Data Engineer

3 days ago

Anywhere in IndiaMultiple Locations, IN Gama Advisory Services LLP Full time

Overview :

We are looking for a highly skilled Data Engineer with extensive experience in ETL (Extract, Transform, Load) processes and PySpark to join our team.

As a Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines that support data transformation and processing needs.

Your expertise in PySpark and ETL frameworks will play a critical role in optimizing data workflows and ensuring data integrity across our organization.

Responsibilities :

- Design, develop, and deploy robust ETL pipelines using PySpark to extract, transform, and load large volumes of data from various sources into data lakes or data warehouses.

- Collaborate with data architects, analysts, and other stakeholders to understand data requirements and translate them into technical solutions.

- Optimize and tune ETL processes for performance and scalability, ensuring efficient data processing and storage.

- Implement data quality checks and monitoring processes to ensure data consistency and accuracy.

- Develop and maintain documentation for data pipelines, workflows, and data models.

- Stay updated with industry trends and best practices in data engineering, ETL frameworks, and big data technologies.

- Troubleshoot and resolve issues related to data processing, ETL failures, and performance bottlenecks.

- Work closely with cross-functional teams to integrate new data sources and support data analytics and reporting initiatives.

Requirements :

- Bachelor's degree in Computer Science, Engineering, or related field; advanced degree preferred.

- 5+ years of experience as a Data Engineer, with a strong focus on ETL development using PySpark.

- Expertise in designing and implementing complex data pipelines and workflows.

- Proficiency in programming languages such as Python and SQL for data manipulation and analysis.

- Hands-on experience with big data technologies and distributed computing frameworks (eg, Hadoop, Spark).

- Strong understanding of data warehousing concepts, data modeling, and schema design.

- Experience with cloud platforms (e.g, AWS, Azure, GCP) and their data services.

- Excellent problem-solving skills and the ability to analyze and resolve complex technical issues.

- Effective communication skills with the ability to collaborate with technical and non-technical stakeholders.

Preferred Qualifications :

- Certification in PySpark or relevant big data technologies.

- Familiarity with data governance and security best practices.

- Experience with containerization (e.g, Docker, Kubernetes) and orchestration tools.

- Knowledge of streaming data processing frameworks (e.g, Kafka, Spark Streaming)

(ref:hirist.tech)

  • Aptus Data Labs

    2 months ago

    Anywhere in India/Multiple Locations, IN Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Aptus Data Labs

    4 weeks ago

    Anywhere in India/Multiple Locations, IN Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • MLOps Engineer

    2 months ago

    Anywhere in India/Multiple Locations, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • MLOps Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • Data Engineer

    1 month ago

    Anywhere in India/Multiple Locations, IN Coders Brain Technology Pvt. Ltd. Full time

    Position Name : Data Engineer (Integration)Experience Required : 10+yrsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description :- Understand all forms of data integration including APIs - Event-based, Streaming, REST and GraphQL API, CDC/Replication, Batch,...

  • Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN Coders Brain Technology Pvt. Ltd. Full time

    Position Name : Data Engineer (Integration)Experience Required : 10+yrsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description :- Understand all forms of data integration including APIs - Event-based, Streaming, REST and GraphQL API, CDC/Replication, Batch,...

  • Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN Coders Brain Technology Pvt. Ltd. Full time

    Position Name : Data ArchitectExperience Required : 10yrsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description : 10+ years of proven experience as a Data Engineer with 5+ years as Data Architect.- Bachelor's degree in computer science, Information...

  • Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN Coders Brain Technology Pvt. Ltd. Full time

    Position Name : Data ArchitectExperience Required : 10yrsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description : 10+ years of proven experience as a Data Engineer with 5+ years as Data Architect.- Bachelor's degree in computer science, Information...

  • Senior Data Engineer

    2 weeks ago

    Anywhere in India/Multiple Locations, IN MindBrain Full time

    Company Description. MindBrain seamlessly integrates innovation, education, and strategic workforce solutions. As a dynamic software company, we shape the future of technology. With a focus on comprehensive IT and non-IT training, we nurture talent, empowering individuals to lead in a rapidly evolving landscape. Through strategic resource augmentation, we...

  • Senior/Staff Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN Grorapid labs Full time

    Senior / Staff Engineer Data EngineeringExperience Required : 8 - 14 years working Days 5 days/week Office Location : Remote WorkingRole & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner.- Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative...

  • Senior/Staff Engineer

    2 months ago

    Anywhere in India/Multiple Locations, IN Grorapid labs Full time

    Senior / Staff Engineer Data EngineeringExperience Required : 8 - 14 years working Days 5 days/week Office Location : Remote WorkingRole & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner.- Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative...

  • Lead Data Engineer

    1 month ago

    Anywhere in India/Multiple Locations, IN Pro5.ai Full time

    Job Description :Technical delivery lead on platform and project builds for building and maintaining optimised and highly available data pipelines that facilitate data management and data analytics solutions. The role will drive the development of data processing frameworks and data architectural approaches that scale to handle the business's growing...

  • Lead Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN Pro5.ai Full time

    Job Description :Technical delivery lead on platform and project builds for building and maintaining optimised and highly available data pipelines that facilitate data management and data analytics solutions. The role will drive the development of data processing frameworks and data architectural approaches that scale to handle the business's growing...

  • Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN ARAHAS TECHNOLOGIES PRIVATE LIMITED Full time

    We are currently hiring a Pyspark Data Engineer with AWS expertise with7 years of experience Job Description :- The candidate should have strong skills in Pyspark coding and have a background in AWS technologies such as Airflow- Experience working with complex SQL queries- Good with PySpark, Databricks, and Airflow- Bachelor's or Master's degree in...

  • Data Engineer

    2 months ago

    Anywhere in India/Multiple Locations, IN Paralleldots Full time

    Job Description :As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and :- Lead the design,...

  • DevOps & Data Engineer

    2 months ago

    Anywhere in India/Multiple Locations, IN Dotflick Solutions Full time

    Profile : DevOps and Data EngineerJob description : This role is a Hybrid DevOps and Data Engineering.Mode : WFO/WFHRoles & responsibilities : - Setting up tools and required infrastructure- Defining and setting development, test, release, update, and support processes for DevOps operation- Have the technical skill to review, verify, and validate the...

  • DevOps & Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN Dotflick Solutions Full time

    Profile : DevOps and Data EngineerJob description : This role is a Hybrid DevOps and Data Engineering.Mode : WFO/WFHRoles & responsibilities : - Setting up tools and required infrastructure- Defining and setting development, test, release, update, and support processes for DevOps operation- Have the technical skill to review, verify, and validate the...

  • Data Engineer

    2 months ago

    Anywhere in India/Multiple Locations, IN Perfecthire Full time

    Job Description : We are seeking a talented and experienced Data Engineer to join our team and play a key role in the development and implementation of our end-to-end 834 EDI solution. A robust level of experience or familiarity with 834 EDI (Electronic Data Interchange) transactions is critical for this role. As a Data Engineer, you will be responsible for...

  • Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN Perfecthire Full time

    Job Description : We are seeking a talented and experienced Data Engineer to join our team and play a key role in the development and implementation of our end-to-end 834 EDI solution. A robust level of experience or familiarity with 834 EDI (Electronic Data Interchange) transactions is critical for this role. As a Data Engineer, you will be responsible for...

  • ParallelDots - Senior Data Engineer - Big Data Technologies

    3 days ago

    Anywhere in India/Multiple Locations, IN Paralleldots Full time

    Job Description :As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and :- Lead the design,...