Data Engineer

1 month ago

Mumbai, India Change leaders Full time

Primary Skill :


- GCP + Python + SQL

OR

- GCP + Java + SQL

NP : Immediate to 35 Days max

Job Location : Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida

- Bachelor's degree in computer science or a related discipline

- 6+ years of applicable engineering experience

- Experience in GCP, Big Query

- Strong proficiency in Python with an emphasis in building data pipelines

- Ability to write complex SQL to perform common types of analysis and aggregations

- Experience with Apache Airflow or Google Composer

- Detail-oriented and document all the work

- Ability to work with others from diverse skill-sets and backgrounds

- GCP solution architect - certified

Responsibilities :

- Design, develop, and deploy scalable and reliable data pipelines on Google Cloud Platform using services such as Cloud Dataflow, Apache Beam, or Apache Spark on Dataproc.

- Work closely with data scientists and analysts to understand data requirements and implement solutions that enable efficient data processing, analysis, and visualization.

- Build and maintain data ingestion processes from various sources (e.g. databases, APIs, streaming data) into GCP data storage solutions like BigQuery, Cloud Storage, and Cloud SQL.

- Optimize and tune data pipelines for performance, scalability, and cost-effectiveness.

- Implement data security and compliance measures to ensure data integrity and privacy.

- Collaborate with cross-functional teams to support data-driven decision-making and business intelligence initiatives.

- Stay updated with the latest trends and best practices in data engineering and GCP services.

Requirements :

- Bachelor's degree in Computer Science, Engineering, or a related field.

- Proven experience as a data engineer with a focus on designing and building data pipelines and analytics solutions.

- Hands-on experience with Google Cloud Platform services, particularly BigQuery, Cloud Dataflow, Cloud Storage, and Cloud Pub/Sub.

- Proficiency in programming languages such as Python, Java, or Scala for data processing and pipeline development.

- Strong understanding of data modeling, database design principles, and SQL.

- Experience with workflow orchestration tools like Apache Airflow or Google Cloud Composer.

- Familiarity with DevOps practices and tools for CI/CD, version control, and infrastructure as code.

- Excellent problem-solving and analytical skills.

- Effective communication and collaboration skills.

(ref:hirist.tech)

  • Data Engineer

    3 days ago

    mumbai, India SparkNet Innovations Full time

    Company DescriptionSparkNet is a trusted partner for businesses seeking to unlock the potential of data science and AI. They specialize in delivering end-to-end solutions that drive innovation, optimize operations, and fuel growth across diverse industries. With expertise in data engineering, AI consulting, and advanced data science, SparkNet transforms...

  • Data Engineer

    4 days ago

    Mumbai, India SparkNet Innovations Full time

    Company Description SparkNet is a trusted partner for businesses seeking to unlock the potential of data science and AI. They specialize in delivering end-to-end solutions that drive innovation, optimize operations, and fuel growth across diverse industries. With expertise in data engineering, AI consulting, and advanced data science, SparkNet transforms...

  • Data Engineer

    4 days ago

    Mumbai, India SparkNet Innovations Full time

    Company Description SparkNet is a trusted partner for businesses seeking to unlock the potential of data science and AI. They specialize in delivering end-to-end solutions that drive innovation, optimize operations, and fuel growth across diverse industries. With expertise in data engineering, AI consulting, and advanced data science, SparkNet transforms...

  • Data Engineer

    3 days ago

    mumbai, India SparkNet Innovations Full time

    Company Description SparkNet is a trusted partner for businesses seeking to unlock the potential of data science and AI. They specialize in delivering end-to-end solutions that drive innovation, optimize operations, and fuel growth across diverse industries. With expertise in data engineering, AI consulting, and advanced data science, SparkNet transforms...

  • Data Engineer

    6 days ago

    Mumbai, India Newfold Digital Full time

    Data EngineerJOB DESCRIPTIONNewfold Digital is looking for a seasoned Data Engineer. This role will participate in all aspects of the development lifecycle, from scoping and requirements to solutioning, implementation and support. The ideal candidate would have extensive experience developing and supporting a DW service comprised of multiple Data Warehouses...

  • Data Engineer

    4 weeks ago

    Mumbai, India Antal International Full time

    Job DescriptionData Engineer Job Responsibilities:· Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.· Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering...

  • Data Engineer

    4 weeks ago

    Mumbai, India Searce Technologies Inc Full time

    about the roleData Engineer identifies the business problem and translates these to data services and engineering outcomes. You will deliver data solutions that empower better decision making and flexibility of your solution that scales to respond to broader business questions.key responsibilitiesAs a Data Engineer, you are a full-stack data engineer that...

  • Data Engineer

    1 month ago

    mumbai, India Antal International Full time

    Job Description Data Engineer Job Responsibilities: · Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity. · Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and...

  • Data Engineer

    1 month ago

    Mumbai, India Searce Technologies Inc Full time

    about the role Data Engineer identifies the business problem and translates these to data services and engineering outcomes. You will deliver data solutions that empower better decision making and flexibility of your solution that scales to respond to broader business questions. key responsibilities As a Data Engineer, you are a full-stack...

  • Data Engineer

    1 week ago

    Mumbai, India Newfold Digital Full time

    Data Engineer JOB DESCRIPTION Newfold Digital is looking for a seasoned Data Engineer. This role will participate in all aspects of the development lifecycle, from scoping and requirements to solutioning, implementation and support. The ideal candidate would have extensive experience developing and supporting a DW service comprised of multiple Data...

  • Data Engineer

    1 week ago

    mumbai, India Newfold Digital Full time

    Data Engineer JOB DESCRIPTION Newfold Digital is looking for a seasoned Data Engineer. This role will participate in all aspects of the development lifecycle, from scoping and requirements to solutioning, implementation and support. The ideal candidate would have extensive experience developing and supporting a DW service comprised of multiple Data...

  • Data Engineer

    1 month ago

    mumbai, India Searce Technologies Inc Full time

    about the role Data Engineer identifies the business problem and translates these to data services and engineering outcomes. You will deliver data solutions that empower better decision making and flexibility of your solution that scales to respond to broader business questions. key responsibilities As a Data Engineer, you are a...

  • Data Engineer

    4 weeks ago

    Mumbai, India Puma Energy Full time

    Main Purpose:Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake.Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists to develop insightful analytics and business stakeholders to make well-informed...

  • Data Engineer

    1 month ago

    mumbai, India Anicalls (Pty) Ltd Full time

    Candidate should have: Clear, concise communication abilities - writing, verbal, presentation - to all levels of technical and non-technical audiences with the ability to collaborate Strong experience in CICD technologies including Python, SQL, Airflow, and Git in a cloud setting Understanding of ELK stack is a plus for logging and reporting purposes...

  • Data Engineer

    8 hours ago

    Mumbai, India HR PLACEMENT CONSULTANTS (HRPC) Full time

    Position- Data EngineerLocation-MumbaiTotal Experience 7+ yearsDomain/Vertical Insurance and / or Finance (preferred)Qualifications Educational  MSc/MCS/BE/B.Sc : Computer Science / Maths / ITExperience• 7+ years of experience into Data Engineering.• Experience programming skills in both Python and SQL.• Experience with infrastructure as code,...

  • Data Engineer

    1 month ago

    Mumbai, India Puma Energy Full time

    Main Purpose: Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake. Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists to develop insightful analytics and business stakeholders to make well-informed...

  • Data Engineer

    1 month ago

    mumbai, India Puma Energy Full time

    Main Purpose: Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake.Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists to develop insightful analytics and business stakeholders to make...

  • Data Engineer

    2 weeks ago

    mumbai, India Virtusa Full time

    Data Engineer - CREQ187220 Description 6-8 years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data Security...

  • Data Engineer

    2 weeks ago

    Mumbai, India Virtusa Full time

    Data Engineer - CREQ187220 Description 6-8 years of relevant work experience showing growth as a Data Engineer. Hands On programming experience Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation. Experience of performance optimization in Batch and Real time processing applications Expertise in Data Governance and Data Security...

  • Data Engineer

    2 weeks ago

    navi mumbai, India Manufacturing MNC Full time

    Location-Navi Mumbai- PreferredBangaloreRequirement-Looking for Data Engineer with SAP experience3-5 years of ExperienceBachelors or master's in technology or engineeringStrong knowledge on Data Engineering aspectsImplementing methods to improve data reliability and quality.Combining raw information from different sources to create consistent and...