Data Engineer

3 weeks ago


Anywhere in IndiaMultiple Locations Change Leaders Full time

Primary Skill - GCP + Python + SQL

OR

GCP + Java + SQL

NP - Immediate to 35 Days max

Job Location - Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida

- Bachelor's degree in computer science or a related discipline

- 6+ years of applicable engineering experience

- Experience in GCP, Big Query

- Strong proficiency in Python with an emphasis in building data pipelines

- Ability to write complex SQL to perform common types of analysis and aggregations

- Experience with Apache Airflow or Google Composer

- Detail-oriented and document all the work

- Ability to work with others from diverse skill-sets and backgrounds

- GCP solution architect - Design, develop, and deploy scalable and reliable data pipelines on Google Cloud Platform using services such as Cloud Dataflow, Apache Beam, or Apache Spark on Dataproc.

- Work closely with data scientists and analysts to understand data requirements and implement solutions that enable efficient data processing, analysis, and visualization.

- Build and maintain data ingestion processes from various sources (e.g., databases, APIs, streaming data) into GCP data storage solutions like BigQuery, Cloud Storage, and Cloud SQL.

- Optimize and tune data pipelines for performance, scalability, and cost-effectiveness.

- Implement data security and compliance measures to ensure data integrity and privacy.

- Collaborate with cross-functional teams to support data-driven decision-making and business intelligence initiatives.

- Stay updated with the latest trends and best practices in data engineering and GCP Bachelor's degree in Computer Science, Engineering, or a related field.

- Proven experience as a data engineer with a focus on designing and building data pipelines and analytics solutions.

- Hands-on experience with Google Cloud Platform services, particularly BigQuery, Cloud Dataflow, Cloud Storage, and Cloud Pub/Sub.

- Proficiency in programming languages such as Python, Java, or Scala for data processing and pipeline development.

- Strong understanding of data modeling, database design principles, and SQL.

- Experience with workflow orchestration tools like Apache Airflow or Google Cloud Composer.

- Familiarity with DevOps practices and tools for CI/CD, version control, and infrastructure as code.

- Excellent problem-solving and analytical skills.

- Effective communication and collaboration skills.

(ref:hirist.tech)
  • Data Architect

    6 days ago


    Anywhere In India/multiple Locations Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ Years Location - Remote Skills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS Cloud We are seeking a highly skilled and experienced Data Architect to join our team.The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS...

  • Sigmoid Analytics

    3 weeks ago


    Anywhere in India/Multiple Locations ASTAR DATA LLP Full time

    Job Description : This position will be part of a growing team working towards building world-class large scale Big Data architectures.Responsibilities : Good Development Practices :- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy,...

  • Sigmoid Analytics

    2 months ago


    Anywhere in India,Multiple Locations ASTAR DATA LLP Full time

    Job Description : This position will be part of a growing team working towards building world-class large scale Big Data architectures.Responsibilities : Good Development Practices :- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy,...

  • Aptus Data Labs

    3 weeks ago


    Anywhere in India/Multiple Locations Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Aptus Data Labs

    1 month ago


    Anywhere in India/Multiple Locations Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Aptus Data Labs

    1 month ago


    Anywhere in India/Multiple Locations, IN Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Aptus Data Labs

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Sigmoid Analytics

    2 months ago


    Anywhere in India,Multiple Locations ASTAR DATA LLP Full time

    This position will be part of a growing team working towards building world-class large scale Big Data Good Development Practices:- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy, unit testing, code deployment- Self-starter to be...

  • Sigmoid Analytics

    3 weeks ago


    Anywhere in India/Multiple Locations ASTAR DATA LLP Full time

    This position will be part of a growing team working towards building world-class large scale Big Data Good Development Practices:- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy, unit testing, code deployment- Self-starter to be...

  • MLOps Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • MLOps Engineer

    1 month ago


    Anywhere in India/Multiple Locations, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • MLOps Engineer

    1 month ago


    Anywhere in India/Multiple Locations GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • MLOps Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • Data Engineer

    6 days ago


    Anywhere in India/Multiple Locations BlueByte Technologies Full time

    Position : Data engineerLocation : Remote/ HybridMust have - AKS, Python and SQLGood to have - Erwin toolJob Description :seeking a skilled and motivated AKS (Azure Kubernetes Service) Data Engineer to join our dynamic team (can be open for GKS exp in place of AKS too). The ideal candidate will have a strong background in data engineering, experience with...

  • Data Engineer

    6 days ago


    Anywhere in India/Multiple Locations Arting Digital Full time

    Position Title : Data EngineerExp : 5+ yearsLocation : RemotePrimary Skills : Data warehousing, ETL leveraging Snowflake, ADF ,Python Qualification : AnyRoles and responsibilities : An offshore Data Engineer to work with the Investment Analytics team. This person needs to have a strong exp of Data warehousing and ETL leveraging Snowflake, ADF and Python. A...

  • Data Engineer

    5 days ago


    Anywhere in India/Multiple Locations CliqHR Full time

    Work Mode : Remote (but need to do WFO after joining of 1st week)Preferred candidate profile : Minimum 5+ years of work experience in Data Analysis, BI or Data Engineering roles with a quantitative degree preferably in Computer Science, Statistics or Mathematics. Excellent Data handling and strong analytical skills to collect, transform and discover...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Coders Brain Technology Pvt. Ltd. Full time

    Position Name : Data Engineer (Integration) Experience Required : 10+yrs Salary : As per the Market Standard or Else whatever budget you have Notice period : Immediate joiner Job Type : Full time Location : Remote Job Description :- Understand all forms of data integration including APIs - Event-based, Streaming, REST and GraphQL API, CDC/Replication,...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN Coders Brain Technology Pvt. Ltd. Full time

    Position Name : Data Engineer (Integration)Experience Required : 10+yrsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description :- Understand all forms of data integration including APIs - Event-based, Streaming, REST and GraphQL API, CDC/Replication, Batch,...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Coders Brain Technology Pvt. Ltd. Full time

    Position Name : Data Engineer (Integration)Experience Required : 10+yrsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description :- Understand all forms of data integration including APIs - Event-based, Streaming, REST and GraphQL API, CDC/Replication, Batch,...

  • Data Engineer

    6 days ago


    Anywhere in India/Multiple Locations ARAHAS TECHNOLOGIES PRIVATE LIMITED Full time

    We are currently hiring a Pyspark Data Engineer with AWS expertise with7 years of experience Job Description :The candidate should have strong skills in Pyspark coding and have a background in AWS technologies such as Airflow Experience working with complex SQL queries Good with PySpark, Databricks, and Airflow Bachelor's or Master's degree in computer...