Data Engineer

4 weeks ago

Any LocationBangalore, India KARYA CONSULTANTS PRIVATE LIMITED Full time

As a GCP Data Engineer, you will be a key player in designing, implementing, and optimizing data solutions on the Google Cloud Platform.

We are seeking a professional with hands-on experience in data engineering and a strong understanding of GCP services.

Key Responsibilities :

Data Architecture :


- Design and implement scalable and efficient data architectures on the Google Cloud Platform to meet project and business requirements.

GCP Implementation :


- Lead the implementation of data solutions using GCP services such as BigQuery, Dataflow, Dataprep, etc. ensuring optimal performance and reliability.

Data Integration :


- Develop and maintain robust data integration processes, facilitating seamless data flow across diverse systems and platforms.

ETL Processes :


- Design and implement ETL processes for extracting, transforming, and loading data into GCP, ensuring data quality and accuracy.

Performance Optimization :


- Identify and address performance bottlenecks, troubleshoot data-related issues, and implement optimizations to enhance overall system performance.

Data Security and Governance :


- Implement data security measures and ensure compliance with data governance policies and standards.

Collaboration :


- Work collaboratively with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver effective solutions.

Documentation :


- Create and maintain comprehensive documentation for data architectures, processes, and best practices.

Minimum Qualifications :

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- Hands-on experience in data engineering, with a focus on Google Cloud Platform.

- Hands-on experience with GCP services, including but not limited to BigQuery, Dataflow, Dataprep, Dataproc etc.

- Proficiency in programming languages such as Python, SQL, or Java.

- Experience with data modeling, ETL processes, and data integration.

- Strong analytical and problem-solving skills.

- Excellent communication and collaboration skills.

(ref:hirist.tech)

  • Senior Machine Learning Engineer

    4 weeks ago

    Any Location, India K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Senior Machine Learning Engineer

    1 month ago

    Any Location, IN K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • MLOps Developer

    2 weeks ago

    Any Location, India GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description : - Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring. - Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and...

  • MLOps Developer

    2 weeks ago

    Any Location, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • Data Engineer

    4 weeks ago

    Bangalore/Any Location, India INSIGHT GLOBAL SOLUTIONS Full time

    Data Engineer Must Haves :- Bachelors Degree in science, technology, or another related field.- 3+ years of data engineering experience.- 3+ years of experience with Cloud platforms like GCP, Azure, Airflow.- 4+ years of data warehouse, relational database, and SQL experience.- 4+ years of supporting ETL process and job scheduling experience.- 3+ years of...

  • Data Engineer

    1 month ago

    Bangalore/Any Location, IN INSIGHT GLOBAL SOLUTIONS Full time

    Data Engineer Must Haves :- Bachelors Degree in science, technology, or another related field.- 3+ years of data engineering experience.- 3+ years of experience with Cloud platforms like GCP, Azure, Airflow.- 4+ years of data warehouse, relational database, and SQL experience.- 4+ years of supporting ETL process and job scheduling experience.- 3+ years of...

  • Data Engineer

    1 day ago

    Any Location, India Edstem Technologies Full time

    Role : Data Engineer Roles : We are looking for Data Engineers for an AI based product development for one of our clients in the banking industry. As a data engineer you will play a pivotal role in collaborating with a team of skilled data engineers to develop and operationalize machine learning models that drive customer satisfaction and enhance our...

  • Data Engineer

    1 hour ago

    Any Location, IN Edstem Technologies Full time

    Role : Data Engineer Roles : We are looking for Data Engineers for an AI based product development for one of our clients in the banking industry. As a data engineer you will play a pivotal role in collaborating with a team of skilled data engineers to develop and operationalize machine learning models that drive customer satisfaction and enhance our...

  • Data Engineer

    3 weeks ago

    Any Location, India Reliable Group Full time

    POSITION DESCRIPTION :WHAT YOU'LL DO :- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow.- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.- Actively monitor and triage...

  • Data Engineer

    3 weeks ago

    Any Location, IN Reliable Group Full time

    POSITION DESCRIPTION :WHAT YOU'LL DO :- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow.- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.- Actively monitor and triage technical...

  • Data Engineer

    4 weeks ago

    Any Location, India Muoro Full time

    Responsibilities :- Design, develop, and maintain robust data pipelines using Apache Spark, Python, and other relevant technologies.- Implement data ingestion processes from various sources, ensuring data quality and integrity.- Optimize and tune data pipelines for performance and scalability.- Collaborate with data scientists and analysts to deploy machine...

  • Data Engineer

    1 month ago

    Any Location, IN Muoro Full time

    Responsibilities :- Design, develop, and maintain robust data pipelines using Apache Spark, Python, and other relevant technologies.- Implement data ingestion processes from various sources, ensuring data quality and integrity.- Optimize and tune data pipelines for performance and scalability.- Collaborate with data scientists and analysts to deploy machine...

  • Senior Data Engineer

    4 weeks ago

    Bangalore/Any Location, India SWAI TECHNOLOGIES PRIVATE LIMITED Full time

    Job Description : We are seeking a highly skilled Senior Data Engineer with 5 - 12 years of experience in building scalable data solutions. The ideal candidate should be proficient in Python programming and SQL, with extensive experience in utilizing various AWS services for data processing and storage. Experience with big data processing environments,...

  • Senior Data Engineer

    1 month ago

    Any Location, India Muoro Full time

    Role & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner. - Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative solutions. - Build a team that mines, analyzes, and transforms large (un)structured datasets, collaborating with analysts, data...

  • Senior Data Engineer

    1 month ago

    Any Location, IN Muoro Full time

    Role & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner. - Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative solutions. - Build a team that mines, analyzes, and transforms large [un]structured datasets, collaborating with analysts, data...

  • Senior Data Engineer

    3 days ago

    Any Location, India Coders Brain Technology Pvt. Ltd. Full time

    Position Name : Sr Data EngineerExperience Required : 8+yearsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description :Solution Architect (Databricks) :Candidate having 8+ years of total experience in Data engineering (development/design), in which at least 5+...

  • Senior Data Engineer

    1 hour ago

    Any Location, IN Coders Brain Technology Pvt. Ltd. Full time

    Position Name : Sr Data EngineerExperience Required : 8+yearsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description :Solution Architect (Databricks) :Candidate having 8+ years of total experience in Data engineering (development/design), in which at least 5+...

  • Data Engineer

    5 days ago

    Any Location, India Suitable.AI Full time

    Role : .Net Core you will do : - Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using DBT, airflow. - Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards. - Actively monitor and triage technical...

  • Data Engineer

    1 hour ago

    Any Location, IN Suitable.AI Full time

    Role : .Net Core you will do :- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using DBT, airflow.- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.- Actively monitor and triage technical challenges...

  • Azure Data Engineer

    4 weeks ago

    Any Location, India Visionyle Full time

    Position Name: Azure Data Engineer Position Mode: PermanentExperience: 6 YearsJoining Location: Remote Notice: ImmediateMode of Interview : 2-3 roundsSUMMARY:Azure Data Engineer should have experience on Azure data lake, Azure SQL database, Databricks, Azure Data Factory, and Azure SQL data warehouse and controlling and granting database access and migrating...