Data Engineer

1 month ago


Any LocationOverseasInternationalBangaloreAtlanta, India HS Solutions Inc Full time

About the job :

Tech stack :

- BigQuery , any ETL tool (Informatica, Talend, DataStage), Dataflow, Dataproc.

- 3-5 years' Experience in Data warehouse and Data lake implementation.

- 1-2 years of experience in Google Cloud Platform (especially Big Query).

- 1-2 years of working experience in converting ETL jobs( in Informatica/Talend,/DataStage) into Dataflow or Dataproc and migrated in CI\CD pipeline.

- Design, develop and deliver data integration/data extraction solutions using IBM DataStage or other ETL tools and Data Warehouse platforms like Teradata, BigQuery.

- Proficiency in Linux/Unix shell scripting and SQL.

- Knowledge of data Modelling, database design, and the data warehousing ecosystem.

- Ability to troubleshoot and solve complex technical problems.

- Excellent analytical and problem-solving skills.

- Knowledge of working in Agile environments.

Qualifications :

- Bachelor's/Master's degree in Computer Science, Engineering, or a related field; advanced degree preferred.

- 3-5 years of experience in data warehouse and data lake implementation, with a focus on designing and optimizing ETL processes.

- 1-2 years of hands-on experience in Google Cloud Platform (GCP), particularly with BigQuery.

- 1-2 years of working experience in converting ETL jobs (in Informatica, Talend, DataStage) into Dataflow or Dataproc and migrating them into CI/CD pipelines.

- Proficiency in ETL tools such as Informatica, Talend, or DataStage, as well as experience with BigQuery, Dataflow, and Dataproc.

- Strong understanding of data warehouse concepts, data modeling, and ETL best practices.

- Experience with version control systems (e.g, Git) and CI/CD pipelines.

(ref:hirist.tech)
  • Data Engineer

    4 weeks ago


    Any Location/Overseas/International/Bangalore/Atlanta, IN HS Solutions Inc Full time

    About the job :Tech stack : - BigQuery , any ETL tool (Informatica, Talend, DataStage), Dataflow, Dataproc.- 3-5 years' Experience in Data warehouse and Data lake implementation.- 1-2 years of experience in Google Cloud Platform (especially Big Query).- 1-2 years of working experience in converting ETL jobs( in Informatica/Talend,/DataStage) into...


  • Any Location, IN K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...


  • Any Location, India K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...


  • Overseas/International, IN Freelancer HR Full time

    Job Description Responsibilities :- Understand the factories , manufacturing process , data availability and avenues for improvement- Brainstorm , together with engineering, manufacturing and quality problems that can be solved using the acquired data in the data lake platform.- Define what data is required to create a solution and work with connectivity...


  • Overseas/International, India Freelancer HR Full time

    Job Description Responsibilities : - Understand the factories , manufacturing process , data availability and avenues for improvement- Brainstorm , together with engineering, manufacturing and quality problems that can be solved using the acquired data in the data lake platform.- Define what data is required to create a solution and work with connectivity...

  • MLOps Developer

    1 day ago


    Any Location, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • MLOps Developer

    1 day ago


    Any Location, India GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description : - Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring. - Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and...

  • Data Engineer

    4 weeks ago


    Bangalore/Any Location, IN INSIGHT GLOBAL SOLUTIONS Full time

    Data Engineer Must Haves :- Bachelors Degree in science, technology, or another related field.- 3+ years of data engineering experience.- 3+ years of experience with Cloud platforms like GCP, Azure, Airflow.- 4+ years of data warehouse, relational database, and SQL experience.- 4+ years of supporting ETL process and job scheduling experience.- 3+ years of...

  • Data Engineer

    2 weeks ago


    Bangalore/Any Location, India INSIGHT GLOBAL SOLUTIONS Full time

    Data Engineer Must Haves :- Bachelors Degree in science, technology, or another related field.- 3+ years of data engineering experience.- 3+ years of experience with Cloud platforms like GCP, Azure, Airflow.- 4+ years of data warehouse, relational database, and SQL experience.- 4+ years of supporting ETL process and job scheduling experience.- 3+ years of...

  • Data Engineer

    1 week ago


    Any Location, IN Reliable Group Full time

    POSITION DESCRIPTION :WHAT YOU'LL DO :- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow.- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.- Actively monitor and triage technical...

  • Data Engineer

    1 week ago


    Any Location, India Reliable Group Full time

    POSITION DESCRIPTION :WHAT YOU'LL DO :- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow.- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.- Actively monitor and triage...

  • Data Engineer

    2 weeks ago


    Any Location, India Muoro Full time

    Responsibilities :- Design, develop, and maintain robust data pipelines using Apache Spark, Python, and other relevant technologies.- Implement data ingestion processes from various sources, ensuring data quality and integrity.- Optimize and tune data pipelines for performance and scalability.- Collaborate with data scientists and analysts to deploy machine...

  • Data Engineer

    4 weeks ago


    Any Location, IN Muoro Full time

    Responsibilities :- Design, develop, and maintain robust data pipelines using Apache Spark, Python, and other relevant technologies.- Implement data ingestion processes from various sources, ensuring data quality and integrity.- Optimize and tune data pipelines for performance and scalability.- Collaborate with data scientists and analysts to deploy machine...

  • Data Engineer

    1 month ago


    Overseas,International,Philadelphia, India IT Full time

    About the job :Job Description:- Utilize PySpark and SQL programming languages to develop and maintain data pipelines for processing and analyzing large datasets.- Work on-site from day one, collaborating closely with the team in a fast-paced environment.- Preferably have experience in the Telecom domain to understand and address domain-specific challenges...

  • Senior Data Engineer

    2 weeks ago


    Bangalore/Any Location, India SWAI TECHNOLOGIES PRIVATE LIMITED Full time

    Job Description : We are seeking a highly skilled Senior Data Engineer with 5 - 12 years of experience in building scalable data solutions. The ideal candidate should be proficient in Python programming and SQL, with extensive experience in utilizing various AWS services for data processing and storage. Experience with big data processing environments,...

  • Senior Data Engineer

    4 weeks ago


    Bangalore/Any Location, IN SWAI TECHNOLOGIES PRIVATE LIMITED Full time

    Job Description :We are seeking a highly skilled Senior Data Engineer with 5 - 12 years of experience in building scalable data solutions. The ideal candidate should be proficient in Python programming and SQL, with extensive experience in utilizing various AWS services for data processing and storage.Experience with big data processing environments,...

  • Senior Data Engineer

    1 month ago


    Any Location, India Muoro Full time

    Role & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner. - Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative solutions. - Build a team that mines, analyzes, and transforms large (un)structured datasets, collaborating with analysts, data...

  • Senior Data Engineer

    4 weeks ago


    Any Location, IN Muoro Full time

    Role & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner. - Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative solutions. - Build a team that mines, analyzes, and transforms large [un]structured datasets, collaborating with analysts, data...


  • Any Location, IN K2 Data & Analytics Full time

    Job Description :Join our team in crafting the future of media with our cutting-edge platforms and technologies. We're on the lookout for highly motivated senior software engineers with a knack for building innovative software. If you're passionate about leveraging ML, search, and recommendation algorithms while mastering distributed architectures,...


  • Any Location, India K2 Data & Analytics Full time

    Job Description : Join our team in crafting the future of media with our cutting-edge platforms and technologies. We're on the lookout for highly motivated senior software engineers with a knack for building innovative software. If you're passionate about leveraging ML, search, and recommendation algorithms while mastering distributed...