Data Engineer

3 weeks ago


Any LocationOverseasInternationalBangaloreAtlanta, IN HS Solutions Inc Full time

About the job :

Tech stack :

- BigQuery , any ETL tool (Informatica, Talend, DataStage), Dataflow, Dataproc.

- 3-5 years' Experience in Data warehouse and Data lake implementation.

- 1-2 years of experience in Google Cloud Platform (especially Big Query).

- 1-2 years of working experience in converting ETL jobs( in Informatica/Talend,/DataStage) into Dataflow or Dataproc and migrated in CI\CD pipeline.

- Design, develop and deliver data integration/data extraction solutions using IBM DataStage or other ETL tools and Data Warehouse platforms like Teradata, BigQuery.

- Proficiency in Linux/Unix shell scripting and SQL.

- Knowledge of data Modelling, database design, and the data warehousing ecosystem.

- Ability to troubleshoot and solve complex technical problems.

- Excellent analytical and problem-solving skills.

- Knowledge of working in Agile environments.

Qualifications :

- Bachelor's/Master's degree in Computer Science, Engineering, or a related field; advanced degree preferred.

- 3-5 years of experience in data warehouse and data lake implementation, with a focus on designing and optimizing ETL processes.

- 1-2 years of hands-on experience in Google Cloud Platform (GCP), particularly with BigQuery.

- 1-2 years of working experience in converting ETL jobs (in Informatica, Talend, DataStage) into Dataflow or Dataproc and migrating them into CI/CD pipelines.

- Proficiency in ETL tools such as Informatica, Talend, or DataStage, as well as experience with BigQuery, Dataflow, and Dataproc.

- Strong understanding of data warehouse concepts, data modeling, and ETL best practices.

- Experience with version control systems (e.g, Git) and CI/CD pipelines.

(ref:hirist.tech)

  • Any Location, IN K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...


  • Overseas/International, IN Freelancer HR Full time

    Job Description Responsibilities :- Understand the factories , manufacturing process , data availability and avenues for improvement- Brainstorm , together with engineering, manufacturing and quality problems that can be solved using the acquired data in the data lake platform.- Define what data is required to create a solution and work with connectivity...

  • MLOps Developer

    4 hours ago


    Any Location, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • Data Engineer

    3 weeks ago


    Bangalore/Any Location, IN INSIGHT GLOBAL SOLUTIONS Full time

    Data Engineer Must Haves :- Bachelors Degree in science, technology, or another related field.- 3+ years of data engineering experience.- 3+ years of experience with Cloud platforms like GCP, Azure, Airflow.- 4+ years of data warehouse, relational database, and SQL experience.- 4+ years of supporting ETL process and job scheduling experience.- 3+ years of...

  • Data Engineer

    1 week ago


    Any Location, IN Reliable Group Full time

    POSITION DESCRIPTION :WHAT YOU'LL DO :- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow.- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.- Actively monitor and triage technical...

  • Data Engineer

    3 weeks ago


    Any Location, IN Muoro Full time

    Responsibilities :- Design, develop, and maintain robust data pipelines using Apache Spark, Python, and other relevant technologies.- Implement data ingestion processes from various sources, ensuring data quality and integrity.- Optimize and tune data pipelines for performance and scalability.- Collaborate with data scientists and analysts to deploy machine...

  • Senior Data Engineer

    3 weeks ago


    Bangalore/Any Location, IN SWAI TECHNOLOGIES PRIVATE LIMITED Full time

    Job Description :We are seeking a highly skilled Senior Data Engineer with 5 - 12 years of experience in building scalable data solutions. The ideal candidate should be proficient in Python programming and SQL, with extensive experience in utilizing various AWS services for data processing and storage.Experience with big data processing environments,...

  • Senior Data Engineer

    3 weeks ago


    Any Location, IN Muoro Full time

    Role & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner. - Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative solutions. - Build a team that mines, analyzes, and transforms large [un]structured datasets, collaborating with analysts, data...


  • Any Location, IN K2 Data & Analytics Full time

    Job Description :Join our team in crafting the future of media with our cutting-edge platforms and technologies. We're on the lookout for highly motivated senior software engineers with a knack for building innovative software. If you're passionate about leveraging ML, search, and recommendation algorithms while mastering distributed architectures,...

  • Azure Data Engineer

    3 weeks ago


    Any Location, IN Visionyle Full time

    Position Name: Azure Data EngineerPosition Mode: PermanentExperience: 6 YearsJoining Location: RemoteNotice: ImmediateMode of Interview : 2-3 roundsSUMMARY:Azure Data Engineer should have experience on Azure data lake, Azure SQL database, Databricks, Azure Data Factory, and Azure SQL data warehouse and controlling and granting database access and migrating o...

  • Azure Data Engineer

    3 weeks ago


    Any Location/Bangalore, IN Zyoin group Full time

    Skills :Proficiency in Azure Data EngineeringStrong expertise in SSIS (SQL Server Integration Services)Extensive experience in ETL (Extract, Transform, Load) processesAdvanced skills in Power BI for data visualization and analyticsResponsibilities :Design, develop, and implement data solutions leveraging Azure Data Engineering services.Utilize SSIS for...

  • Data Engineer

    6 days ago


    Any Location/Bangalore, IN RS Consultants Full time

    About the job :Responsibilities :- Build, document, test and launch new data extract, transform and load (ETL) processes for one or more core data sets.- Collaborate with Business Intelligence team and other stakeholders for data requirements- Collaborate with the Data Management team to provide quality data to stakeholders.- Build data expertise and learn...

  • Azure Data Engineer

    3 weeks ago


    Any Location/Bangalore, IN Diatoz Solutions Full time

    We Are Seeking A Skilled Azure Data Engineer To Join Our Dynamic Team. The Ideal Candidate Will Be Responsible For Designing, Developing, And Maintaining Data Solutions On The Microsoft Azure Platform. You Will Collaborate With Cross-Functional Teams To Gather Requirements, Design Data Pipelines, And Implement Solutions To Meet Business...

  • Senior Data Engineer

    3 weeks ago


    Bangalore/Any Location, IN Randstad Full time

    Job Description:We are looking for a highly skilled Senior Data Engineer with over 5 years of experience in the data engineering field. The ideal candidate will have strong expertise in PySpark, SQL databases, and Big Data programming for data transformation and aggregations. This role offers an exciting opportunity to work on cutting-edge projects,...


  • Any Location, IN Victrix Systems & Labs Full time

    Job Title : GCP Cloud Data EngineerLocation : RemoteExperience : 2 to 7 yearsJob Description :We are seeking a talented Cloud Data Engineer to join our team on a remote basis.The ideal candidate will have a strong background in cloud migration, building ETL pipelines, data integrations, and the development of Operational Data Stores (ODS) and Data Warehouses...


  • Bangalore/Any Location, IN TalentXo Full time

    Criteria :Role : Strong Senior Data Warehouse/Data Engineer - Must have more than 8+ YOE in Software Development- Must have 6+ YOE in Data Ware house/Data Engineering and Data Modelling- Must have strong work experience in Any Dataware House / Data Lake- Must have Good Experience in SQL on any databases MySQL / PostgreSQL / Postgres / Oracle / SQL Server /...


  • Malaysia/Overseas/International, IN Amk technologies Full time

    About the job:- Work experience in being Senior BI engineer role- Work closely with internal and external stakeholders to turn data into critical information and knowledge that can be used to make sound business decisions- Responsible for the full life cycle development, implementation, production support, and performance tuning of the Enterprise Data...


  • Any Location/Bangalore, IN Harmony Data Integration Technologies Pvt. Ltd. Full time

    Job Description :We are seeking an experienced and proactive Senior DevOps Engineer with a strong background in Azure to join our dynamic team. The ideal candidate is not only a technical expert but also possesses excellent communication and problem-solving skills. As a Senior DevOps Engineer, you will work as support engineer and play a crucial role in...

  • Data Engineer

    2 weeks ago


    Any Location/Bangalore, IN KARYA CONSULTANTS PRIVATE LIMITED Full time

    As a GCP Data Engineer, you will be a key player in designing, implementing, and optimizing data solutions on the Google Cloud Platform. We are seeking a professional with hands-on experience in data engineering and a strong understanding of GCP services.Key Responsibilities :Data Architecture : - Design and implement scalable and efficient data...


  • Any Location/Bangalore, IN INSIGHT GLOBAL SOLUTIONS Full time

    Must-haves :- 5+ years of Data Warehouse engineering experience.- Strong proficiency in Linux/Unix tools and scripting (Python).- Strong proficiency with integrating ETL tools with database load utilities.- Cloud Data Lake/Data warehouse technology and tools (Databricks or Snowflake).- Strong proficiency in writing SQL and procedures.- Good understanding of...