Diatoz - Senior Data Engineer - ETL

5 days ago


Remote, IN Diatoz Solutions Full time

A Senior Data Engineer Specializing In Snowflake And ETL (Extract, Transform, Load) Processes Is Responsible For Designing, Implementing, And Maintaining Data Infrastructure And Pipelines To Ensure Data Is Efficiently Extracted From Various Sources, Transformed Into Usable Formats, And Loaded Into Data Warehouses Or Data Lakes.

Responsibilities :

- Developing End To End ETL/ELT Pipeline Working With Data Analysts Of Business Function.


- Designing, Developing, And Implementing Scalable, Automated Processes For Data Extraction, Processing, And Analysis In A Data Mesh Architecture


- Mentoring Other Junior Engineers In The Team


- Be A "Go-To" Expert For Data Technologies And Solutions


- Ability To Provide On The Ground Troubleshooting And Diagnosis To Architecture And Design Challenges


- Troubleshooting And Resolving Technical Issues As They Arise


- Looking For Ways Of Improving Both What And How Data Pipelines Are Delivered By The Department


- Translating Business Requirements Into Technical Requirements, Such As Entities That Need To Be Modelled, DBT Models That Need To Be Build, Timings, Tests And Reports


- Owning The Delivery Of Data Models And Reports End To End


- Perform Exploratory Data Analysis In Order To Identify Data Quality Issues Early In The Process And


- Implement Tests To Ensure Prevent Them In The Future


- Working With Data Analysts To Ensure That All Data Feeds Are Optimised And Available At The Required

Times.


- This Can Include Change Capture, Change Data Control And Other "Delta Loading" Approaches

Discovering, Transforming, Testing, Deploying And Documenting Data Source


- Applying, Help Defining, And Championing


- Data Warehouse Governance: Data Quality, Testing, Coding Best Practises, And Peer Review

Building Looker Dashboard For Use Cases If Require


Skills & Qualifications :


- 5+ Years Of Extensive Development Experience Using Snowflake Or Similar Data Warehouse Technology


- Working Experience With Dbt And Other Technologies Of The Modern Datastack, Such As Snowflake, Apache Airflow, Fivetran, Looker, AWS, Git.


- Experience In Agile Processes, Such As SCRUM


- Extensive Experience In Writing Advanced SQL Statements And Performance Tuning Them


- Proficient In Data Ingestion Techniques Using Custom Or SAAS Tool Like Fivetran


- Expertise In Data Modelling And Can Optimise Existing/New Data Models


- Experience In Data Mining, Data Warehouse Solutions, And ETL, And Using Databases In A Business


- Environment With Large-Scale, Complex Datasets


- Experience In Architecting Analytical Databases (In Data Mesh Architecture) Is Added Advantage


- Must Have Experience Working In Agile Cross-Functional Delivery Team


- Familarity With High Development Standards, Especially For Code Quality, Code Reviews, Unit Testing,


- Continuous Integration And Deployment


(ref:hirist.tech)
  • Senior Data Engineer

    1 month ago


    Remote, IN Nthinsight Full time

    Job Description :We are seeking a skilled and experienced Data Engineer with expertise in Python, data warehousing, ETL (Extract, Transform, Load), and SQL. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure to support the organization's data needs. You will collaborate with cross-functional...


  • Remote, IN Gama Advisory Services LLP Full time

    Overview :We are seeking a proficient Big Data/ETL Test Engineer with 4-6 years of experience in testing Big Data platforms and ETL processes, specifically using Hadoop and Hive technologies. As a Test Engineer, you will play a critical role in ensuring the quality and reliability of our Big Data solutions by designing and executing comprehensive test...


  • Pune/Remote, IN TVARIT Full time

    TVARIT GmbH develops and delivers solutions in the field of artificial intelligence (AI) for the Manufacturing, automotive, and process industries. With its software products, TVARIT makes it possible for its customers to make intelligent and well-founded decisions, e.g., in forward-looking Maintenance, increasing the OEE and predictive quality. We have...


  • Remote, IN MindBrain Full time

    Job Title - Big Data Engineer. Location - Remote. Contractual - Duration 1 yr. Responsibilities :- Design, build, and maintain large-scale data processing systems (batch and streaming) using technologies such as Hadoop, Spark, Kafka, etc.- Develop and optimize data pipelines, data ingestion processes, and data integration workflows.- Implement data...

  • Data Modeler

    2 weeks ago


    Remote, IN MindBrain Full time

    Key Responsibilities :- Data Modeling: Design and develop data models for ETL processes to support data warehousing and business intelligence solutions.- Warehouse Architecture: Create and maintain data warehouse architecture, ensuring it aligns with business needs and performance standards.- SQL Proficiency: Utilize strong SQL skills to write, optimize, and...

  • Neurones IT

    5 days ago


    Remote, IN IT AISA Full time

    Job Description :- As a Data engineer, you will be a part of a highly qualified team, leading the delivery of modern data platforms using Azure Services and Databricks.- Designing and delivering software using an agile and iterative approach based on Scrum or Kanban.- Following and contributing to improvement of client's software engineering practices...

  • Data Engineer

    2 days ago


    Remote/Any Location, IN Supro Info Solutions pvt ltd Full time

    Job Description :- Design and development with Informatica IICS or PowerCenter in either/both Data Warehousing and Enterprise Integration projects - Development of ETL [Extract Transform & Load] by utilizing relevant technologies (e. Informatica, MS Azure Data Factory, Azure Data Lake, etc.) - Develop Data Ingestion and Integration from data sources to Azure...

  • Datastage Developer

    7 days ago


    Remote, IN Gama Advisory Services LLP Full time

    Overview :We are looking for a skilled DataStage Developer with 2-4 years of experience in ETL (Extract, Transform, Load) processes to join our team. As a DataStage Developer, you will be responsible for designing, developing, and maintaining ETL jobs and workflows using IBM DataStage. Your expertise in DataStage and ETL methodologies will play a crucial...

  • Data Engineer

    2 weeks ago


    Remote, IN Suitable.AI Full time

    Role Objective :Data Engineer will be responsible for expanding and optimizing our data and database architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building. The Data Engineer will support our software...

  • Aptus Data Labs

    7 days ago


    Remote, IN Aptus Data Labs Full time

    Description :We are seeking a highly skilled and experienced individual to join our team as a Data Governance expert with AWS knowledge. In this role, you will play a critical role in ensuring data integrity, quality, and security across our organization's data assets. As a data governance expert, your main responsibility will be to develop and implement...

  • Snowflake Developer

    2 weeks ago


    Remote, IN Flexiventures Pvt. Ltd Full time

    We are seeking a skilled Data Engineer with expertise in Snowflake to join our dynamic team. The ideal candidate will have a strong background in data engineering and a deep understanding of Snowflake architecture and development. You will be responsible for designing, building, and optimizing data pipelines and warehouse solutions within the Snowflake...


  • Remote, IN Suitable.AI Full time

    Role Objective :Data Engineer will be responsible for expanding and optimizing our data and database architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building. The Data Engineer will support our software...


  • remote, IN AdAstra Full time

    Job Description :As a Senior Power BI Developer, you will be responsible for : Technical Requirements :- Gathering and Development of Functional Specifications - Translating business needs into technical specifications. - Developing reporting systems that provide accessible information for decision-making. - Using warehouse data to generate reports to...

  • Lead Data Engineer

    7 days ago


    Remote, IN Unison consulting pte ltd Full time

    About the job :- Understanding of RDBMS, Data ingestions, Data flows, Data Integrations etc- Technical expertise with data models, data mining and segmentation techniques- Experience with full SDLC lifecycle and Lean or Agile development methodologies- Knowledge of CI/CD and GIT Deployments- Ability to work in team in diverse/ multiple stakeholder...


  • Remote, IN FENL IT SERVICES FINANCIAL ENGINES LLP Full time

    Senior Staff Engineer - Salesforce Development At Edelman Financial Engines (EFE), we believe everyone deserves to move their financial life forward! We know that assets have the power to fund goals. Those numbers represent individual lifetimes filled with hard work and dreams for our clients and generations to follow. Our clients trust us to guide them...


  • Remote/Any Location, IN Mazenet solution Full time

    Job Description : We are looking for a skilled Power BI / Tableau Developer who will be responsible for designing, developing, and maintaining business intelligence solutions. The ideal candidate should have strong expertise in data visualization, ETL workflows, and dashboarding with tools like Power BI, Tableau, Quicksight, and Looker Studio. Must Have :...


  • Remote, IN MindBrain Full time

    Roles & Responsibilities :- Sound knowledge in Spark architecture and distributed computing- Proficient in Spark - including RDD and Dataframes core functions, troubleshooting and performance tuning.- Good understanding in object-oriented concepts and hands on experience on Scala or on java with excellent programming logic and technique- Good in functional...


  • Remote/Bangalore/Pune, IN TechTiv Software Solutions Full time

    The Opportunity :Digit88 development team is establishing a new offshore product development team for its partner , that is building next-generation Big Data, Cloud-Based Business Operation Support technology for utilities, retail energy suppliers and Community Choice Aggregators (CCA). The candidate would be joining an existing team of outstanding data...

  • Data Engineer

    5 days ago


    Remote/Any Location, IN Kooe Private Limited Full time

    Job Overview :We are seeking an experienced Data Engineer with expertise in Oracle Data Integrator (ODI) and project management. The ideal candidate will have a strong background in Agile methodologies, JIRA, and data warehousing. This role involves designing and developing ELT processes, validating data, and ensuring data quality. The successful candidate...


  • Remote, IN Unison consulting pte ltd Full time

    Responsibilities :- Collaborate with project managers, data architects, and other stakeholders to understand data migration requirements and objectives- Create and maintain ETL pipelines to extract, transform, and load data from various sources to target systems- Develop SQL scripts, stored procedures, and queries to support data migration and integration...