Truelancer.com | Data Engineer

1 week ago


india Truelancer.com Full time

Job Title: Data Engineer - DBT (Data Build Tool)

Experience: 5-8 yrs

Must-Have Skills: Airflow, S3, Snowflake, SQL/No SQL, Talend, AWS


Essential Skills, Education and Experience:



  • Should have a B.E. / B.Tech. / MCA or equivalent degree along with 4-7 years of experience in Data Engineering
  • Strong experience in DBT concepts like Model building and configurations, incremental load strategies, macro, DBT tests.
  • Strong experience in SQL
  • Strong Experience in AWS
  • Creation and maintenance of optimum data pipeline architecture for ingestion, processing of data
  • Creation of necessary infrastructure for ETL jobs from a wide range of data sources using Talend, DBT, S3, Snowflake.
  • Experience in Data storage technologies like Amazon S3, SQL, NoSQL
  • Data modeling technical awareness
  • Experience in working with stakeholders working in different time zones



Responsibilities:



  • Assist in the design and implementation of Snowflake-based analytics solution (data lake and data warehouse) on AWS
  • Requirements definition, source data analysis and profiling, the logical and physical design of the data lake and data warehouse as well as the design of data integration and publication pipelines
  • Develop Snowflake deployment and usage best practices
  • Help educate the rest of the team members on the capabilities and limitations of Snowflake
  • Build and maintain data pipelines adhering to suggested enterprise architecture principles and guidelines
  • Design, build, test, and maintain data management systems
  • Work in sync with internal and external team members like data architects, data scientists, data analysts to handle all sorts of technical issue
  • Act as technical leader within the team
  • Working in Agile/Lean model
  • Deliver quality deliverables on time
  • Translating complex functional requirements into technical solutions.





sudhanshu.mishra@truelancer.com



  • india Truelancer.com Full time

    Job Title: Data Engineer (Gen AI)Must Have Skills: Gen AI, Python, AzureExp: 5-8 YrsStrong experience in Python programming language - Must.Experience in REST APIs, Fast APIs, Graph APIs, SQL Alchemy.Good experience in Azure Services like DataLake, Azure SQL, Function App, Azure Cognitive Search.Good Understanding on Chunking, Embeddings, vectorization,...


  • india Truelancer.com Full time

    Job Title: Senior ETL QAExperience: 8-12 yrsMust Have Skills: Performance Testing, snowflake, Automation, Comprehensive ETL Testing, Documentation Skills, Talend, Regulatory Compliance, Data Masking, sql, PythonPrimary Skillsets:Comprehensive ETL TestingPerformance TestingData MaskingSQLSnowflakeResponsibilities:We are seeking a highly skilled and...

  • Data Engineer

    4 weeks ago


    India Truelancer.com Full time

    Job Title: Data Engineer Mandatory Skills: Pyspark, Azure, ADF, Databricks, ETL, SQL Job Description: Design and build data pipelines using Spark-SQL and PySpark in Azure Databricks Design and build ETL pipelines using ADF Build and maintain a Lakehouse architecture in ADLS / Databricks. Perform data preparation tasks including data cleaning,...

  • Data engineer

    4 weeks ago


    India Truelancer.com Full time

    Job Title: Data Engineer Mandatory Skills: Pyspark, Azure, ADF, Databricks, ETL, SQL Job Description: Design and build data pipelines using Spark-SQL and Py Spark in Azure Databricks Design and build ETL pipelines using ADF Build and maintain a Lakehouse architecture in ADLS / Databricks. Perform data preparation tasks including data cleaning,...

  • Data Engineer

    4 weeks ago


    India Truelancer.com Full time

    Job Title: Data EngineerMandatory Skills: Pyspark, Azure, ADF, Databricks, ETL, SQLJob Description:Design and build data pipelines using Spark-SQL and PySpark in Azure DatabricksDesign and build ETL pipelines using ADFBuild and maintain a Lakehouse architecture in ADLS / Databricks.Perform data preparation tasks including data cleaning, normalization,...

  • Data Engineer

    4 weeks ago


    india Truelancer.com Full time

    Job Title: Data EngineerMandatory Skills: Pyspark, Azure, ADF, Databricks, ETL, SQLJob Description:Design and build data pipelines using Spark-SQL and PySpark in Azure DatabricksDesign and build ETL pipelines using ADFBuild and maintain a Lakehouse architecture in ADLS / Databricks.Perform data preparation tasks including data cleaning, normalization,...

  • Data Engineer

    4 weeks ago


    india Truelancer.com Full time

    Job Title: Data EngineerMandatory Skills: Pyspark, Azure, ADF, Databricks, ETL, SQLJob Description:Design and build data pipelines using Spark-SQL and PySpark in Azure DatabricksDesign and build ETL pipelines using ADFBuild and maintain a Lakehouse architecture in ADLS / Databricks.Perform data preparation tasks including data cleaning, normalization,...


  • india Truelancer.com Full time

    Job Title: Data Engineer - DBT (Data Build Tool)Experience: 5-8 yrsMust-Have Skills: Airflow, S3, Snowflake, SQL/No SQL, Talend, AWSEssential Skills, Education and Experience:Should have a B.E. / B.Tech. / MCA or equivalent degree along with 4-7 years of experience in Data EngineeringStrong experience in DBT concepts like Model building and configurations,...


  • india Truelancer.com Full time

    Job Title: Data Engineer - DBT (Data Build Tool) Experience: 5-8 yrs Must-Have Skills: Airflow, S3, Snowflake, SQL/No SQL, Talend, AWS Essential Skills, Education and Experience: Should have a B.E. / B.Tech. / MCA or equivalent degree along with 4-7 years of experience in Data Engineering Strong experience in DBT concepts like Model building and...

  • Data Engineer

    1 week ago


    India Truelancer.com Full time

    Job Title: Data Engineer (Gen AI)Must Have Skills: Gen AI, Python, AzureExp: 5-8 YrsStrong experience in Python programming language - Must.Experience in REST APIs, Fast APIs, Graph APIs, SQL Alchemy.Good experience in Azure Services like DataLake, Azure SQL, Function App, Azure Cognitive Search.Good Understanding on Chunking, Embeddings, vectorization,...


  • india Truelancer.com Full time

    Job Title: Senior Data Engineer Experience: 5-7 yrs Must Have Skills: Airflow, Python/scala, GCP, Spark, SQL hands-on fundational or exposure Mandatory Skills: Design and develop data-ingestion frameworks, real-time processing solutions, and data processing and transformation frameworks leveraging open-source tools and data processing frameworks....

  • Data Engineer

    1 week ago


    India Truelancer.com Full time

    Job Title: Data Engineer - DBT (Data Build Tool)Experience: 5-8 yrsMust-Have Skills: Airflow, S3, Snowflake, SQL/No SQL, Talend, AWSEssential Skills, Education and Experience:Should have a B.E. / B.Tech. / MCA or equivalent degree along with 4-7 years of experience in Data EngineeringStrong experience in DBT concepts like Model building and configurations,...


  • india Truelancer.com Full time

    Project Title: Senior Data Scientist Experience: 8-10 yrs Must have Skills: Generative AI technologies(Preferably Open Source LLM), Cloud - AWS preferred, DL, ML, Python, Sql External Skills And Expertise: 8+ years of experience in Data Science, Machine Learning, and AI Proficiency in Python, SQL and data visualization tools like Tableau or PowerBI...


  • india Truelancer.com Full time

    Job Title: Data Engineer (Gen AI) Must Have Skills: Gen AI, Python, Azure Exp: 5-8 Yrs Strong experience in Python programming language - Must. Experience in REST APIs, Fast APIs, Graph APIs, SQL Alchemy. Good experience in Azure Services like DataLake, Azure SQL, Function App, Azure Cognitive Search. Good Understanding on Chunking, Embeddings,...


  • india Truelancer.com Full time

    Job Title: Senior ETL QA Experience: 8-12 yrs Must Have Skills: Performance Testing, snowflake, Automation, Comprehensive ETL Testing, Documentation Skills, Talend, Regulatory Compliance, Data Masking, sql, Python Primary Skillsets: Comprehensive ETL Testing Performance Testing Data Masking SQL Snowflake - Optimization Responsibilities: We are seeking...


  • india Truelancer.com Full time

    Job Title: Senior ETL QAExperience: 8-12 yrsMust Have Skills: Performance Testing, snowflake, Automation, Comprehensive ETL Testing, Documentation Skills, Talend, Regulatory Compliance, Data Masking, sql, PythonPrimary Skillsets:Comprehensive ETL TestingPerformance TestingData MaskingSQLSnowflake - OptimizationResponsibilities:We are seeking a highly skilled...


  • India Truelancer.com Full time

    Job Title: Snowflake Administrator Experience: 5 - 7 years Mandatory Skills: DDL/DML, Snowflake, Role-Based Access Control (RBAC) Key Responsibilities: Administer and manage Snowflake environments, ensuring efficient database performance and availability. Handle DDL/DML operations such as creating tables, views, indexes, and managing data loading,...

  • Sr. ETL QA

    4 weeks ago


    india Truelancer.com Full time

    Job Title: Senior ETL QA EngineerExperience: 5 - 8 YearsMandatory Skills: Performance Testing, snowflake, Automation, Comprehensive ETL Testing, Documentation Skills, Talend, Regulatory Compliance, Data Masking, sqlJob Description: We are seeking an experienced Senior ETL QA Engineer with a strong background in ETL testing, automation, and performance...


  • india Truelancer.com Full time

    Job Title: Senior ETL QA Experience: 8-12 yrs Must Have Skills: Performance Testing, snowflake, Automation, Comprehensive ETL Testing, Documentation Skills, Talend, Regulatory Compliance, Data Masking, sql, Python Primary Skillsets: Comprehensive ETL Testing Performance Testing Data Masking SQL Snowflake Responsibilities: We are seeking a highly...


  • india Truelancer.com Full time

    Job Title: Senior ETL QA Experience: 8-12 yrs Must Have Skills: Performance Testing, snowflake, Automation, Comprehensive ETL Testing, Documentation Skills, Talend, Regulatory Compliance, Data Masking, sql, Python Primary Skillsets: Comprehensive ETL Testing Performance Testing Data Masking SQL Snowflake Responsibilities: We are seeking a highly...