Data Engineering Expert

4 weeks ago


Remote, India AsalJobs Full time

Job Summary

We are seeking a highly skilled Data Engineering Expert to join our team at AsalJobs. The ideal candidate will have a strong background in data engineering, with expertise in SQL, Python, and Azure Databricks.

Key Responsibilities

  • Design, implement, and optimize end-to-end data pipelines using Azure Databricks, ensuring reliability, scalability, and performance.
  • Utilize Azure Databricks for data transformation tasks, including cleansing, aggregation, and enrichment of datasets.
  • Implement automation for data workflows and monitoring pipelines to ensure data integrity and availability.

Requirements

  • 6-10 years of hands-on experience in SQL and Python development.
  • Proven track record of building complex data validation and transformation projects using both SQL and Python.
  • Strong practical knowledge in SQL and Python, with an emphasis on creating reusable code.
  • Experience with data integration tools and techniques, including ETL processes, data pipelines, and orchestration.
  • Proficient in writing base code that dynamically generates multiple code instances based on a configuration file.

Preferred Qualifications

  • Knowledge of Databricks, Spark, or similar frameworks for processing large datasets.
  • Knowledge of Apache Spark, including Spark SQL, DataFrame/Dataset API.
  • Proficiency in setting up and managing Databricks clusters, notebooks, and jobs within the Azure ecosystem.

What We Offer

  • A dynamic and collaborative work environment.
  • Opportunities for professional growth and development.
  • A competitive salary and benefits package.

  • Kendryl Expert

    5 months ago


    Remote, India True Data Software Full time

    Kendryl Expert - Description Here Full Time - Remote, Anywhere Vacancy - 12 **About Job**: At True Data Software, we drive innovation and digital transformation for businesses around the globe. Our dedication to excellence and forward-thinking approach ensures our clients receive the most effective solutions. We are looking to expand our team with a...


  • Remote, India Racrosoft Technologies Full time

    Racrosoft Technologies is seeking a highly skilled Data Engineering Expert to design, develop, and maintain scalable data pipelines and systems. The ideal candidate will have experience in building and managing data pipelines using Azure Data Factory, as well as proficiency in managing large-scale data storage using Azure Data Lake Storage.Key...

  • Azure Data Architect

    5 months ago


    Remote, India Data PlatformExperts Full time

    **Job Description: Azure Data Architect** **Key Responsibilities**: - **Design and Implementation**: - Design and implement end-to-end data solutions (data models, pipelines, data lakes, data warehouses) in Azure. - Optimize and maintain existing Azure data structures and integration processes. - Ensure architectural solutions are scalable, maintainable,...

  • Azure Data Architect

    6 months ago


    Remote, India Data PlatformExperts Full time

    Job Description: Azure Data Engineer (Architect Level) We are seeking an experienced and highly skilled Azure Data Engineer at the Architect level to lead the design and implementation of complex data solutions on the Microsoft Azure platform. As an Azure Data Engineer Architect, you will be responsible for providing technical expertise, guiding the...

  • Data Engineer

    4 weeks ago


    Remote, India BlueByte Technologies Full time

    **Job Summary**BlueByte Technologies is seeking an experienced Data Engineer - Cloud Migration Expert to lead the migration of data from Google Cloud Platform (GCP) to Snowflake. This is a 12-month contract position with the possibility of extension.Job Description:We are looking for a highly skilled Data Engineer with expertise in GCP, Snowflake, and dbt to...


  • Remote, India Quantumbricks Full time

    Job Summary: We are seeking a highly skilled Senior Data Engineer with over 10 years of experience in designing, developing, and managing robust data pipelines, with specific expertise in Informatica Intelligent Cloud Services (IICS). The ideal candidate will have extensive experience in handling complex ETL/ELT processes, cloud data integration, and data...

  • Data Engineer

    1 month ago


    Pune/Remote, India Zimetrics Technologies Private Limited Full time

    Job Title: Data Engineer - GCP BigQuery ExpertWe are seeking an experienced Data Engineer to join our team at Zimetrics Technologies Private Limited. The ideal candidate will have expertise in Google Cloud Platform (GCP), particularly BigQuery, and strong skills in SQL, Data Warehousing (DWH), and ETL processes.Key Responsibilities:Design, develop, and...


  • Remote, India Talpro Full time

    Detailed Job DescriptionTalpro is seeking a skilled Azure Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing data pipelines and orchestration using Azure Data Factory and other Azure Modern Data Warehouse platform components.Key Responsibilities:Data Curation and...

  • AWS Data Engineer

    3 weeks ago


    Remote, India Kooe Private Limited Full time

    Job Title: AWS Data EngineerData Engineering ExpertiseWe are looking for a highly skilled AWS Data Engineer to join our team at Kooe Private Limited. The ideal candidate will have extensive experience in designing, building, and maintaining large-scale data pipelines using AWS services. Key Responsibilities:- Design and implement data pipelines using AWS...

  • Data Platform Expert

    1 month ago


    Remote, India InCommon Full time

    We are seeking a highly skilled Data Platform Expert to lead the development and management of large-scale data solutions using Azure Synapse Analytics. This role requires expertise in designing and implementing data solutions, developing and managing ETL processes, and optimizing Synapse environments for performance, scalability, and cost-effectiveness. The...

  • Azure Data Engineer

    4 weeks ago


    Remote, India Racrosoft Technologies Full time

    Role : Azure Data Engineer Exp - 4+ years of experience Job Type : Contract Mode of Work : Remote Qualification : - Very Good Communication (Client engagement)- Able to answer Scenario Based Questions on your past work- Able to answer Deep down on certification - Able to answer Past work with deep explanation. - Good exposure to Pyspark - Focus on Azure...

  • Azure Data Engineer

    2 months ago


    Remote, IN Racrosoft Technologies Full time

    Role : Azure Data EngineerExp - 4+ years of experienceJob Type : ContractMode of Work : RemoteQualification : - Very Good Communication (Client engagement)- Able to answer Scenario Based Questions on your past work- Able to answer Deep down on certification - Able to answer Past work with deep explanation. - Good exposure to Pyspark - Focus on Azure Data...

  • Data Annotation Expert

    5 months ago


    Remote, India Mindrift Full time

    Annotation drives AI’s capabilities Industries across the board are embracing AI, and the backbone of this revolution is accurate data labeling. Annotation Experts are not just regular performers; they are meticulous specialists ensuring the highest quality of data markup. As AI continues its upward trajectory, these experts lay the groundwork, paving the...

  • DevOps Expert

    7 months ago


    Remote, India Morfius Full time

    As a DevOps Expert at Morfius, you will be a key player in our mission to develop, deploy, and maintain our AI-driven products and services. You will work collaboratively with our engineering and data science teams to streamline our development and deployment processes, ensuring that our AI solutions operate efficiently and...

  • Data Engineer

    1 month ago


    Remote, India SPECTRUM AV TECHNO CONSULTANTS Full time

    Job Title: Data EngineerAbout the Role:We are seeking a highly skilled Data Engineer to join our team at Spectrum AV Technology Consultants. As a Data Engineer, you will play a critical role in designing and implementing robust data pipelines that drive our analytics and machine learning initiatives.Key Responsibilities:Design and develop scalable data...


  • Remote, India Overture Rede Private Limited. Full time

    Job DescriptionOverture Rede Private Limited is seeking a skilled Data Science Visualization Expert to join our team. As a Data Insights and Visualization Lead, you will be responsible for collaborating with business stakeholders to understand data requirements and reporting needs.Key ResponsibilitiesDesign, develop, and maintain interactive dashboards and...


  • Remote/Bangalore, India Creative Technostructure Full time

    Data Engineer - AWS Cloud ExpertAt Creative Technostructure, we are seeking an experienced Data Engineer to join our team as a AWS Cloud Expert. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data pipelines and data warehouses using AWS services such as Glue, Lambda, Redshift, S3,...

  • Data Analyst

    4 weeks ago


    Pune/Remote, India CHISTATS LABS PRIVATE LIMITED Full time

    Job Title:Data Analyst - Commercial Insurance ExpertJob Summary:We are seeking a highly skilled Data Analyst to join our team at ChiStats Labs Private Limited. The ideal candidate will have a strong background in data analysis, with a focus on Commercial Insurance data. Your primary responsibility will be to analyze and interpret complex data sets to provide...

  • Data Engineer

    4 weeks ago


    Remote/Anywhere in India/Multiple Locations Incubyte Datatech Pvt Ltd Full time

    **Job Title:** Data Engineer - ETL and Data Pipelines ExpertWe are a company where the 'HOW' of building software is just as important as the 'WHAT'. Embracing Software Craftsmanship values and eXtreme Programming Practices, we create well-crafted products for our clients. Our team is passionate about creating exceptional software, and we are looking for a...

  • PowerBI Expert

    5 months ago


    Remote, India iSageBrum Technologies Pvt Ltd Full time

    * Fluent communication in English is must for this positions PowerBI Engineer (2 position) **Role Description**: The **BI Engineer - Power BI **would need to have at least 2+ years of experience. In this role, you will be responsible for administering, supporting, monitoring, tuning and patching the Power BI reporting environment. This involves the...