Data Engineer

4 weeks ago


Anywhere in IndiaMultiple Locations XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Full time

Primary Roles and Responsibilities:

- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack

- Ability to provide solutions that are forward-thinking in data engineering and analytics space

- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.

- Triage issues to find gaps in existing pipelines and fix the issues

- Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs

- Help joiner team members to resolve issues and technical challenges.

- Drive technical discussion with client architect and team members

- Orchestrate the data pipelines in scheduler via Airflow

Skills and Qualifications:

- Bachelor's and/or master's degree in computer science or equivalent experience.

- Must have total 5+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.

- Deep understanding of Star and Snowflake dimensional modelling.

- Strong knowledge of Data Management principles

- Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture

- Should have hands-on experience in SQL, Python and Spark (PySpark)

- Candidate must have experience in AWS/ Azure stack

- Desirable to have ETL with batch and streaming (Kinesis).

- Experience in building ETL / data warehouse transformation processes

- Experience with Apache Kafka for use with streaming data / event-based data

- Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)

- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)

- Experience working with structured and unstructured data including imaging & geospatial data.

- Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.

- Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot

- Databricks Certified Data Engineer Associate/Professional Certification (Desirable).

- Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects

- Should have experience working in Agile methodology

- Strong verbal and written communication skills.

- Strong analytical and problem-solving skills with a high attention to detai

(ref:hirist.tech)
  • Sigmoid Analytics

    1 month ago


    Anywhere in India,Multiple Locations ASTAR DATA LLP Full time

    Job Description : This position will be part of a growing team working towards building world-class large scale Big Data architectures.Responsibilities : Good Development Practices :- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy,...

  • Aptus Data Labs

    2 weeks ago


    Anywhere in India/Multiple Locations Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Sigmoid Analytics

    1 month ago


    Anywhere in India,Multiple Locations ASTAR DATA LLP Full time

    This position will be part of a growing team working towards building world-class large scale Big Data Good Development Practices:- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy, unit testing, code deployment- Self-starter to be...

  • MLOps Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...


  • india Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...


  • India Data Engineer Academy Full time

    Job Title: Operations Analyst Location : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • india Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations Vithamas Technologies Private Limited Full time

    Description : Seeking a skilled Data Engineer to join our IT team. Responsible for designing, implementing, and managing data infrastructure. Collaborate with teams to ensure smooth data integration and analysis, enabling data-driven decisions.Responsibilities : - Design, build, and optimize scalable data pipelines and ETL processes. - Extract, transform,...

  • Azure Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations Vikisol Technologies Full time

    Azure Data Engineer Opportunity : Remote Exp : 5+ years Location : Remote Skills : - Azure Databricks- Azure ADF- PySpark- Python- SQL Responsibilities : - Collaborate on ETL data requirements.- Design and optimize data pipelines (Azure Databricks, ADF).- Develop PySpark scripts for efficient data processing.- Ensure ETL tasks' performance and...

  • Senior/Staff Engineer

    1 month ago


    Anywhere in India/Multiple Locations, IN Grorapid labs Full time

    Senior / Staff Engineer Data EngineeringExperience Required : 8 - 14 years working Days 5 days/week Office Location : Remote WorkingRole & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner.- Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative...

  • Senior/Staff Engineer

    1 month ago


    Anywhere in India,Multiple Locations Grorapid labs Full time

    Senior / Staff Engineer Data Engineering Experience Required : 8 - 14 years working Days 5 days/week Office Location : Remote WorkingRole & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner.- Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations Paralleldots Full time

    Job Description : As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and : - Lead the design,...

  • Lead Data Engineer

    2 days ago


    Anywhere in India/Multiple Locations Pro5.ai (formerly Mangtas) Full time

    Job Description :Technical delivery lead on platform and project builds for building and maintaining optimised and highly available data pipelines that facilitate data management and data analytics solutions. The role will drive the development of data processing frameworks and data architectural approaches that scale to handle the business's growing...

  • Data Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations Perfecthire Full time

    Job Description : We are seeking a talented and experienced Data Engineer to join our team and play a key role in the development and implementation of our end-to-end 834 EDI solution. A robust level of experience or familiarity with 834 EDI (Electronic Data Interchange) transactions is critical for this role. As a Data Engineer, you will be...


  • Anywhere in India,Multiple Locations Dotflick Solutions Full time

    Profile : DevOps and Data EngineerJob description : This role is a Hybrid DevOps and Data Engineering.Mode : WFO/WFH Roles & responsibilities : - Setting up tools and required infrastructure- Defining and setting development, test, release, update, and support processes for DevOps operation- Have the technical skill to review, verify, and validate the...

  • Data Engineer

    1 month ago


    Anywhere in India,Multiple Locations BlueByte Technologies Full time

    Position : Data engineerLocation : Remote/ HybridMust have - AKS, Python and SQLGood to have - Erwin toolJob Description :seeking a skilled and motivated AKS (Azure Kubernetes Service) Data Engineer to join our dynamic team (can be open for GKS exp in place of AKS too). The ideal candidate will have a strong background in data engineering, experience with...

  • Data Engineer

    1 month ago


    Anywhere in India,Multiple Locations Arting Digital Full time

    Position Title : Data Engineer Exp : 5+ years Location : Remote Primary Skills : Data warehousing, ETL leveraging Snowflake, ADF ,Python Qualification : Any Roles and responsibilities :- An offshore Data Engineer to work with the Investment Analytics team. - This person needs to have a strong exp of Data warehousing and ETL leveraging Snowflake, ADF and...

  • Data Engineer

    1 month ago


    Anywhere in India,Multiple Locations CliqHR Full time

    Work Mode : Remote (but need to do WFO after joining of 1st week)Preferred candidate profile :- Minimum 5+ years of work experience in Data Analysis, BI or Data Engineering roles with a quantitative degree preferably in Computer Science, Statistics or Mathematics.- Excellent Data handling and strong analytical skills to collect, transform and discover...

  • Data Engineering Lead

    4 weeks ago


    Anywhere in India/Multiple Locations VAST Consulting Full time

    Job Description : - Should have 8+ years of working experience.- Bachelor's or Master's degree in Computer Science, Engineering, or related field.- Demonstrated leadership experience leading cross-functional teams in the design and implementation of complex data solutions.- Experience in a data engineering role with strong understanding of graph...

  • Data Engineer

    1 month ago


    Anywhere in India,Multiple Locations Ridgeant Techonologies Full time

    Responsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as- Glue, S3, Lambda, DynamoDB, Athena, and RedShift.- Implement data...