Data Engineer/Architect/Manager

2 months ago


Anywhere in IndiaMultiple Locations, IN Spectrum Consulting Full time

Job Description Roles and Responsibilities :


- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack

- Ability to provide solutions that are forward-thinking in data engineering and analytics space

- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.

- Triage issues to find gaps in existing pipelines and fix the issues

- Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs

- Help joiner team members to resolve issues and technical challenges.

- Drive technical discussion with client architect and team members

- Orchestrate the data pipelines in scheduler via Airflow

Skills and Qualifications :

- Bachelor's and/or master's degree in computer science or equivalent experience.

- Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.

- Deep understanding of Star and Snowflake dimensional modelling.

- Strong knowledge of Data Management principles

- Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture

- Should have hands-on experience in SQL, Python and Spark (PySpark)

- Candidate must have experience in AWS/ Azure stack

- Desirable to have ETL with batch and streaming (Kinesis).

- Experience in building ETL / data warehouse transformation processes

- Experience with Apache Kafka for use with streaming data / event-based data

- Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)

- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)

- Experience working with structured and unstructured data including imaging & geospatial data.

- Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.

- Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot

- Databricks Certified Data Engineer Associate/Professional Certification (Desirable).

- Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects

- Should have experience working in Agile methodology

- Strong verbal and written communication skills.

- Strong analytical and problem-solving skills with a high attention to detail. (ref:hirist.tech)

  • Anywhere in India/Multiple Locations, IN INUMELLAS CONSULTANCY SERVICES PRIVATE LIMITED Full time

    Job Description :As a Cloud Data Lead, he/she will oversee the design, implementation, and management of cloud-based data solutions. He/she will lead a team of data engineers and collaborate with stakeholders to ensure data is managed efficiently, securely, and is accessible for business intelligence and analytics. His/her expertise in cloud platforms, data...


  • Anywhere in India/Multiple Locations, IN GENPACT India Private Limited Full time

    Inviting applications for the role of Senior Engineer - Software Development, Data Engineer!Mandatory Skillsets : Snowflake+ DBT+ DataWarehousing +Data Modelling+ Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow. - Ensure correctness and completeness of the data being...

  • UsefulBI Corporation

    2 months ago


    Anywhere in India/Multiple Locations, IN USEFULBI CORPORATION Full time

    Job Role : Solution Architect. Location : Remote. Job Description : - Minimum 8+years' Experience in Data Engineering. - Must have good knowledge and experience in Python. - Must have good Knowledge of Pyspark or Spark. - Must have good experience in AWS/Azure (Glue,- EMR). - Typically requires relevant analysis work and domain-area work experience. -...

  • Lead Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations, IN ARR Recruitment Solutions Full time

    Job Description :Required skills & experience :- Proficiency in data modeling and database management.- Strong programming skills in Pyspark, Python and SQL.- Experience with ETL (Extract, Transform, Load) processes.- Familiarity with strong data warehousing and Azure cloud platform with immense working knowledge in Databricks. - Knowledge of data governance...

  • Data Architect

    2 months ago


    Anywhere in India/Multiple Locations, IN RAPINNO TECH SOLUTIONS PRIVATE LIMITED Full time

    Position Overview :We are looking for an experienced Data Architect with expertise in Databricks, Apache Spark, and ETL processes. The ideal candidate will have a proven track record of designing and building robust data applications from the ground up. You will play a key role in shaping our data strategy and ensuring our data solutions meet business needs...

  • Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations, IN IT Source Global Full time

    Role : Data EngineerJob Description :- Design, build, and maintain large-scale data pipelines and ETL/ELT workflows using PySpark, Python, and SQL for data extraction, transformation, and loading.- Work extensively with AWS services such as Amazon S3 for data storage and Athena for querying and analyzing structured and unstructured data.- Develop and manage...

  • Data Bricks Manager

    2 months ago


    Anywhere in India/Multiple Locations, IN Spectrum Consulting Full time

    Role : Data Bricks ManagerPrimary Roles and Responsibilities :- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in...

  • Data Architect

    2 months ago


    Anywhere in India/Multiple Locations, IN Crox Consulting Inc. Full time

    Data Architect :- More than 10+ years of experience in Data and AI engagement- Ability to perform due-diligence, data strategy, architecture and data platform consulting independently with global client- Experience in building practices to develop solutions assets and accelerators, client workshops and capability building- Experience in Data estate...

  • Lead Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations, IN Gen Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose - the relentless pursuit of a world that works better for people - we...

  • Technical Lead

    2 months ago


    Anywhere in India/Multiple Locations, IN Praxis Consultants Full time

    Job Summary :We are looking for a highly skilled and experienced Technical Lead (Sr. Data Engineer/Data Architect / Data Modeler) to join our team. will play a crucial role in designing data architecture and models based on business requirements, and ensuring data integrity, security, and performance. Oversee technical aspects of data integration and...

  • Engineering Architect

    2 months ago


    Anywhere in India/Multiple Locations, IN Bonzer Business Solutions Pvt. Ltd. Full time

    Job Description :GenAI Engineering Architect (Must have AutoGen, CrewAI and WrenAI). This role requires hands-on project expertise to implement an enterprise application built on top of SQL and unstructured data (images, videos, logs etc ) using AutoGen, CrewAI, Azure OpenAI GPT-4 Turbo and GPT-4V with PTUs. This is a hands-on architect role requiring both...

  • AIMDek Technologies

    4 weeks ago


    Anywhere in India/Multiple Locations/Gujarat, IN AIMDek Technologies Pvt. Ltd. Full time

    Job Title : Engineering ManagerExperience Level : 10+ YearsLocation : India (Remote)Job Type : Full-timeAbout the Role : We are seeking a highly experienced Engineering Manager / Solutions Architect with over 10 years of expertise working in areas like AI/ML, Cloud Engineering, Web and Mobile applications. The ideal candidate will have a proven track record...

  • Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations, IN Orangeskill Technologies Pvt Ltd Full time

    Job Description :We are looking for a talented and experienced Data Engineer to join our team. You will be responsible for designing, building, and maintaining data pipelines, workflows, and infrastructure to support efficient data processing and analysis. The ideal candidate will have experience in workflow orchestration tools, database management, data...


  • Anywhere in India/Multiple Locations, IN Rapid Technologies Full time

    Salary : 10 - 35 LPAJob Description :Key Responsibilities :Architecture and Design :- Lead the design and development of scalable cloud-based applications and services on Azure.- Provide technical leadership to the development team, ensuring adherence to best practices and design patterns.- Collaborate with architects and stakeholders to ensure the...


  • Anywhere in India/Multiple Locations, IN TETRAHED INC Full time

    Job Description :Role : Principal ML Ops ArchitectResponsibilities :1. Strategic Leadership :a. Define and drive the overall ML Ops strategy and roadmap for the organization, aligning it with business objectives and technical capabilities.b. Oversee the design, development, and implementation of ML Ops platforms, frameworks, and processes.c. Foster a culture...


  • Anywhere in India/Multiple Locations, IN Prep.Study Full time

    Job Description : - Design, architect, and develop end-to-end data solutions on the Azure Stack platform. - Implement and optimize data pipelines, ETL processes, and data integration solutions using Azure Data Factory, Azure Data Lake, Azure Databricks, Azure SQL Database, and other relevant Azure services. - Collaborate with data scientists, analysts, and...

  • Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations, IN Praxis Consultants Full time

    Job SummaryWe are looking for a highly skilled and experienced Technical Lead (Sr. Data Engineer/Data Architect / Data Modeler) to join our team. will play a crucial role in designing data architecture and models based on business requirements, ensuring data integrity, security, and performance. Oversee technical aspects of data integration and management...

  • Data Architect

    1 month ago


    Bangalore/Anywhere in India/Multiple Locations/Chennai, IN Mazenet solution Full time

    About Mazenet : Over 23 years of proven success as a workforce development leader, we deliver impactful Staffing & Corporate Training solutions. We leverage a strategic blend of innovative thinking, cutting-edge technologies and expert capabilities to cultivate a future-ready workforce. Our comprehensive approach has empowered over 300 clients, including...


  • Anywhere in India/Multiple Locations, IN Magnacore Technologies Private Limited Full time

    Job Description : We are seeking a highly skilled and detail-oriented Azure Data Solutions Test Engineer to join our team. In this role, you will be responsible for designing, developing, and executing test strategies to ensure the quality and reliability of our Azure-based data solutions. The ideal candidate will have a strong background in data testing,...


  • Anywhere in India/Multiple Locations, IN PureSoftware Pvt Ltd. Full time

    Azure Data ArchitectLocation : Bangalore/ :- Establish and maintain database architecture standards and best practices Participate in the evaluation of emerging technology and tools- Provide database architecture leadership and mentor projects consisting of TW employees and outside contractors- Maintain the governance model on the database architecture...