Data Engineer/Architect/Manager
2 months ago
Job Description Roles and Responsibilities :
- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack
- Ability to provide solutions that are forward-thinking in data engineering and analytics space
- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.
- Triage issues to find gaps in existing pipelines and fix the issues
- Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs
- Help joiner team members to resolve issues and technical challenges.
- Drive technical discussion with client architect and team members
- Orchestrate the data pipelines in scheduler via Airflow
Skills and Qualifications :
- Bachelor's and/or master's degree in computer science or equivalent experience.
- Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.
- Deep understanding of Star and Snowflake dimensional modelling.
- Strong knowledge of Data Management principles
- Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
- Should have hands-on experience in SQL, Python and Spark (PySpark)
- Candidate must have experience in AWS/ Azure stack
- Desirable to have ETL with batch and streaming (Kinesis).
- Experience in building ETL / data warehouse transformation processes
- Experience with Apache Kafka for use with streaming data / event-based data
- Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)
- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)
- Experience working with structured and unstructured data including imaging & geospatial data.
- Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
- Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot
- Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
- Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects
- Should have experience working in Agile methodology
- Strong verbal and written communication skills.
- Strong analytical and problem-solving skills with a high attention to detail. (ref:hirist.tech)
-
Cloud Data Lead/Architect
2 months ago
Anywhere in India/Multiple Locations, IN INUMELLAS CONSULTANCY SERVICES PRIVATE LIMITED Full timeJob Description :As a Cloud Data Lead, he/she will oversee the design, implementation, and management of cloud-based data solutions. He/she will lead a team of data engineers and collaborate with stakeholders to ensure data is managed efficiently, securely, and is accessible for business intelligence and analytics. His/her expertise in cloud platforms, data...
-
Snowflake Data Architect
2 months ago
Anywhere in India/Multiple Locations, IN GENPACT India Private Limited Full timeInviting applications for the role of Senior Engineer - Software Development, Data Engineer!Mandatory Skillsets : Snowflake+ DBT+ DataWarehousing +Data Modelling+ Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow. - Ensure correctness and completeness of the data being...
-
UsefulBI Corporation
2 months ago
Anywhere in India/Multiple Locations, IN USEFULBI CORPORATION Full timeJob Role : Solution Architect. Location : Remote. Job Description : - Minimum 8+years' Experience in Data Engineering. - Must have good knowledge and experience in Python. - Must have good Knowledge of Pyspark or Spark. - Must have good experience in AWS/Azure (Glue,- EMR). - Typically requires relevant analysis work and domain-area work experience. -...
-
Lead Data Engineer
2 months ago
Anywhere in India/Multiple Locations, IN ARR Recruitment Solutions Full timeJob Description :Required skills & experience :- Proficiency in data modeling and database management.- Strong programming skills in Pyspark, Python and SQL.- Experience with ETL (Extract, Transform, Load) processes.- Familiarity with strong data warehousing and Azure cloud platform with immense working knowledge in Databricks. - Knowledge of data governance...
-
Data Architect
2 months ago
Anywhere in India/Multiple Locations, IN RAPINNO TECH SOLUTIONS PRIVATE LIMITED Full timePosition Overview :We are looking for an experienced Data Architect with expertise in Databricks, Apache Spark, and ETL processes. The ideal candidate will have a proven track record of designing and building robust data applications from the ground up. You will play a key role in shaping our data strategy and ensuring our data solutions meet business needs...
-
Data Engineer
2 months ago
Anywhere in India/Multiple Locations, IN IT Source Global Full timeRole : Data EngineerJob Description :- Design, build, and maintain large-scale data pipelines and ETL/ELT workflows using PySpark, Python, and SQL for data extraction, transformation, and loading.- Work extensively with AWS services such as Amazon S3 for data storage and Athena for querying and analyzing structured and unstructured data.- Develop and manage...
-
Data Bricks Manager
2 months ago
Anywhere in India/Multiple Locations, IN Spectrum Consulting Full timeRole : Data Bricks ManagerPrimary Roles and Responsibilities :- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in...
-
Data Architect
2 months ago
Anywhere in India/Multiple Locations, IN Crox Consulting Inc. Full timeData Architect :- More than 10+ years of experience in Data and AI engagement- Ability to perform due-diligence, data strategy, architecture and data platform consulting independently with global client- Experience in building practices to develop solutions assets and accelerators, client workshops and capability building- Experience in Data estate...
-
Lead Data Engineer
2 months ago
Anywhere in India/Multiple Locations, IN Gen Full timeGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose - the relentless pursuit of a world that works better for people - we...
-
Technical Lead
2 months ago
Anywhere in India/Multiple Locations, IN Praxis Consultants Full timeJob Summary :We are looking for a highly skilled and experienced Technical Lead (Sr. Data Engineer/Data Architect / Data Modeler) to join our team. will play a crucial role in designing data architecture and models based on business requirements, and ensuring data integrity, security, and performance. Oversee technical aspects of data integration and...
-
Engineering Architect
2 months ago
Anywhere in India/Multiple Locations, IN Bonzer Business Solutions Pvt. Ltd. Full timeJob Description :GenAI Engineering Architect (Must have AutoGen, CrewAI and WrenAI). This role requires hands-on project expertise to implement an enterprise application built on top of SQL and unstructured data (images, videos, logs etc ) using AutoGen, CrewAI, Azure OpenAI GPT-4 Turbo and GPT-4V with PTUs. This is a hands-on architect role requiring both...
-
AIMDek Technologies
4 weeks ago
Anywhere in India/Multiple Locations/Gujarat, IN AIMDek Technologies Pvt. Ltd. Full timeJob Title : Engineering ManagerExperience Level : 10+ YearsLocation : India (Remote)Job Type : Full-timeAbout the Role : We are seeking a highly experienced Engineering Manager / Solutions Architect with over 10 years of expertise working in areas like AI/ML, Cloud Engineering, Web and Mobile applications. The ideal candidate will have a proven track record...
-
Data Engineer
2 months ago
Anywhere in India/Multiple Locations, IN Orangeskill Technologies Pvt Ltd Full timeJob Description :We are looking for a talented and experienced Data Engineer to join our team. You will be responsible for designing, building, and maintaining data pipelines, workflows, and infrastructure to support efficient data processing and analysis. The ideal candidate will have experience in workflow orchestration tools, database management, data...
-
Lead Azure Developer/Architect
2 months ago
Anywhere in India/Multiple Locations, IN Rapid Technologies Full timeSalary : 10 - 35 LPAJob Description :Key Responsibilities :Architecture and Design :- Lead the design and development of scalable cloud-based applications and services on Azure.- Provide technical leadership to the development team, ensuring adherence to best practices and design patterns.- Collaborate with architects and stakeholders to ensure the...
-
Principal MLOps Architect
2 months ago
Anywhere in India/Multiple Locations, IN TETRAHED INC Full timeJob Description :Role : Principal ML Ops ArchitectResponsibilities :1. Strategic Leadership :a. Define and drive the overall ML Ops strategy and roadmap for the organization, aligning it with business objectives and technical capabilities.b. Oversee the design, development, and implementation of ML Ops platforms, frameworks, and processes.c. Foster a culture...
-
Prep.Study - Azure Data Engineer - ETL
2 months ago
Anywhere in India/Multiple Locations, IN Prep.Study Full timeJob Description : - Design, architect, and develop end-to-end data solutions on the Azure Stack platform. - Implement and optimize data pipelines, ETL processes, and data integration solutions using Azure Data Factory, Azure Data Lake, Azure Databricks, Azure SQL Database, and other relevant Azure services. - Collaborate with data scientists, analysts, and...
-
Data Engineer
2 months ago
Anywhere in India/Multiple Locations, IN Praxis Consultants Full timeJob SummaryWe are looking for a highly skilled and experienced Technical Lead (Sr. Data Engineer/Data Architect / Data Modeler) to join our team. will play a crucial role in designing data architecture and models based on business requirements, ensuring data integrity, security, and performance. Oversee technical aspects of data integration and management...
-
Data Architect
1 month ago
Bangalore/Anywhere in India/Multiple Locations/Chennai, IN Mazenet solution Full timeAbout Mazenet : Over 23 years of proven success as a workforce development leader, we deliver impactful Staffing & Corporate Training solutions. We leverage a strategic blend of innovative thinking, cutting-edge technologies and expert capabilities to cultivate a future-ready workforce. Our comprehensive approach has empowered over 300 clients, including...
-
Azure Data Solutions Test Engineer
2 months ago
Anywhere in India/Multiple Locations, IN Magnacore Technologies Private Limited Full timeJob Description : We are seeking a highly skilled and detail-oriented Azure Data Solutions Test Engineer to join our team. In this role, you will be responsible for designing, developing, and executing test strategies to ensure the quality and reliability of our Azure-based data solutions. The ideal candidate will have a strong background in data testing,...
-
PureSoftware - Azure Data Architect - Python/PySpark
2 months ago
Anywhere in India/Multiple Locations, IN PureSoftware Pvt Ltd. Full timeAzure Data ArchitectLocation : Bangalore/ :- Establish and maintain database architecture standards and best practices Participate in the evaluation of emerging technology and tools- Provide database architecture leadership and mentor projects consisting of TW employees and outside contractors- Maintain the governance model on the database architecture...