Azure Data Engineer
4 weeks ago
Primary Roles and Responsibilities :
- Developing Modern Data Warehouse solutions using Databricks and Azure Stack
- Ability to provide solutions that are forward-thinking in data engineering and analytics space
- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.
- Triage issues to find gaps in existing pipelines and fix the issues
- Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs
- Help joiner team members to resolve issues and technical challenges.
- Drive technical discussion with client architect and team members
- Orchestrate the data pipelines in scheduler via Airflow
Skills and Qualifications :
- Bachelor's and/or master's degree in computer science or equivalent experience.
- Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.
- Deep understanding of Star and Snowflake dimensional modelling.
- Strong knowledge of Data Management principles
- Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
- Should have hands-on experience in SQL, Python and Spark (PySpark)
- Candidate must have experience in Azure stack
- Desirable to have ETL with batch and streaming (Kinesis).
- Experience in building ETL / data warehouse transformation processes
- Experience with Apache Kafka for use with streaming data / event-based data
- Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)
- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)
- Experience working with structured and unstructured data including imaging & geospatial data.
- Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
- Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot
- Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
- Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects
- Should have experience working in Agile methodology
- Strong verbal and written communication skills.
- Strong analytical and problem-solving skills with a high attention to detail.
-
bangalore, India NTT DATA Full timeJob Description Azure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’...
-
Azure Data Engineer
4 weeks ago
Bangalore/Pune/Kolkata/Chennai/Gurgaon/Gurugram, India VIDPRO CONSULTANCY SERVICES Full timePrimary Roles and Responsibilities: - Developing Modern Data Warehouse solutions using Databricks and Azure Stack - Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines and fix the...
-
Eucloid - Data Engineer - Azure Databricks
5 days ago
Gurgaon/Gurugram/Chennai, India Eucloid Data Solutions Pvt Ltd Full timeJob Description - Data Engineer (Databricks)About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for...
-
Chennai/Gurgaon/Gurugram, India Eucloid Data Solutions Pvt Ltd Full timeJob Role : Sr. Data Engineer (Databricks) About Eucloid :Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some...
-
Azure Databricks Engineer/Data Engineer
4 weeks ago
Bangalore/Chennai/Pune/Gurgaon/Gurugram/Kolkata, India Pylon Management Consulting Full timePrimary Roles and Responsibilities:- Developing Modern Data Warehouse solutions using Databricks and Azure Stack- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Triage issues to find gaps in existing pipelines and fix the issues- Work with business to understand the need in reporting layer and develop data...
-
Data Engineer
5 days ago
Chennai, India NTT DATA Full timeJob Description Req ID: 269806 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in chennai, Tamil Nādu (IN-TN), India (IN).Azure Data...
-
Data Engineer
5 days ago
chennai, India NTT DATA Full timeJob Description Req ID: 269806 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in chennai, Tamil Nādu (IN-TN), India (IN). Azure Data...
-
Data Engineer
22 hours ago
chennai, India NTT DATA Full timeJob Description Req ID: 269806 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in chennai, Tamil Nādu (IN-TN), India (IN). Azure Data...
-
Data Engineer
3 days ago
Chennai, India NTT DATA Full timeJob Description Req ID: 269806 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in chennai, Tamil Nādu (IN-TN), India (IN).Azure Data...
-
Azure Data Engineer
3 weeks ago
Kolkata, India LTIMindtree Full timePosition: Azure Data EngineerLocation: Hyderabad / Chennai / Pune / Mumbai / Bangalore / KolkataExperience: 8 - 16 Years onlyMust have minimum of 6 Years of Database Experience with Azure cloud experienceMust have Data Mesh Data products implementation experienceMust have Data Governance Solution Experience Metadata Management Data Quality Lineage...
-
Azure Data Engineer
3 weeks ago
Kolkata, India LTIMindtree Full timePosition: Azure Data EngineerLocation: Hyderabad / Chennai / Pune / Mumbai / Bangalore / KolkataExperience: 8 - 16 Years onlyMust have minimum of 6 Years of Database Experience with Azure cloud experienceMust have Data Mesh Data products implementation experienceMust have Data Governance Solution Experience Metadata Management Data Quality Lineage...
-
Azure Data Engineer
2 months ago
gurugram, India Absolutdata Full timeLocation : Gurgaon Experience : 4-8 years Experience as Data Engineer with database design experience. Strong hands-on experience in designing data lakes / date warehouses Proficient in designing relation and NoSQL entities Proficient in creating Azure Data Factory pipelines for on-cloud ETL processing; copy activity,custom Azure development...
-
Azure Data Engineer
2 months ago
Gurugram, India Absolutdata Full timeLocation : Gurgaon Experience : 4-8 years Experience as Data Engineer with database design experience. Strong hands-on experience in designing data lakes / date warehouses Proficient in designing relation and NoSQL entities Proficient in creating Azure Data Factory pipelines for on-cloud ETL processing; copy activity,custom Azure development etc. ...
-
Azure Data engineer
2 months ago
chennai, India Trigyn Technologies Full timeJob Description: Trigyn has an opportunity Azure Data Engineer. This resource will work at our client sites in Mumbai/Pune/Chennai/Bangalore/Hyderabad. Job Responsibilities: Azure Data engineer to deliver the new Data Strategy and Data Governance projects. The resource must have experience in Incorta and Oracle Cloud and be highly skilled in...
-
Azure Data Engineer
7 days ago
Chennai, India Manvision Technologies Full timeRole: Azure Data EngineerExp: 4-5yearsLocation: Chennai, Hyderabad, KolkataSkills: Azure Data Factory, Azure Data Bricks, Synapse Analytics
-
Azure Data Engineer
6 days ago
chennai, India Manvision Technologies Full timeRole: Azure Data Engineer Exp: 4-5years Location: Chennai, Hyderabad, Kolkata Skills: Azure Data Factory, Azure Data Bricks, Synapse Analytics
-
Azure Data Engineer
5 days ago
Gurgaon/Gurugram, India HuQuo Consulting Pvt. Ltd. Full timeRole & Responsibilities Overview :- A seasoned data team member with a good grasp of both business and technical aspects. - Good familiarity with data stack- Interact with the other members of the data governance team, business teams to understand requirements and also collaborate with stewards / data custodians / end users etc- Demonstrated experience of...
-
Data Engineer
5 days ago
chennai, India NTT DATA Services Full timeReq ID: 269806 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in chennai, Tamil Nādu (IN-TN), India (IN). Azure Data Engineer, you will...
-
Azure Data Engineer
11 minutes ago
Pune, India EXL Full timeWork Location – All EXL Locations (Hybrid)Experience - 5+ YearsMust have Skills:Minimum 4Y+ on Azure cloud services.Proficiency in using Azure Synapse, Azure Storage, and Azure Data Factory for building data solutions.Strong understanding of metadata-driven approaches and data governance principles.Excellent problem-solving skills and ability to work in a...
-
Azure Data Engineer
2 hours ago
Pune, India EXL Full timeWork Location – All EXL Locations (Hybrid)Experience - 5+ YearsMust have Skills:Minimum 4Y+ on Azure cloud services.Proficiency in using Azure Synapse, Azure Storage, and Azure Data Factory for building data solutions.Strong understanding of metadata-driven approaches and data governance principles.Excellent problem-solving skills and ability to work in a...