Data Engineer
2 weeks ago
Job Description :
- Design and build data pipelines using Spark-SQL and PySpark in Azure Databricks
Job Description :
- Design and build ETL pipelines using ADF
- Build and maintain a Lakehouse architecture in ADLS / Databricks.
- Perform data preparation tasks including data cleaning, normalization, deduplication, type conversion etc.
- Work with DevOps team to deploy solutions in production environments.
- Control data processes and take corrective action when errors are identified.
- Corrective action may include executing a work around process and then identifying the cause and solution for data errors.
- Participate as a full member of the global Analytics team, providing solutions for and insights into data related items.
- Collaborate with your Data Science and Business Intelligence colleagues across the world to share key learnings, leverage ideas and solutions and to propagate best practices.
- You will lead projects that include other team members and participate in projects led by other team members.
- Apply change management tools including training, communication and documentation to manage upgrades, changes and data migrations.
Required skills Mandatory :
Must have skills : Pyspark, Databricks, ML Flow, Azure DevOps, SQL
-
delhi, India Data Warehouse Engineer Full timeExperience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.
-
Data Warehouse Engineer
2 weeks ago
Delhi, India Data Warehouse Engineer Full timeExperience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.
-
Senior Data Integration Engineer
2 weeks ago
Delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
Senior Data Integration Engineer
2 weeks ago
Delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:- Design and architect integration solutions to connect various enterprise applications, systems, and databases.- Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.- Utilize Azure Integration Services such as Azure Logic...
-
Senior data integration engineer
2 weeks ago
Delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
Software Engineering Director
2 months ago
Gurgaon/Gurugram/Delhi/Delhi NCR, India Real Time Data Services . Ltd. Full timeKey Responsibilities: As a Software Engineering Director at Real Time Data Services . Ltd., you will lead a team of software engineers, providing regular feedback, performance reviews, and career development support. You will oversee the end-to-end execution of engineering projects, collaborating with stakeholders to understand requirements, set priorities,...
-
Lead data engineer
4 weeks ago
Delhi, India Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
Senior Data Engineer
1 week ago
Delhi NCR/Gurgaon/Gurugram, India AJ Consulting Full timeTitle : Senior Data Engineer Job Location : Gurgaon Education : B.TECH / MTECH Experience : 5 + Payroll : Nippon Data Systems Ltd NIPPON DATA SYSTEMS LIMITED is a provider of IT enabled business solutions which provide our clients competitive business advantage. We partner with our customers to deliver business solutions to their satisfaction and help...
-
Data Platform Engineer
3 days ago
Delhi, India OSD Data Services Full timeData Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
Data platform engineer
3 days ago
Delhi, India OSD Data Services Full timeData Platform Engineer Location : RemoteType : InternshipAbout Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...
-
Data Platform Engineer
3 days ago
Delhi, India OSD Data Services Full timeData Platform EngineerLocation : RemoteType : InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
AWS Data Engineer
4 weeks ago
delhi, India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
4 months ago
Delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
AWS Data Engineer
1 month ago
delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
Aws data engineer
4 weeks ago
Delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
Data Engineer
1 month ago
Delhi NCR, India Shamrock Value Pvt Ltd Full timeJob Description : Hiring : Data Engineer (Female Candidates Only)Location : GurugramExperience : 2+ YearsSalary : Up to 15 LPA(Depends on your interview, experience and current CTC)Qualification : Master's/Bachelor's degree in Engineering, Computer Science, Math, or StatisticsAvailability : Immediate JoinersSkills : Python, SQL, Spark, Azure...
-
Lead Data Architect
5 days ago
Delhi NCR/Gurgaon/Gurugram, India AJ Consulting Full timeJob Overview:">We are seeking a skilled Senior Data Engineer to join our team at AJ Consulting. As a key member of our data engineering team, you will play a pivotal role in architecting and implementing our data infrastructure transformation.This is an exciting opportunity to work with cutting-edge technologies and contribute to the development of our data...
-
Data Platform Engineer
1 month ago
Gurgaon/Gurugram/Delhi NCR, India ARC Consulting Full timePurpose of the role :To configure, design, build, and maintain our integration of both software and hardware platforms, collaborating closely with cross-functional teams to ensure our data systems are efficient, scalable, and secure and comply with IT guardrails. As platform SME, this role also consults on change initiatives involving the data...
-
Data Engineer
3 weeks ago
Noida, Delhi NCR, India Syncwell Infotech Private Limited Full timeRole and ResponsibilitiesDesign, develop and deliver the building of ADF pipelines across various integration points for the Accounting & Reporting Stream.Create and maintain scalable data pipelines using PySpark and ETL workflows using Azure Databricks and Azure Data FactoryData Modelling and Architecture: Build and optimize data models and structures to...