Data Engineer

2 weeks ago


Delhi NCRGurgaonGurugram, India Drimlite Full time

Job Description :

- Design and build data pipelines using Spark-SQL and PySpark in Azure Databricks

Job Description :


- Design and build ETL pipelines using ADF

- Build and maintain a Lakehouse architecture in ADLS / Databricks.

- Perform data preparation tasks including data cleaning, normalization, deduplication, type conversion etc.

- Work with DevOps team to deploy solutions in production environments.

- Control data processes and take corrective action when errors are identified.


- Corrective action may include executing a work around process and then identifying the cause and solution for data errors.

- Participate as a full member of the global Analytics team, providing solutions for and insights into data related items.

- Collaborate with your Data Science and Business Intelligence colleagues across the world to share key learnings, leverage ideas and solutions and to propagate best practices.


- You will lead projects that include other team members and participate in projects led by other team members.

- Apply change management tools including training, communication and documentation to manage upgrades, changes and data migrations.

Required skills Mandatory :

Must have skills : Pyspark, Databricks, ML Flow, Azure DevOps, SQL

(ref:hirist.tech)

  • delhi, India Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.


  • Delhi, India Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.


  • Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...


  • delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...


  • Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:- Design and architect integration solutions to connect various enterprise applications, systems, and databases.- Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.- Utilize Azure Integration Services such as Azure Logic...


  • Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...


  • Gurgaon/Gurugram/Delhi/Delhi NCR, India Real Time Data Services . Ltd. Full time

    Key Responsibilities: As a Software Engineering Director at Real Time Data Services . Ltd., you will lead a team of software engineers, providing regular feedback, performance reviews, and career development support. You will oversee the end-to-end execution of engineering projects, collaborating with stakeholders to understand requirements, set priorities,...

  • Lead data engineer

    4 weeks ago


    Delhi, India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...


  • Delhi NCR/Gurgaon/Gurugram, India AJ Consulting Full time

    Title : Senior Data Engineer Job Location : Gurgaon Education : B.TECH / MTECH Experience : 5 + Payroll : Nippon Data Systems Ltd NIPPON DATA SYSTEMS LIMITED is a provider of IT enabled business solutions which provide our clients competitive business advantage. We partner with our customers to deliver business solutions to their satisfaction and help...


  • Delhi, India OSD Data Services Full time

    Data Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...


  • Delhi, India OSD Data Services Full time

    Data Platform Engineer Location : RemoteType : InternshipAbout Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...


  • Delhi, India OSD Data Services Full time

    Data Platform EngineerLocation : RemoteType : InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • AWS Data Engineer

    4 weeks ago


    delhi, India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    4 months ago


    Delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • AWS Data Engineer

    1 month ago


    delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • Aws data engineer

    4 weeks ago


    Delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • Data Engineer

    1 month ago


    Delhi NCR, India Shamrock Value Pvt Ltd Full time

    Job Description : Hiring : Data Engineer (Female Candidates Only)Location : GurugramExperience : 2+ YearsSalary : Up to 15 LPA(Depends on your interview, experience and current CTC)Qualification : Master's/Bachelor's degree in Engineering, Computer Science, Math, or StatisticsAvailability : Immediate JoinersSkills : Python, SQL, Spark, Azure...

  • Lead Data Architect

    5 days ago


    Delhi NCR/Gurgaon/Gurugram, India AJ Consulting Full time

    Job Overview:">We are seeking a skilled Senior Data Engineer to join our team at AJ Consulting. As a key member of our data engineering team, you will play a pivotal role in architecting and implementing our data infrastructure transformation.This is an exciting opportunity to work with cutting-edge technologies and contribute to the development of our data...


  • Gurgaon/Gurugram/Delhi NCR, India ARC Consulting Full time

    Purpose of the role :To configure, design, build, and maintain our integration of both software and hardware platforms, collaborating closely with cross-functional teams to ensure our data systems are efficient, scalable, and secure and comply with IT guardrails. As platform SME, this role also consults on change initiatives involving the data...

  • Data Engineer

    3 weeks ago


    Noida, Delhi NCR, India Syncwell Infotech Private Limited Full time

    Role and ResponsibilitiesDesign, develop and deliver the building of ADF pipelines across various integration points for the Accounting & Reporting Stream.Create and maintain scalable data pipelines using PySpark and ETL workflows using Azure Databricks and Azure Data FactoryData Modelling and Architecture: Build and optimize data models and structures to...