Data Engineer

2 weeks ago


GurgaonGurugram, India Drimlite Full time

Job Title : Data Engineer

Location : Gurugram, Delhi

Experience : 3-5 Years

Budget : 24 LPA

Work Mode : Work From Office (WFO)

Interview Mode : Virtual

Must-Have Skills : PySpark, Databricks, ML Flow, Azure DevOps, SQL


Job Description :

We are seeking a skilled Data Engineer to design, build, and maintain data pipelines, data architectures, and ETL processes using advanced tools and technologies. The ideal candidate will have hands-on experience with PySpark, Databricks, and Azure DevOps, and will be proficient in building scalable solutions for data processing and analytics.

As a Data Engineer, you will collaborate with global teams, including data science and business intelligence, to ensure efficient data handling and gain insights that drive business decisions

Key Responsibilities :

- Data Pipeline Development: Design and build data pipelines using Spark-SQL and PySpark within Azure Databricks to handle large datasets efficiently.

- ETL Pipeline Design: Develop ETL pipelines using Azure Data Factory (ADF) for robust data transformation and integration.

- Lakehouse Architecture: Build and maintain a Lakehouse architecture in ADLS/Databricks, ensuring scalable and efficient data storage and processing.

- Data Preparation: Perform data preparation tasks including cleaning, normalization, deduplication, and type conversion for optimized data usability.

- Collaboration with DevOps: Work closely with the DevOps team to deploy data solutions in production environments using Azure DevOps.

- Error Handling: Monitor data processes, identify errors, and execute corrective actions, ensuring data integrity. This includes troubleshooting and resolving root causes of data errors.

- Global Team Collaboration: Participate as a member of the global analytics team, collaborating on projects, sharing insights, and adopting best practices from data science and business intelligence colleagues.

- Project Leadership: Lead and participate in projects, applying change management tools to manage upgrades, changes, and data migrations. This includes training, documentation, and communication efforts.

Qualifications :

- 3 to 5 years of experience in data engineering, with a strong focus on PySpark, Databricks, and Azure DevOps.

- Expertise in designing and building ETL pipelines using ADF.

- Strong knowledge of Lakehouse architecture and ADLS/Databricks.

- Solid experience with SQL for database queries and data management.

- Proven ability to collaborate with global teams and lead data projects.

- Strong problem-solving skills and attention to detail in managing data processes and errors.

(ref:hirist.tech)
  • Data Engineer

    2 weeks ago


    Gurgaon/Gurugram, India Paddlelift Full time

    Job Description : You will work closely with the data analytics team to analyze and interpret data, develop data visualizations, and assist in data-driven decision-making processes. This includes collecting and cleaning data, conducting data analysis using statistical software, and creating reports and presentations to communicate insights.Requirements : -...

  • Data Engineer

    2 weeks ago


    Gurgaon/Gurugram, India Unifocus Full time

    Unifocus (formerly Knowcross) is an integrated workforce management software platform offering intelligent automation for daily work orders management, housekeeping activities, facility maintenance, survey solutions, scheduling & labour management, and time & attendance built for the hospitality market and other dynamic scheduling environment.We support...


  • Gurgaon, Haryana, India NTT DATA Full time

    Job Title: Network Engineering Professional - Advanced Routing and SwitchingAn exciting opportunity has arisen for an experienced Network Engineering Professional to join our team at NTT DATA in Delhi/NCR. We are seeking a seasoned engineer with advanced routing and switching skills to provide technical support to clients.

  • Senior Data Engineer

    2 weeks ago


    Gurgaon/Gurugram, India Altudo Full time

    We have a unique career opportunity for an experienced Data Engineer to play a key role in the growth of the Analytics practice. You will work with Altudo' s clients to deliver cutting-edge data & analytics solutions using modern data platforms such as Databricks, Snowflake and Microsoft Fabric. You will play a key role in leading complex engagements....

  • Data Engineer

    2 weeks ago


    Gurgaon/Gurugram, India IFLOWTECH SOLUTIONS PRIVATE LIMITED Full time

    Role : Data Engineerlocation : GurugramExperience : Must have 5+ Years Primary Skills : Python, Pyspark, SQL, Hive, Data Ware Housing, Data Modelling, Tableau/Power BI, Data Migration, Source to Target MappingKey Responsibilities : - Independently run workshops and interviews with appropriate stakeholders (data owners from Business, Service and Product...

  • Data Engineer

    2 weeks ago


    Gurgaon/Gurugram, India Coders Brain Technology Private Limited Full time

    Job Title : ML - Data EngineerLocation : Gurugram, HaryanaJob Type : Full-TimeNotice period : Immediate Joiners OnlyAbout Us :Coders Brain is a global leader in its services, digital and business solutions that partners with its clients to simplify, strengthen and transform their businesses. We ensure the highest levels of certainty and satisfaction through...

  • Data Engineer

    4 weeks ago


    Gurgaon, India mccainfood Full time

       Position Title: Data EngineerPosition Type: Regular - Full-Time ​Position Location: New Delhi Requisition ID: 33103   Position SummaryData Engineers are primarily responsible for designing, building, managing, and operationalizing data pipelines in support of key data and analytics use cases. They are accountable for guaranteeing compliance...

  • Data Engineer

    3 weeks ago


    Gurugram, India StatusNeo Full time

    Job description Job Title: Data Engineer Company: StatusNeo About At StatusNeo, we are on a mission to redefine the future of data-driven decision-making. We are looking for a passionate and talented Junior Data Engineer to join our dynamic team. If you have up to one year of experience or are fresh out of college with a strong academic background in data...

  • Data Engineer

    3 weeks ago


    Gurugram, India StatusNeo Full time

    Job descriptionJob Title: Data EngineerCompany: StatusNeoAboutAt StatusNeo, we are on a mission to redefine the future of data-driven decision-making. We are looking for a passionate and talented Junior Data Engineer to join our dynamic team. If you have up to one year of experience or are fresh out of college with a strong academic background in data...

  • Data Engineer

    3 weeks ago


    Gurugram, India StatusNeo Full time

    Job descriptionJob Title: Data EngineerCompany: StatusNeoAboutAt StatusNeo, we are on a mission to redefine the future of data-driven decision-making. We are looking for a passionate and talented Junior Data Engineer to join our dynamic team. If you have up to one year of experience or are fresh out of college with a strong academic background in data...


  • Gurgaon, India Cognitio Analytics Inc Full time

    Experience: 1 to 8 years - DE/ Sr. DE/ AM /Manager Must Have: SQL Python/ Pyspark Azure Databricks, ADLS Gen 2 Blob Storage, Key Vaults, Bit Bucket, Version control, Azure Dev Ops ETL, Building Data Pipelines, Data Warehousing, Data Modelling and Governance, Data Security Agile Practices, SDLC Data Exploration, Data Quality metrics,...

  • Data Engineer

    3 weeks ago


    Gurgaon, India StatusNeo Full time

    Job descriptionJob Title: Data EngineerCompany: StatusNeoAboutAt StatusNeo, we are on a mission to redefine the future of data-driven decision-making. We are looking for a passionate and talented Junior Data Engineer to join our dynamic team. If you have up to one year of experience or are fresh out of college with a strong academic background in data...

  • Data Engineer

    2 weeks ago


    Gurgaon/Gurugram, India OMEGA HIRES CONSULTANCY Full time

    Job Description : - Design, build, and maintain scalable and efficient data pipelines using GCP tools such as Cloud Dataflow, Cloud Composer, and Cloud Functions.- Extract data from various sources (e. , databases, files, APIs) and transform it into a suitable format for analytics.- Load data into GCP data stores like BigQuery, Cloud Storage, and Data...

  • IT Manager

    2 weeks ago


    Gurgaon/Gurugram, India Spectral Consultants – Search & Recruitment firm Full time

    Job Description : We are looking for an experienced Cloud and Data Manager to provide strategic and technical direction to help deliver our next-generation solutions using cloud-based technologies. This role requires expertise around data quality and maintaining the production environment, where the delivered solutions are executing on daily basis. You...

  • Data Engineer

    2 months ago


    gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...


  • Gurgaon, India Cognitio Analytics Inc Full time

    Experience:1 to 8 years - DE/ Sr. DE/ AM /ManagerMust Have:SQLPython/ PysparkAzure Databricks, ADLS Gen 2 Blob Storage, Key Vaults, Bit Bucket, Version control, Azure Dev OpsETL, Building Data Pipelines, Data Warehousing, Data Modelling and Governance, Data SecurityAgile Practices, SDLCData Exploration, Data Quality metrics, Historical data Management, Good...

  • Data Engineer

    3 weeks ago


    Gurgaon, India StatusNeo Full time

    Job description Job Title: Data Engineer Company: StatusNeo About At StatusNeo, we are on a mission to redefine the future of data-driven decision-making. We are looking for a passionate and talented Junior Data Engineer to join our dynamic team. If you have up to one year of experience or are fresh out of college with a strong academic background...


  • Gurugram, India Cognitio Analytics Inc Full time

    Experience:1 to 8 years - DE/ Sr. DE/ AM /ManagerMust Have:SQLPython/ Pyspark Azure Databricks, ADLS Gen 2 Blob Storage, Key Vaults, BitBucket, Version control, Azure DevOpsETL, Building Data Pipelines, Data Warehousing, Data Modelling and Governance, Data SecurityAgile Practices, SDLCData Exploration, Data Quality metrics, Historical data Management, Good...


  • Gurugram, India Cognitio Analytics Inc Full time

    Experience: 1 to 8 years - DE/ Sr. DE/ AM /Manager Must Have: SQL Python/ Pyspark Azure Databricks, ADLS Gen 2 Blob Storage, Key Vaults, BitBucket, Version control, Azure DevOps ETL, Building Data Pipelines, Data Warehousing, Data Modelling and Governance, Data Security Agile Practices, SDLC Data Exploration, Data Quality metrics, Historical data...

  • Data engineer

    4 weeks ago


    Gurgaon, India Markovate Full time

    Job Summary We are seeking a skilled and motivated Data Engineer with a strong background in data integration, ETL processes, and data warehousing. The ideal candidate will have over 2 years of experience in data engineering, with a good understanding of data architecture, pipeline creation, and big data technologies. This role requires a proactive...