Data Engineer

3 weeks ago


GurgaonGurugram, IN Drimlite Full time

Job Title : Data Engineer

Location : Gurugram, Delhi

Experience : 3-5 Years

Budget : 24 LPA

Work Mode : Work From Office (WFO)

Interview Mode : Virtual

Must-Have Skills : PySpark, Databricks, ML Flow, Azure DevOps, SQL


Job Description :

We are seeking a skilled Data Engineer to design, build, and maintain data pipelines, data architectures, and ETL processes using advanced tools and technologies. The ideal candidate will have hands-on experience with PySpark, Databricks, and Azure DevOps, and will be proficient in building scalable solutions for data processing and analytics.

As a Data Engineer, you will collaborate with global teams, including data science and business intelligence, to ensure efficient data handling and gain insights that drive business decisions

Key Responsibilities :

- Data Pipeline Development: Design and build data pipelines using Spark-SQL and PySpark within Azure Databricks to handle large datasets efficiently.

- ETL Pipeline Design: Develop ETL pipelines using Azure Data Factory (ADF) for robust data transformation and integration.

- Lakehouse Architecture: Build and maintain a Lakehouse architecture in ADLS/Databricks, ensuring scalable and efficient data storage and processing.

- Data Preparation: Perform data preparation tasks including cleaning, normalization, deduplication, and type conversion for optimized data usability.

- Collaboration with DevOps: Work closely with the DevOps team to deploy data solutions in production environments using Azure DevOps.

- Error Handling: Monitor data processes, identify errors, and execute corrective actions, ensuring data integrity. This includes troubleshooting and resolving root causes of data errors.

- Global Team Collaboration: Participate as a member of the global analytics team, collaborating on projects, sharing insights, and adopting best practices from data science and business intelligence colleagues.

- Project Leadership: Lead and participate in projects, applying change management tools to manage upgrades, changes, and data migrations. This includes training, documentation, and communication efforts.

Qualifications :

- 3 to 5 years of experience in data engineering, with a strong focus on PySpark, Databricks, and Azure DevOps.

- Expertise in designing and building ETL pipelines using ADF.

- Strong knowledge of Lakehouse architecture and ADLS/Databricks.

- Solid experience with SQL for database queries and data management.

- Proven ability to collaborate with global teams and lead data projects.

- Strong problem-solving skills and attention to detail in managing data processes and errors.

(ref:hirist.tech)
  • Data Engineer

    2 weeks ago


    Gurgaon/Gurugram, IN CRESCENDO GLOBAL LEADERSHIP HIRING INDIA PRIVATE L Full time

    Exciting opportunity for a Data Engineer with 4-7 years' experience to lead analytic strategies, technical requirements, and data solutions for a major insurance client in our dynamic team.Location : PAN INDIA(Remote)Your Future Employer :This company is a leading operations management and analytics provider that empowers businesses to achieve strategic...

  • Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN Paddlelift Full time

    Job Description :You will work closely with the data analytics team to analyze and interpret data, develop data visualizations, and assist in data-driven decision-making processes. This includes collecting and cleaning data, conducting data analysis using statistical software, and creating reports and presentations to communicate insights.Requirements : -...

  • Azure Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN HNM Solutions Full time

    Note : Immediate joiner's only. 1st, 3rd and 5th Saturdays are workingInterview mode : Walkin Drive interview on 10th-Aug-24 (Saturday) at Gurgaon location (F2F)Role : Azure data engineeringLocation : GurgaonExperience : 3+ yearsMandatory :- DataBricks Engineer, SQL Engineer and a Mongodb Engineer- Little with any bid data exp (Hands on)Roles and...

  • Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN curatAId Full time

    Job Description :Expertise in Azure cloud tools for our client, a global business and technology services firm. In this role, you will be integral to designing, developing, and maintaining the data infrastructure. The ideal candidate will have extensive experience with cloud-based data technologies, particularly in Azure, and a proven track record of...

  • Senior Data Engineer

    2 weeks ago


    Gurgaon/Gurugram, IN Altudo Full time

    We have a unique career opportunity for an experienced Data Engineer to play a key role in the growth of the Analytics practice. You will work with Altudo' s clients to deliver cutting-edge data & analytics solutions using modern data platforms such as Databricks, Snowflake and Microsoft Fabric. You will play a key role in leading complex engagements. In...


  • Gurgaon/Gurugram, IN Spectral Consultant Full time

    Spectral Consultants is hiring for the role of Data Engineering- Manager with one of the financial services organisation.Experience : 10+ yearsShould have experience in - Enterprise Data EnvironmentResponsibilities :- Extensive experience with Azure Cloud strategies & industry best practices- Excellent skills in data management, data modelling, data...

  • Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN Elite recruitments Full time

    Job opportunity for data engineers for Gurgaon location. Experience : 8+ years.Job Description :Role & Responsibilities :- Should have good experience in databricks.- A seasoned data team member with a good grasp of both business and technical aspects.- Familiarity with data stack.- Interact with the other members of the data governance team, business teams...

  • Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN IFLOWTECH SOLUTIONS PRIVATE LIMITED Full time

    Role : Data Engineerlocation : GurugramExperience : Must have 5+ Years Primary Skills : Python, Pyspark, SQL, Hive, Data Ware Housing, Data Modelling, Tableau/Power BI, Data Migration, Source to Target MappingKey Responsibilities :- Independently run workshops and interviews with appropriate stakeholders (data owners from Business, Service and Product teams)...

  • Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN Coders Brain Technology Private Limited Full time

    Job Title : ML - Data EngineerLocation : Gurugram, HaryanaJob Type : Full-TimeNotice period : Immediate Joiners OnlyAbout Us :Coders Brain is a global leader in its services, digital and business solutions that partners with its clients to simplify, strengthen and transform their businesses. We ensure the highest levels of certainty and satisfaction through...

  • Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN Uncap Research Labs Full time

    Job Description :Apache Spark : - Expertise in Spark for large-scale data processing and analytics, including Spark SQL and Spark Streaming.Apache Kafka : - Proficiency in Kafka for real-time data streaming, message brokering, and building event-driven architectures.Apache Cassandra : - In-depth knowledge of Cassandra for scalable and high-performance...

  • Lead Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN RENOUS EXTENSERVE PRIVATE LIMITED Full time

    One our leading client is hiring for "Lead Data Engineer"Below are the details -Position - Lead Data Engineer Experience - 8+YearsJob type - ContractualLocation - GurgaonCTC - Best in the IndustryJob Description : We're looking for people to join our engineering team in building upon this success, as we grow to play a key part in redefining the future of...

  • IT Manager

    3 weeks ago


    Gurgaon/Gurugram, IN Spectral Consultants – Search & Recruitment firm Full time

    Job Description : We are looking for an experienced Cloud and Data Manager to provide strategic and technical direction to help deliver our next-generation solutions using cloud-based technologies. This role requires expertise around data quality and maintaining the production environment, where the delivered solutions are executing on daily basis. You must...

  • Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN OMEGA HIRES CONSULTANCY Full time

    Job Description :- Design, build, and maintain scalable and efficient data pipelines using GCP tools such as Cloud Dataflow, Cloud Composer, and Cloud Functions.- Extract data from various sources (e. , databases, files, APIs) and transform it into a suitable format for analytics.- Load data into GCP data stores like BigQuery, Cloud Storage, and Data...

  • Petonic Infotech

    3 weeks ago


    Gurgaon/Gurugram, IN Petonic Infotech Pvt. Ltd. Full time

    Job Title : Senior Data EngineerLocation : Gurgaon (Work from Office)Company Overview :Petonic is an innovative leader in harnessing AI-driven solutions to solve complex challenges. We empower our clients by enabling data-driven insights and advanced analytics. Join us as we build transformative AI systems and revolutionize industries.Job Summary :We are...

  • Lead Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN Acquire Bright Minds Full time

    Job Description : Lead Data EngineerLocation : GurgaonExperience : 8 to 10 YearsNotice Period : 20 Days :Data Integration and ETL :- Design, develop, and implement efficient data integration and ETL pipelines using Talend or other relevant tools.- Ensure data quality, consistency, and accuracy throughout the data lifecycle.- Optimize ETL processes for...

  • Lead Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN StorySideUp Full time

    Job Description : We are seeking a passionate, hands-on and experienced Lead Data Engineer to join our Databricks Center of Excellence. You will play a key role in helping customers understand and implement Databricks Lakehouse platform, and to achieve their business goals. The candidate will collaborate with client stakeholders on multiple projects in Big...


  • Gurgaon/Gurugram, IN Elite recruitments Full time

    Experience : 8+ years. Location : Gurgaon. Should have good experience in azure cloud platform. Role & Responsibilities Overview :- A seasoned data team member with a good grasp of both business and technical aspects.- Familiarity with data stack.- Interact with the other members of the data governance team,business teams to understand requirements and also...

  • AWS Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN True Tech Professionals Full time

    Job Description :We are seeking a skilled Senior Data Engineer to join our dynamic team. The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena, Redshift, and SQL. The successful candidate will play a key role in designing, developing, and maintaining our data infrastructure, ensuring...

  • Data Engineer II

    3 weeks ago


    Pune/Gurgaon/Gurugram, IN Hiring Infinity Full time

    SDE2 Data EngineerAbout :My client is a generative AI company dedicated to transforming workplaces with innovative AI solutions and micro-applications built on the GenAI stack. Our mission is to enhance efficiency and scalability across various industries, including education, legal and compliance, and auditing and taxation. We leverage deep industry...


  • Gurgaon/Gurugram, IN Huntingcube Recruitment Solutions Full time

    Job Description : - Lead the design and implementation of scalable and efficient big data architectures, ensuring optimal performance, security, and scalability.- Design, build, and maintain complex data pipelines that process large volumes of data from multiple sources, ensuring data is clean, reliable, and accessible.- Implement and manage big data storage...