Manager-Data Engineering-Cloud Data Engineering

4 days ago

Gurgaon, Haryana, India EXL Full time ₹ 12,00,000 - ₹ 36,00,000 per year
Description

Data Engineer Consultant – Job Description

Job Summary:

Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders..

Qualifications and Skills:

  • Strong knowledge on Python and Pyspark 
    • Expectation is to have ability to write Pyspark scripts for developing data workflows. 
  • Strong knowledge on SQL, Hadoop, Hive, Azure, Databricks and Greenplum 
    • Expectation is to write SQL to query metadata and tables from different data management system such as, Oracle, Hive, Databricks and Greenplum.
    • Familiarity with big data technologies like Hadoop, Spark, and distributed computing frameworks.
    • Expectation is to use Hue and run Hive SQL queries, schedule Apache Oozie jobs to automate the data workflows.
  • Good working experience of communicating with the stakeholders and collaborate effectively with the business team for data testing.
    • Expectation is to have strong problem-solving and troubleshooting skills.
    • Expectation is to establish comprehensive data quality test cases, procedures and implement automated data validation processes.
  • Degree in Data Science, Statistics, Computer Science or other related fields or an equivalent combination of education and experience.
  • 5-7 years of experience in Data Engineer.
  • Proficiency in programming languages commonly used in data engineering, such as Python, Pyspark, SQL.
  • Experience in Azure cloud computing platform, such as developing ETL processes using Azure Data Factory, big data processing and analytics with Azure Databricks.
  • Strong communication, problem solving and analytical skills with the ability to do time management and multi-tasking with attention to detail and accuracy.
Responsibilities

Responsibilities:

  • Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.
  • Create the data integration and data diagram documentation. 
  • Lead the data validation, UAT and regression test for new data asset creation.
  • Create and maintain data models, including schema design and optimization.
  • Create and manage data pipelines that automate the flow of data, ensuring data quality and consistency
Qualifications

Any Graduate

  • Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India CoPoint Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Data Engineer Location: India (Gurugram)About CoPointAIAI isn't coming — it's here. And we help enterprises make it real. At CoPointAI, we work inside the enterprise — not just around it — to turn AI potential into practical wins. From hands-on C-suite workshops (our AI Foundations series) to AI-native MVPs built in weeks, our team partners...

  • Data Engineer Advisor

    2 weeks ago

    Gurgaon, Haryana, India NTT DATA Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Req ID: 338198NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Advisor to join our team in Gurgaon, Haryāna (IN-HR), India (IN). Technical Support: Provide L1, L2...

  • Data Scientist

    6 days ago

    Gurgaon, Haryana, India Data Sutram Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    *Data Sutram,*funded by India Infoline (IIFL), Indian Angel Network (IAN) and 100x.VC (led by Sanjay Mehta), is an alternate data company, using external data feeds to create every location's DNA that is utilized in various use cases like credit underwriting, location profiling, site selection, etc. It is one of the fastest-growing companies in the space of...

  • Data Engineer Advisor

    2 weeks ago

    Gurgaon, Haryana, India NTT DATA North America Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Req ID:338198NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer Advisor to join our team in Gurgaon, Haryāna (IN-HR), India (IN).Technical Support:Provide L1, L2 and L3...

  • Area Manager-Data Engineering-Cloud Data Engineering

    7 days ago

    Gurgaon, Haryana, India EXL Talent Acquisition Team Full time ₹ 1,50,00,000 - ₹ 3,00,00,000 per year

    Data Engineer Consultant – Job DescriptionJob Summary:Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders..Qualifications and Skills:Strong knowledge on Python and Pyspark  Expectation is to have ability to write Pyspark scripts for developing...

  • Manager-Data Engineering-Cloud Data Engineering

    3 days ago

    Gurgaon, Haryana, India EXL Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    DescriptionDesign, develop, and maintain scalable and efficient data pipelines using PySpark and DatabricksPerform data extraction, transformation, and loading (ETL) from diverse structured and unstructured data sourcesDevelop and maintain data models, data warehouses, and data marts in DatabricksProficient in Python, Apache Spark, and PySpark Integrate...

  • Data Engineer

    4 days ago

    Gurgaon, Haryana, India Sirius AI Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Data Engineer Job DescriptionAbout Sirius AISirius AI is a US headquartered AI Consulting services and products company with operations in India. Sirius AI focuses on Financial Services enterprises and solutions / services delivered across multiple geographies. We are an innovation-driven AI and data driven consulting services firm with a high focus on...

  • Lead Assistant Manager-Data Engineering-Cloud Data Engineering

    1 week ago

    Gurgaon, Haryana, India EXL Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description4-9 years experience on Data Engineering role working with Databricks & Azure Cloud technologies.Bachelor's degree in computer science, Information Technology, or related field.Strong proficiency in PySpark, Python, SQL. Strong experience in data modeling, ETL/ELT pipeline development, and automationProficient in working on Azure cloud components...

  • Consultant – Cloud Data Engineer – GCP

    1 week ago

    Gurgaon, Haryana, India Sirius AI Full time ₹ 8,00,000 - ₹ 25,00,000 per year

    Key Responsibilities:Design, develop, and manage scalable, secure, and efficient data pipelines on Google Cloud Platform (GCP) to process and transform large datasets from multiple sources.Implement and optimize GCP data services such as BigQuery, Cloud Storage, Cloud SQL, Dataflow, Dataproc, Pub/Sub, and Cloud Functions.Architect and maintain ETL/ELT...

  • Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Mount Talent Consulting Pvt Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role-Data EngineerLocation -GurgoanJD-Mandatory Skill Set– Data Engineering, Data Architecture, ETL Pipelines, AWS cloud, DSA, Programming on Python, Spark, Pyspark, batch processing of Data,.Required skills and qualificationsProgramming languages : Strong skills in SQL, Python, and/or Java are common requirements.Database management : Expertise with...