Data Engineer

3 weeks ago


GurgaonGurugram, IN IFLOWTECH SOLUTIONS PRIVATE LIMITED Full time

Role : Data Engineer

location : Gurugram

Experience : Must have 5+ Years

Primary Skills : Python, Pyspark, SQL, Hive, Data Ware Housing, Data Modelling, Tableau/Power BI, Data Migration, Source to Target Mapping

Key Responsibilities :

- Independently run workshops and interviews with appropriate stakeholders (data owners from Business, Service and Product teams) to understand the magnitude of data usage & dependencies and identify key use cases associated to data sources.

- Assess data sources in scope, prioritize data products based on usage & priority and ascertain the data required

- Review and analyze common data used across multiple use cases but with varied definitions and derivations and perform root cause analysis

- Categorize the data based on usage and priority

- Develop Data Model (conceptual, logical and physical data models), create data mapping (Source-to-target mapping of complex business rules) while transforming business requirements to technical specifications

- Ensure successful migration of Legacy system data used under all use cases to new data platform

- Compile, segregate and prioritize Legacy system data

- Map all Legacy system variables in question with their new data platform counterparts

- Facilitate the creation, migration and testing of all variables from the Legacy system

- Test the SOR and derived data, scanners and dashboards enabled in new data platform

- Strong analytical skills with the ability to collect, organize, analyse, and disseminate significant amounts of information with attention to detail and accuracy

- Develop optimized SQL queries to extract data from test and production databases to perform data analysis and data quality check, perform data analysis

- Proficient in Python for data engineering task, scripting and automation

- Responsible for creation of ETL pipelines using PySpark and Python in cloud platforms (e.g., AWS, Azure, Google Cloud)

- Strong understanding of data integration best practices and concepts

- Analysis of data to extract business logic under different business and technical BI reports (Tableau, Power BI, etc) and create visualizations to present the findings

- Communicate effectively with both technical and non-technical team members and partner teams to ensure alignment and project success

Essential Skills and Qualifications :

- Bachelor's degree in computer science, Engineering, or a related field; or equivalent work experience

- Excellent problem-solving and analytical skills, with a strong attention to detail

- Effective communication and collaboration skills, with the ability to work in cross-functional teams

- Familiarity with Data Engineering tools and technologies.

- Hands on experience working on cloud platforms (e.g., AWS, Azure, Google Cloud).

- Strong proficiency in SQL, Python, PySpark, Hive, Bigdata,

- 5+ years of experience in data engineering or a related role, with a focus on managed services and cloud-based solutions.

Main and PrimaryTechnical Skills :

- Python, Pyspark, SQL, Hive, Data Ware Housing, Data Modelling, Tableau/Power BI, Data Migration, Source to Target Mapping

(ref:hirist.tech)
  • Data Engineer

    2 weeks ago


    Gurgaon/Gurugram, IN CRESCENDO GLOBAL LEADERSHIP HIRING INDIA PRIVATE L Full time

    Exciting opportunity for a Data Engineer with 4-7 years' experience to lead analytic strategies, technical requirements, and data solutions for a major insurance client in our dynamic team.Location : PAN INDIA(Remote)Your Future Employer :This company is a leading operations management and analytics provider that empowers businesses to achieve strategic...

  • Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN Paddlelift Full time

    Job Description :You will work closely with the data analytics team to analyze and interpret data, develop data visualizations, and assist in data-driven decision-making processes. This includes collecting and cleaning data, conducting data analysis using statistical software, and creating reports and presentations to communicate insights.Requirements : -...

  • Azure Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN HNM Solutions Full time

    Note : Immediate joiner's only. 1st, 3rd and 5th Saturdays are workingInterview mode : Walkin Drive interview on 10th-Aug-24 (Saturday) at Gurgaon location (F2F)Role : Azure data engineeringLocation : GurgaonExperience : 3+ yearsMandatory :- DataBricks Engineer, SQL Engineer and a Mongodb Engineer- Little with any bid data exp (Hands on)Roles and...

  • Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN curatAId Full time

    Job Description :Expertise in Azure cloud tools for our client, a global business and technology services firm. In this role, you will be integral to designing, developing, and maintaining the data infrastructure. The ideal candidate will have extensive experience with cloud-based data technologies, particularly in Azure, and a proven track record of...

  • Senior Data Engineer

    2 weeks ago


    Gurgaon/Gurugram, IN Altudo Full time

    We have a unique career opportunity for an experienced Data Engineer to play a key role in the growth of the Analytics practice. You will work with Altudo' s clients to deliver cutting-edge data & analytics solutions using modern data platforms such as Databricks, Snowflake and Microsoft Fabric. You will play a key role in leading complex engagements. In...


  • Gurgaon/Gurugram, IN Spectral Consultant Full time

    Spectral Consultants is hiring for the role of Data Engineering- Manager with one of the financial services organisation.Experience : 10+ yearsShould have experience in - Enterprise Data EnvironmentResponsibilities :- Extensive experience with Azure Cloud strategies & industry best practices- Excellent skills in data management, data modelling, data...

  • Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN Elite recruitments Full time

    Job opportunity for data engineers for Gurgaon location. Experience : 8+ years.Job Description :Role & Responsibilities :- Should have good experience in databricks.- A seasoned data team member with a good grasp of both business and technical aspects.- Familiarity with data stack.- Interact with the other members of the data governance team, business teams...

  • Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN Drimlite Full time

    Job Title : Data EngineerLocation : Gurugram, DelhiExperience : 3-5 YearsBudget : 24 LPAWork Mode : Work From Office (WFO)Interview Mode : VirtualMust-Have Skills : PySpark, Databricks, ML Flow, Azure DevOps, SQLJob Description :We are seeking a skilled Data Engineer to design, build, and maintain data pipelines, data architectures, and ETL processes using...

  • Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN Coders Brain Technology Private Limited Full time

    Job Title : ML - Data EngineerLocation : Gurugram, HaryanaJob Type : Full-TimeNotice period : Immediate Joiners OnlyAbout Us :Coders Brain is a global leader in its services, digital and business solutions that partners with its clients to simplify, strengthen and transform their businesses. We ensure the highest levels of certainty and satisfaction through...

  • Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN Uncap Research Labs Full time

    Job Description :Apache Spark : - Expertise in Spark for large-scale data processing and analytics, including Spark SQL and Spark Streaming.Apache Kafka : - Proficiency in Kafka for real-time data streaming, message brokering, and building event-driven architectures.Apache Cassandra : - In-depth knowledge of Cassandra for scalable and high-performance...

  • Lead Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN RENOUS EXTENSERVE PRIVATE LIMITED Full time

    One our leading client is hiring for "Lead Data Engineer"Below are the details -Position - Lead Data Engineer Experience - 8+YearsJob type - ContractualLocation - GurgaonCTC - Best in the IndustryJob Description : We're looking for people to join our engineering team in building upon this success, as we grow to play a key part in redefining the future of...

  • IT Manager

    3 weeks ago


    Gurgaon/Gurugram, IN Spectral Consultants – Search & Recruitment firm Full time

    Job Description : We are looking for an experienced Cloud and Data Manager to provide strategic and technical direction to help deliver our next-generation solutions using cloud-based technologies. This role requires expertise around data quality and maintaining the production environment, where the delivered solutions are executing on daily basis. You must...

  • Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN OMEGA HIRES CONSULTANCY Full time

    Job Description :- Design, build, and maintain scalable and efficient data pipelines using GCP tools such as Cloud Dataflow, Cloud Composer, and Cloud Functions.- Extract data from various sources (e. , databases, files, APIs) and transform it into a suitable format for analytics.- Load data into GCP data stores like BigQuery, Cloud Storage, and Data...

  • Petonic Infotech

    3 weeks ago


    Gurgaon/Gurugram, IN Petonic Infotech Pvt. Ltd. Full time

    Job Title : Senior Data EngineerLocation : Gurgaon (Work from Office)Company Overview :Petonic is an innovative leader in harnessing AI-driven solutions to solve complex challenges. We empower our clients by enabling data-driven insights and advanced analytics. Join us as we build transformative AI systems and revolutionize industries.Job Summary :We are...

  • Lead Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN Acquire Bright Minds Full time

    Job Description : Lead Data EngineerLocation : GurgaonExperience : 8 to 10 YearsNotice Period : 20 Days :Data Integration and ETL :- Design, develop, and implement efficient data integration and ETL pipelines using Talend or other relevant tools.- Ensure data quality, consistency, and accuracy throughout the data lifecycle.- Optimize ETL processes for...

  • Lead Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN StorySideUp Full time

    Job Description : We are seeking a passionate, hands-on and experienced Lead Data Engineer to join our Databricks Center of Excellence. You will play a key role in helping customers understand and implement Databricks Lakehouse platform, and to achieve their business goals. The candidate will collaborate with client stakeholders on multiple projects in Big...

  • AWS Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN True Tech Professionals Full time

    Job Description :We are seeking a skilled Senior Data Engineer to join our dynamic team. The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena, Redshift, and SQL. The successful candidate will play a key role in designing, developing, and maintaining our data infrastructure, ensuring...


  • Gurgaon/Gurugram, IN Elite recruitments Full time

    Experience : 8+ years. Location : Gurgaon. Should have good experience in azure cloud platform. Role & Responsibilities Overview :- A seasoned data team member with a good grasp of both business and technical aspects.- Familiarity with data stack.- Interact with the other members of the data governance team,business teams to understand requirements and also...

  • Data Engineer II

    3 weeks ago


    Pune/Gurgaon/Gurugram, IN Hiring Infinity Full time

    SDE2 Data EngineerAbout :My client is a generative AI company dedicated to transforming workplaces with innovative AI solutions and micro-applications built on the GenAI stack. Our mission is to enhance efficiency and scalability across various industries, including education, legal and compliance, and auditing and taxation. We leverage deep industry...


  • Gurgaon/Gurugram, IN Huntingcube Recruitment Solutions Full time

    Job Description : - Lead the design and implementation of scalable and efficient big data architectures, ensuring optimal performance, security, and scalability.- Design, build, and maintain complex data pipelines that process large volumes of data from multiple sources, ensuring data is clean, reliable, and accessible.- Implement and manage big data storage...