See more Collapse

Data Engineer

4 weeks ago


Delhi, India Kenan Management Consultants Pvt Ltd Full time
Job Description

The role requires data ingestion, processing and extraction of data to & from Hadoop Cluster onlyusing Informatica BDM. It requires extensive experience in ETL, SQL, Scoop, Spark, Hive, Hadoop &KAFKA. Knowledge of PySpark will be preferable

Job Title Data Engineer

Experience

Minimum 4-5 years of Experience in Development inInformatica Big Data Management/ DEI & Informatica PowerCenterExtensive experience in delivering data pipelines usingInformatica on Big Data ClustersHands on experience with extraction of unstructured and semistructured data using data processor transformationKnowledge of PySpark will be high preferableFull knowledge of designing and creating complex data models

Education, Skillsets &Qualifications

Bachelor's degree in Computer Science or equivalent; Masterspreferred ProgrammingSolid programming skills in SQLDeep Knowledge in data architecture, designing workflows,building ingestion frameworkExpertise of working on Enterprise Big data distribution likeCloudera. Exposure to big data components HDFS, HIVEQL,Spark, HBase, Impala is essential

Main Duties & Responsibilities

Building and optimizing data pipelines architectures and data sets;both batch-oriented and real time using Informatica BDM fromboth relational & non relational DBsDesign, develop and customize mappings/workflows for differenttypes of loads using Informatica BDMLeverage various transformations in Informatica BDM tool to workon data ingestion, data profiling & data qualityLeverage Hadoop ecosystem knowledge to design, and developcapabilities to deliver our solutionsSupport and play a pivotal role as part of data engineering team tobuild the data lake on Cloudera for Enterprise analytics.Work hands on with Spark & KAFKA in addition to InformaticaplatformDesign recommend best approach suited for data movement fromdifferent sources to HDFSEnsure optimum performance of the Informatica mappings andworkflowWork with dynamic cross functional teams including business,Solution architects & Data engineers

We have other current jobs related to this field that you can find below

  • Operations Specialist

    2 weeks ago


    Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Operations Specialist

    2 weeks ago


    Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • Delhi, Delhi, India Lapis Data Analytics Full time

    Company DescriptionLapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...


  • Delhi, Delhi, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India...


  • Delhi, Delhi, India NTT DATA Full time

    Job DescriptionReq ID:273690NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India...

  • Lead Data Engineer

    4 days ago


    Delhi, India Advance Data Analytics Ltd. Full time

    *Immediate Joiners Preferred* We are hiring for a UK based client Experience: 6 to 10 years Location: Noida (Hybrid) Your main duties & responsibilities: Design, build and unit test of aspects data services, from ingestion, through harmonization and transformation into business usable analytics. Input into High level design and responsibility for low level...

  • Lead Data Engineer

    4 days ago


    Delhi, India Advance Data Analytics Ltd. Full time

    *Immediate Joiners Preferred*We are hiring for a UK based clientExperience: 6 to 10 yearsLocation: Noida (Hybrid)Your main duties & responsibilities:Design, build and unit test of aspects data services, from ingestion, through harmonization and transformation into business usable analytics.Input into High level design and responsibility for low level...

  • QA Engineer

    2 months ago


    delhi, India Data Unveil Full time

    Position Title: QA EngineerLevel: Mid-LevelLocation: Hyderabad, Telangana.Hire Type: Full TimeStart Date: ImmediateMinimum 3+ years of QA experience in data projects.Collaborate with the Development/Business teams to understand the requirements.Analyzing Business Requirements/cases and developing/managing the positive/negative test scenarios cases.Ability to...

  • Tableau Developer

    1 week ago


    delhi, India The Data Family Full time

    Company DescriptionThe Data Family offers analytics and data visualization services designed to transform data into actionable insights for our clients. Through our service, customers can access expert analytics, robust data engineering, and captivating visualizations to drive better decision-making and uncover opportunities for growth.Our primary customers...


  • Delhi, Delhi, India NTT DATA Services Full time

    Req ID:273690NTT DATA Services is looking for a Digital Engineering Sr. Engineer to join their team in Delhi, India.Responsibilities: Manage and maintain the Appworx/UC4 batch scheduling system Create and modify job schedules as required Monitor job execution and ensure accuracy and timeliness Troubleshoot any issues during job execution Collaborate with...

  • Software Engineer

    2 weeks ago


    Delhi, Delhi, India NTT DATA Full time

    Job DescriptionReq ID:283993NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Software Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Work closely with the...


  • New Delhi, India NTT DATA Full time

    Job DescriptionReq ID:273690NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India...


  • New Delhi, India NTT DATA Full time

    Job DescriptionReq ID:273690NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India...

  • Software Engineer

    2 weeks ago


    Delhi, Delhi, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Software Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Work closely with the Senior...


  • Delhi, India NTT DATA Full time

    Job DescriptionMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineer

    6 days ago


    Delhi, India krtrimaIQ Cognitive Solutions Full time

    Company DescriptionkrtrimaIQ Cognitive Solutions is a technology company specializing in Cognitive Process Automation, Data Engineering, Statistical Analysis and Optimization, Data Science, Natural Language Processing, and Computer Vision. Our expertise allows us to transform organizations into intelligent enterprises.Role DescriptionThis is a full-time...

  • Data Engineer

    2 weeks ago


    Delhi, Delhi, India Aprisity Technologies Full time

    We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals.To succeed in this data engineering position, you should have...


  • New Delhi, India NTT DATA Full time

    Job Description Req ID: 273690 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India...


  • New Delhi, India NTT DATA Full time

    Job Description Req ID: 273690 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India...


  • new delhi, India NTT DATA Full time

    Job Description Req ID:  273690  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India (IN)....