Data Engineer

2 weeks ago


Sany, India Kenan Management Consultants Pvt Ltd Full time
Job Description Therole requires data ingestion processing and extraction of data to& from Hadoop Cluster only
using Informatica BDM. Itrequires extensive experience in ETL SQL Scoop Spark Hive Hadoop&
KAFKA. Knowledge of PySpark will bepreferable Job Title DataEngineer Experience Minimum 45 years ofExperience in Development in
Informatica Big DataManagement/ DEI & Informatica Power
Center
Extensive experience in delivering data pipelinesusing
Informatica on Big Data Clusters
Handson experience with extraction of unstructured and semi
structured data using data processor transformation
Knowledge of PySpark will be high preferable
Fullknowledge of designing and creating complex data modelsEducation Skillsets &
Qualifications Bachelors degree in ComputerScience or equivalent; Masters
preferredProgramming
Solid programming skills in SQL
Deep Knowledge in data architecture designing workflows
building ingestion framework
Expertise of working onEnterprise Big data distribution like
Cloudera. Exposureto big data components HDFS HIVEQL
Spark HBase Impala isessential Main Duties & ResponsibilitiesBuilding and optimizing data pipelines architectures and datasets;
both batchoriented and real time using InformaticaBDM from
both relational & non relationalDBs
Design develop and customize mappings/workflows fordifferent
types of loads using InformaticaBDM
Leverage various transformations in Informatica BDMtool to work
on data ingestion data profiling & dataquality
Leverage Hadoop ecosystem knowledge to designand develop
capabilities to deliver oursolutions
Support and play a pivotal role as part ofdata engineering team to
build the data lake on Clouderafor Enterprise analytics.
Work hands on with Spark &KAFKA in addition to Informatica
platform
Design recommend best approach suited for data movementfrom
different sources to HDFS
Ensure optimumperformance of the Informatica mappings and
workflow
Work with dynamic cross functional teamsincluding business
Solution architects & Dataengineers
  • Data Engineer

    2 months ago


    Sany, India BTOSC Infotech Full time

    We are looking for an experienced dataengineer to join our team. You will use various methods totransform raw data into useful data systems. For example you llcreate algorithms and conduct statistical analysis. Overall you llstrive for efficiency by aligning data systems with business goals. To succeed in this data engineering positionyou should have strong...

  • Data Engineer

    3 hours ago


    sany, India Informica Full time

    Job Description Experience Required: 48 yrs. Knowledge on Data Modelling Data warehouse andData Analysis is also required. Immediate requirement: 1520 days joineronly. Data Engineer Key Skills: Azure Data Factory Pyspark T/SQLPL/SQL Exposure on other ETL Tools like SSIS DatabricksLooker Data Engineering Create and maintain optimal datapipeline...

  • Data Engineer

    4 hours ago


    Sany, India Kenan Management Consultants Pvt Ltd Full time

    Job Title: Data EngineerExperience: Minimum 4-5 years of experience in Development in Informatica Big Data Management/ DEI & Informatica Power CenterSkills Required: ETL, SQL, Scoop, Spark, Hive, Hadoop, KAFKAPreferred: Knowledge of PySparkEducation: Bachelors degree in Computer Science or equivalent; Masters preferredMain Duties & Responsibilities:Building...

  • Data Engineer

    4 weeks ago


    Sany, India Expedify Full time

    OverviewExpedify.iois looking for an intelligent and detailoriented Data Engineer tojoin our ever expanding team of data engineering and analytics. Thehire will be responsible for building and optimizing our datapipeline architecture optimizing data flow and suggesting the rightset of tooling for thesame.Ourcandidate will be working directly with the senior...

  • Data Engineer

    10 hours ago


    Sany, India Bitcoin Devs Company Full time

    Overview:TheData Engineer Lead plays a crucial role in our organization workingremotely to design develop and maintain scalable data pipelines andinfrastructures for our data platforms. This position is vital inensuring the efficiency reliability and quality of our datasolutions enabling our teams to make informed decisions and drivebusinessgrowth.TheData...

  • Data engineer

    1 month ago


    sany, India HR Aspiration Full time

    Senior Data Engineer Expreine : 3 10Years WorkLocation :Bangalore MandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServer Must HaveExperience: 6 yearsof handson data engineeringexperience Expertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDB Buildingbatch and realtime data pipelines Python SQLcoding for data...

  • Data engineer

    2 hours ago


    Sany, India HR Aspiration Full time

    Senior Data EngineerExpreine : 3 10Years WorkLocation :BangaloreMandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServerMust HaveExperience:6 yearsof handson data engineeringexperienceExpertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDBBuildingbatch and realtime data pipelinesPython SQLcoding for data processing...

  • Data Engineer

    2 months ago


    Sany, India TalentPulse Consultant Full time

    Overview:The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Data Engineer

    11 hours ago


    Sany, India TalentPulse Consultant Full time

    Overview:The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Data Engineer

    2 months ago


    sany, India TalentPulse Consultant Full time

    Overview: The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Data Engineer

    9 hours ago


    Sany, India NewPage Solution Inc Full time

    Who Are We NewPage is a digital health solutions company. Wedevote ourselves to advancing the quality of life by enhancing thehealth and optimizing the longevity of people. We do this bypassionately building futuristic technologies for globalorganizations across the healthcare ecosystem. We partake at everystage from problem definition strategy & service...

  • Data Engineer

    12 hours ago


    sany, India Informica Full time

    Data EngineerTide Experience5 to 8 Years Number of Position(s) 5 MandatorySkills SQL Distributed ETLData Pipeline Building Data modeling Snowflake JobDescription LocationGurgram/Bangalore MANDATORY SKILLSET Team Management SQL ExpertDistributed ETL Data Pipeline Building Data Modeling KPIs Knowledgeof Snowflake As part of theteam you will be...


  • sany, India Agilite Global Solutions Company Full time

    Role: Snowflakes Data Engineer Location: India (Remote Work) Minimum Qualification: Bachelor's degree or higher in the technology field Experience: 3+ years Domain: US Healthcare Customer Profile: Captive research and development pods for a 500-million-member group of pharma data research companies that assist patients in accessing life-saving...

  • Data Engineer

    2 months ago


    sany, India Bista Univarsal Limited Full time

    Overview: The DataEngineer plays a crucial role in our organization by designingdeveloping and maintaining scalable data architecture for ourdataintensive applications. They work closely with data scientistsanalysts and other stakeholders to ensure efficient data flow andutilization across the organization.KeyResponsibilities: Design andimplement scalable...


  • sany, India eTek IT Services, Inc. Full time

    Role : DataEngineer Location: CincinnatiOhio Experience:5years W2Contract JobDescriptionJobOverview: Weare seeking a skilled Data Engineer with a strong background inmortgage banking to join our IT team. The candidate will beinstrumental in constructing testing and maintaining our mortgagebanking data architecture. This includes optimizing data flow...

  • Python Data Engineer

    4 weeks ago


    Sany, India SAM Manpower and Career Services LLP Full time

    Role: Python DataEngineer/DeveloperExp: 3 YearsRelevantLocation: PANIndiaPositions: 1Budget: 15LPANotice: Immediate joinersonlyJD:KeyResponsibilities: Lead the development andmaintenance of our Pythonbased data processing and analyticsinfrastructure. Design and implement robust ETLprocesses integrating data from diverse sources.Develop manage and optimize...

  • Python Data Engineer

    2 weeks ago


    sany, India SAM Manpower and Career Services LLP Full time

    Role: Python DataEngineer/Developer Exp: 3 YearsRelevant Location: PANIndia Positions: 1 Budget: 15LPA Notice: Immediate joinersonly JD: KeyResponsibilities: Lead the development andmaintenance of our Pythonbased data processing and analyticsinfrastructure. Design and implement robust ETLprocesses integrating data from diverse sources. Develop manage and...


  • Sany, India BigShyft Full time

    AboutCompany:Our client is aninnovative startup that specializes in data infrastructuresolutions. With a focus on automation and reliability they empowerorganizations to harness the power of their data effectively.Recently acquired their team is expanding and they are seekingtalented individuals to join us in ourmission.JobDescription:As a DatabricksData...


  • sany, India BigShyft Full time

    AboutCompany: Our client is aninnovative startup that specializes in data infrastructuresolutions. With a focus on automation and reliability they empowerorganizations to harness the power of their data effectively.Recently acquired their team is expanding and they are seekingtalented individuals to join us in ourmission.JobDescription: As a DatabricksData...

  • AWS Data Engineer

    1 month ago


    sany, India TalentPulse Consultant Full time

    Overview: The AWS DataEngineer plays a crucial role in our organization by designing andimplementing scalable reliable and secure data solutions in the AWScloud environment. They are responsible for developing andmaintaining data pipelines optimizing data workflows and ensuringthe quality and integrity of our data. This position is essentialfor leveraging...