Data Engineer

7 days ago


Sany, India TalentPulse Consultant Full time
Overview:The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to understand the organizations data needs and helpdesign and develop data pipelines and infrastructure to enable thedata science team to create scalable and reliable data products.This position is essential for ensuring that our data is accessibleand reliable for analysis.KeyResponsibilities:
  • Develop constructtest and maintain data architectures such as databases andlargescale processing systems
  • Design andmaintain scalable data pipelines for data integration andtransformation
  • Create and maintain optimal datapipeline architecture
  • Identify design andimplement internal process improvements: automating manualprocesses optimizing data delivery redesigning infrastructure forgreater scalability etc.
  • Collaborate with datascientists and other team members on datarelatedprojects
  • Build the infrastructure required foroptimal extraction transformation and loading of data from a widevariety of data sources using SQL and big datatechnologies
  • Work with stakeholders includingthe Executive Product Data and Design teams to assist withdatarelated technical issues and support their data infrastructureneeds
  • Keep our data separated and secure acrossnational boundaries through multiple data centers and cloudproviders
  • Create data tools for analytics anddata scientist team members that assist them in building andoptimizing our product into an innovative industryleader
  • Provide support to the data science teamin the development and deployment of machine learningmodels
  • Work towards reducing data redundancyand maintaining data integrity
  • Troubleshootdatarelated problems and author technicaldocumentation
  • Stay current with industry bestpractices and emerging technologies and recommend when and wherethey can be implemented
  • Ensure data quality andintegrity and performance of our datasystems
  • Proactively monitoring and improvingsystem performance anddependability
RequiredQualifications:
  • Bachelors or Mastersdegree in Computer Science Information Technology or a relatedfield
  • Proven experience as a Data Engineer orin a similar role
  • Experience with relationalSQL and NoSQL databases
  • Experience with ETLtools
  • Experience with big data tools such asHadoop Spark etc.
  • Experience with cloudplatforms such as AWS Azure or GoogleCloud
  • Experience with data modeling datawarehousing and building ETL pipelines
  • Strongprogramming skills in languages such as Python Java orScala
  • Experience with data visualization toolslike Tableau Power BI etc.
  • Ability to work in ateam and possess strong problemsolvingskills
  • Excellent communication andcollaboration skills
  • A strong understanding ofdata privacy and security concerns
  • Experiencein implementing machine learning models will be aplus
  • Ability to conduct performance tuning andtroubleshooting of data systems
  • Continuouslearning and staying updated with the latest technologies and toolsin the industry

python,sql,datamodeling,etl,big data,data warehousing,datavisualization


  • Data Engineer

    2 months ago


    Sany, India BTOSC Infotech Full time

    We are looking for an experienced dataengineer to join our team. You will use various methods totransform raw data into useful data systems. For example you llcreate algorithms and conduct statistical analysis. Overall you llstrive for efficiency by aligning data systems with business goals. To succeed in this data engineering positionyou should have strong...

  • Data Engineer

    6 days ago


    sany, India Informica Full time

    Job Description Experience Required: 48 yrs. Knowledge on Data Modelling Data warehouse andData Analysis is also required. Immediate requirement: 1520 days joineronly. Data Engineer Key Skills: Azure Data Factory Pyspark T/SQLPL/SQL Exposure on other ETL Tools like SSIS DatabricksLooker Data Engineering Create and maintain optimal datapipeline...

  • Data Engineer

    7 days ago


    Sany, India Kenan Management Consultants Pvt Ltd Full time

    Job Title: Data EngineerExperience: Minimum 4-5 years of experience in Development in Informatica Big Data Management/ DEI & Informatica Power CenterSkills Required: ETL, SQL, Scoop, Spark, Hive, Hadoop, KAFKAPreferred: Knowledge of PySparkEducation: Bachelors degree in Computer Science or equivalent; Masters preferredMain Duties & Responsibilities:Building...

  • Data Engineer

    7 days ago


    Sany, India Bitcoin Devs Company Full time

    Overview:TheData Engineer Lead plays a crucial role in our organization workingremotely to design develop and maintain scalable data pipelines andinfrastructures for our data platforms. This position is vital inensuring the efficiency reliability and quality of our datasolutions enabling our teams to make informed decisions and drivebusinessgrowth.TheData...

  • Data engineer

    6 days ago


    Sany, India HR Aspiration Full time

    Senior Data EngineerExpreine : 3 10Years WorkLocation :BangaloreMandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServerMust HaveExperience:6 yearsof handson data engineeringexperienceExpertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDBBuildingbatch and realtime data pipelinesPython SQLcoding for data processing...

  • Data Engineer

    2 months ago


    Sany, India TalentPulse Consultant Full time

    Overview:The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Data Engineer

    7 days ago


    Sany, India NewPage Solution Inc Full time

    Who Are We NewPage is a digital health solutions company. Wedevote ourselves to advancing the quality of life by enhancing thehealth and optimizing the longevity of people. We do this bypassionately building futuristic technologies for globalorganizations across the healthcare ecosystem. We partake at everystage from problem definition strategy & service...

  • Data Engineer

    5 days ago


    Sany, India NewPage Solution Inc Full time

    Who Are We NewPage is a digital health solutions company. Wedevote ourselves to advancing the quality of life by enhancing thehealth and optimizing the longevity of people. We do this bypassionately building futuristic technologies for globalorganizations across the healthcare ecosystem. We partake at everystage from problem definition strategy & service...

  • Data Engineer

    7 days ago


    sany, India Informica Full time

    Data EngineerTide Experience5 to 8 Years Number of Position(s) 5 MandatorySkills SQL Distributed ETLData Pipeline Building Data modeling Snowflake JobDescription LocationGurgram/Bangalore MANDATORY SKILLSET Team Management SQL ExpertDistributed ETL Data Pipeline Building Data Modeling KPIs Knowledgeof Snowflake As part of theteam you will be...


  • sany, India Agilite Global Solutions Company Full time

    Role: Snowflakes Data Engineer Location: India (Remote Work) Minimum Qualification: Bachelor's degree or higher in the technology field Experience: 3+ years Domain: US Healthcare Customer Profile: Captive research and development pods for a 500-million-member group of pharma data research companies that assist patients in accessing life-saving...

  • Data Engineer

    3 weeks ago


    Sany, India Kenan Management Consultants Pvt Ltd Full time

    Job Description Therole requires data ingestion processing and extraction of data to& from Hadoop Cluster only using Informatica BDM. Itrequires extensive experience in ETL SQL Scoop Spark Hive Hadoop& KAFKA. Knowledge of PySpark will bepreferable Job Title DataEngineer Experience Minimum 45 years ofExperience in Development in Informatica Big...


  • sany, India eTek IT Services, Inc. Full time

    Role : DataEngineer Location: CincinnatiOhio Experience:5years W2Contract JobDescriptionJobOverview: Weare seeking a skilled Data Engineer with a strong background inmortgage banking to join our IT team. The candidate will beinstrumental in constructing testing and maintaining our mortgagebanking data architecture. This includes optimizing data flow...

  • Python Data Engineer

    1 month ago


    Sany, India SAM Manpower and Career Services LLP Full time

    Role: Python DataEngineer/DeveloperExp: 3 YearsRelevantLocation: PANIndiaPositions: 1Budget: 15LPANotice: Immediate joinersonlyJD:KeyResponsibilities: Lead the development andmaintenance of our Pythonbased data processing and analyticsinfrastructure. Design and implement robust ETLprocesses integrating data from diverse sources.Develop manage and optimize...

  • Python Data Engineer

    3 weeks ago


    sany, India SAM Manpower and Career Services LLP Full time

    Role: Python DataEngineer/Developer Exp: 3 YearsRelevant Location: PANIndia Positions: 1 Budget: 15LPA Notice: Immediate joinersonly JD: KeyResponsibilities: Lead the development andmaintenance of our Pythonbased data processing and analyticsinfrastructure. Design and implement robust ETLprocesses integrating data from diverse sources. Develop manage and...


  • Sany, India BigShyft Full time

    AboutCompany:Our client is aninnovative startup that specializes in data infrastructuresolutions. With a focus on automation and reliability they empowerorganizations to harness the power of their data effectively.Recently acquired their team is expanding and they are seekingtalented individuals to join us in ourmission.JobDescription:As a DatabricksData...

  • AWS Data Engineer

    2 months ago


    Sany, India TalentPulse Consultant Full time

    Overview:The AWS DataEngineer plays a crucial role in our organization by designing andimplementing scalable reliable and secure data solutions in the AWScloud environment. They are responsible for developing andmaintaining data pipelines optimizing data workflows and ensuringthe quality and integrity of our data. This position is essentialfor leveraging...

  • AWS Data Engineer

    3 weeks ago


    Sany, India TalentPulse Consultant Full time

    Overview:The AWS DataEngineer plays a crucial role in our organization by designing andimplementing scalable reliable and secure data solutions in the AWScloud environment. They are responsible for developing andmaintaining data pipelines optimizing data workflows and ensuringthe quality and integrity of our data. This position is essentialfor leveraging...


  • Sany, India eTek IT Services, Inc. Full time

    Role :DataEngineerLocation: CincinnatiOhioExperience:5yearsW2ContractJobDescriptionJobOverview:Weare seeking a skilled Data Engineer with a strong background inmortgage banking to join our IT team. The candidate will beinstrumental in constructing testing and maintaining our mortgagebanking data architecture. This includes optimizing data flow andcollection...


  • Sany, India eTek IT Services, Inc. Full time

    Role :DataEngineerLocation: CincinnatiOhioExperience:5yearsW2ContractJobDescriptionJobOverview:Weare seeking a skilled Data Engineer with a strong background inmortgage banking to join our IT team. The candidate will beinstrumental in constructing testing and maintaining our mortgagebanking data architecture. This includes optimizing data flow andcollection...


  • Sany, India Tekwissen India Full time

    Overview TekWissen Group isa workforce management provider operating throughout India andseveral other countries worldwide. The client below is a leadingtechnology company offering a range of IT solutions to businessesand organizations enabling them to transform their digital futures Position: ConsultantData Engineering Location: Bangalore ...