Data Engineer AWS2

3 days ago


Sany, India TCP Corps Full time
Required Experience AWS ETL Data ModellingData Integration Data Manipulation GITHUB Azure Devops DatabrickGood to havepytest
Weare seeking a highly skilled AWS Data Engineer to join our dynamicteam. As an AWS Data Engineer you will be responsible for designingbuilding and maintaining data pipelines and ETL processes on theAWS platform. In addition to your technical expertise we valueindividuals who are enthusiastic about contributing to communitybuilding initiatives such as Centers of Excellence (CoE) andCommunities of Practice(CoP).Responsibilities:
  1. AWSData Solutions Development: Design develop andimplement robust data solutions on AWS leveraging services such asAmazon Redshift Amazon S3 AWS Glue AWS Lambda and others. Ensurescalability reliability and performance of data pipelines and ETLprocesses.
  2. Data Modeling andOptimization: Develop and maintain data modelsschemas and data warehouses to support analytical and reportingneeds. Optimize data structures and queries for efficient dataretrieval and processing.
  3. DataIntegration and Transformation: Implement dataintegration solutions to consolidate data from various sourcesensuring consistency and accuracy. Perform data manipulation andtransformation as required to meet businessrequirements.
  4. Version Control andCollaboration: Utilize version control systems likeGitHub and collaboration tools like Azure DevOps to manage codebaseand facilitate team collaboration. Contribute to code reviews andensure adherence to coding standards and bestpractices.
  5. Cloud DataPlatforms: Experience with cloudbased data platformssuch as Databricks is highly desirable. Familiarity with AzureDevOps for CI/CD pipelines and automation tasks is aplus.
  6. Documentation and KnowledgeSharing: Document data engineering processesworkflows and best practices. Contribute to knowledge sharinginitiatives like CoE and CoP by sharing insights presentingfindings and participating in discussions related to dataengineering and AWS.
  7. Testing andQuality Assurance: Good to have experience withtesting frameworks like pytest for implementing automated tests toensure the reliability and quality of datasolutions.
Qualifications:
  • Bachelorsdegree in Computer Science Engineering or a relatedfield.
  • years of experience as a Data Engineerwith a strong focus on AWStechnologies.
  • Proficiency in ETL (ExtractTransform Load) processes data modeling and data integrationtechniques.
  • Handson experience with AWSservices such as Amazon Redshift Amazon S3 AWS Glue AWS Lambdaetc.
  • Experience with data manipulation usingSQL and other relevant languages ortools.
  • Familiarity with version control systemslike GitHub and collaboration tools like AzureDevOps.
  • Experience with cloudbased dataplatforms such as Databricks is a plus.
  • Good tohave experience with testing frameworks like pytest forimplementing automated tests.
  • Strongproblemsolving skills and attention todetail.
  • Excellent communication andcollaboration skills.
Join us inour mission to harness the power of data on the AWS platform whilealso contributing to community building initiatives that promoteknowledge sharing and collaboration across the organization. If youare passionate about data engineering and AWS and enjoy working ina collaborative and innovative environment we encourage you toapply

datamodelling,etl,github,aws,data manipulation,pytest,dataintegration,azure devops,datamodeling,databrick


  • Data Engineer

    2 months ago


    Sany, India BTOSC Infotech Full time

    We are looking for an experienced dataengineer to join our team. You will use various methods totransform raw data into useful data systems. For example you llcreate algorithms and conduct statistical analysis. Overall you llstrive for efficiency by aligning data systems with business goals. To succeed in this data engineering positionyou should have strong...

  • Data Engineer

    2 weeks ago


    sany, India Informica Full time

    Job Description Experience Required: 48 yrs. Knowledge on Data Modelling Data warehouse andData Analysis is also required. Immediate requirement: 1520 days joineronly. Data Engineer Key Skills: Azure Data Factory Pyspark T/SQLPL/SQL Exposure on other ETL Tools like SSIS DatabricksLooker Data Engineering Create and maintain optimal datapipeline...

  • Data Engineer

    2 weeks ago


    Sany, India Kenan Management Consultants Pvt Ltd Full time

    Job Title: Data EngineerExperience: Minimum 4-5 years of experience in Development in Informatica Big Data Management/ DEI & Informatica Power CenterSkills Required: ETL, SQL, Scoop, Spark, Hive, Hadoop, KAFKAPreferred: Knowledge of PySparkEducation: Bachelors degree in Computer Science or equivalent; Masters preferredMain Duties & Responsibilities:Building...

  • Data Engineer

    2 weeks ago


    Sany, India Bitcoin Devs Company Full time

    Overview:TheData Engineer Lead plays a crucial role in our organization workingremotely to design develop and maintain scalable data pipelines andinfrastructures for our data platforms. This position is vital inensuring the efficiency reliability and quality of our datasolutions enabling our teams to make informed decisions and drivebusinessgrowth.TheData...

  • Data engineer

    2 weeks ago


    Sany, India HR Aspiration Full time

    Senior Data EngineerExpreine : 3 10Years WorkLocation :BangaloreMandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServerMust HaveExperience:6 yearsof handson data engineeringexperienceExpertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDBBuildingbatch and realtime data pipelinesPython SQLcoding for data processing...

  • Data Engineer

    3 months ago


    Sany, India TalentPulse Consultant Full time

    Overview:The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Data Engineer

    2 weeks ago


    Sany, India TalentPulse Consultant Full time

    Overview:The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Data Engineer

    2 weeks ago


    Sany, India NewPage Solution Inc Full time

    Who Are We NewPage is a digital health solutions company. Wedevote ourselves to advancing the quality of life by enhancing thehealth and optimizing the longevity of people. We do this bypassionately building futuristic technologies for globalorganizations across the healthcare ecosystem. We partake at everystage from problem definition strategy & service...

  • Data Engineer

    1 week ago


    Sany, India NewPage Solution Inc Full time

    Who Are We NewPage is a digital health solutions company. Wedevote ourselves to advancing the quality of life by enhancing thehealth and optimizing the longevity of people. We do this bypassionately building futuristic technologies for globalorganizations across the healthcare ecosystem. We partake at everystage from problem definition strategy & service...

  • Data Engineer

    2 weeks ago


    sany, India Informica Full time

    Data EngineerTide Experience5 to 8 Years Number of Position(s) 5 MandatorySkills SQL Distributed ETLData Pipeline Building Data modeling Snowflake JobDescription LocationGurgram/Bangalore MANDATORY SKILLSET Team Management SQL ExpertDistributed ETL Data Pipeline Building Data Modeling KPIs Knowledgeof Snowflake As part of theteam you will be...


  • Sany, India TCP Corps Full time

    Required Skills Python Pyspark Azure DataFactory SQL DataModellingOverview:TheData Engineer (Azure) plays a crucial role in our organizationresponsible for designing developing and maintaining scalable datapipelines for data ingestion transformation and storage on Azurecloud platform. This position is pivotal in ensuring the efficiencyand reliability of data...


  • sany, India Agilite Global Solutions Company Full time

    Role: Snowflakes Data Engineer Location: India (Remote Work) Minimum Qualification: Bachelor's degree or higher in the technology field Experience: 3+ years Domain: US Healthcare Customer Profile: Captive research and development pods for a 500-million-member group of pharma data research companies that assist patients in accessing life-saving...

  • Data Engineer

    3 weeks ago


    Sany, India Kenan Management Consultants Pvt Ltd Full time

    Job Description Therole requires data ingestion processing and extraction of data to& from Hadoop Cluster only using Informatica BDM. Itrequires extensive experience in ETL SQL Scoop Spark Hive Hadoop& KAFKA. Knowledge of PySpark will bepreferable Job Title DataEngineer Experience Minimum 45 years ofExperience in Development in Informatica Big...


  • sany, India eTek IT Services, Inc. Full time

    Role : DataEngineer Location: CincinnatiOhio Experience:5years W2Contract JobDescriptionJobOverview: Weare seeking a skilled Data Engineer with a strong background inmortgage banking to join our IT team. The candidate will beinstrumental in constructing testing and maintaining our mortgagebanking data architecture. This includes optimizing data flow...

  • Python Data Engineer

    4 weeks ago


    sany, India SAM Manpower and Career Services LLP Full time

    Role: Python DataEngineer/Developer Exp: 3 YearsRelevant Location: PANIndia Positions: 1 Budget: 15LPA Notice: Immediate joinersonly JD: KeyResponsibilities: Lead the development andmaintenance of our Pythonbased data processing and analyticsinfrastructure. Design and implement robust ETLprocesses integrating data from diverse sources. Develop manage and...


  • Sany, India SAM Manpower and Career Services LLP Full time

    Role: Python DataEngineer/DeveloperExp: 3 YearsRelevantLocation: PANIndiaPositions: 1Budget: 15LPANotice: Immediate joinersonlyJD:KeyResponsibilities: Lead the development andmaintenance of our Pythonbased data processing and analyticsinfrastructure. Design and implement robust ETLprocesses integrating data from diverse sources.Develop manage and optimize...


  • Sany, India BigShyft Full time

    AboutCompany:Our client is aninnovative startup that specializes in data infrastructuresolutions. With a focus on automation and reliability they empowerorganizations to harness the power of their data effectively.Recently acquired their team is expanding and they are seekingtalented individuals to join us in ourmission.JobDescription:As a DatabricksData...

  • Data Engineer

    3 days ago


    Sany, India Overture Rede Private Limited Full time

    DataEngineer. KeySkills: Azure Data Factory Pyspark T/SQLPL/SQL Exposure on other ETL Tools like SSIS Databricks DataEngineering Create and maintain optimal data pipelinearchitecture Design and develop Data Warehouse solutions Assemble large complex data sets that meet functional /nonfunctional business requirements. Identify designand implement internal...

  • Data Engineer AWS1

    24 hours ago


    Sany, India TCP Corps Full time

    Contributes to community buildinginitiatives like CoECoPResponsibilities:Designand Develop Data Solutions: Architect build andoptimize data pipelines and ETL processes on AWS using serviceslike Amazon Redshift Amazon RDS AWS Glue and AWS Lambda.Collaborate with crossfunctional teams to understand datarequirements and translate them into...

  • AWS Data Engineer

    4 weeks ago


    Sany, India TalentPulse Consultant Full time

    Overview:The AWS DataEngineer plays a crucial role in our organization by designing andimplementing scalable reliable and secure data solutions in the AWScloud environment. They are responsible for developing andmaintaining data pipelines optimizing data workflows and ensuringthe quality and integrity of our data. This position is essentialfor leveraging...