Data Engineer

2 weeks ago


Chennai, India Gainwell Technologies LLC Full time
Summary

We’re looking for a dynamic data engineer with Apache Spark and AWS experience to join the data analytics team at Gainwell Technologies. You will have the opportunity to work as part of a cross-functional team to define, design and deploy frameworks for data collection, normalization, transformation, storage and reporting on AWS to support the analytic missions of Gainwell and its clients.  

 

Your role in our mission

Essential Job Functions

 

•    Design, develop and deploy data pipelines including ETL-processes for getting, processing and delivering data using Apache Spark Framework.
•    Monitor, manage, validate and test data extraction, movement, transformation, loading, normalization, cleansing and updating processes. Build complex databases that are useful, accessible, safe and secure.
•    Coordinates with users to understand data needs and delivery of data with a focus on data quality, data reuse, consistency, security, and regulatory compliance.
•    Collaborate with team-members on data models and schemas in our data warehouse.
•    Collaborate with team-members on documenting source-to-target mapping.
•    Conceptualize and visualize data frameworks
•    Communicate effectively with various internal and external stakeholders.

What we're looking for

 

•    Bachelor's degree in computer sciences or related field
•    Total experience needed is 14+ years and 7+ years experince in ETL Processing/data architecture or equivalent.
•    5+ years of experience working with big data technologies on AWS/Azure/GCP
•    7+ years of experience in the Apache Spark/DataBricks framework (Python/Scala)
•    Experience working with different between database structures (e.g., transaction based vs. data warehouse)
•    Databricks and AWS developer/architect certifications a big plus

What you should expect in this role

 

Fast-paced,challenging and rewarding work environment.
Hybrid Office environment.
Will require late evening work to overlap US work hours.



  • Chennai/Coimbatore, India Wavicle data solutions Full time

    Job Description :- We are seeking a highly experienced Senior and Lead Data Engineer with over 6 years of expertise in data engineering.- As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.- Your proficiency in Python, PySpark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for...


  • Chennai, India Planners and Engineer Full time

    Requirement for Auto cad those have knownledge in Pre DCR ONLINE DRAWING WORKING DRAWING & CMDA APPROVAL DRAWING & LAYOUT BASED COMBINED DRAWING. - Should have excellent communication skills - Ability to work independently with little supervision as well as the ability to work within a team. - Excellent multi-tasking skills - Self-motivated with strong team...


  • Chennai, India Planners and Engineer Full time

    Requirement for Auto cad those have knownledge in Pre DCR ONLINE DRAWING WORKING DRAWING & CMDA APPROVAL DRAWING & LAYOUT BASED COMBINED DRAWING. - Should have excellent communication skills - Ability to work independently with little supervision as well as the ability to work within a team. - Excellent multi-tasking skills - Self-motivated with strong team...

  • Data Engineer

    3 weeks ago


    Chennai, India Encora Inc. Full time

    Description hereLead Data EngineerJD :Qualifications5 to 10 years of hands-on Big Data Engineering experienceExcellent communication and collaboration skillsDemonstrated strong leadership skills in leading a teamKey responsibilities include: ·Create and maintain data pipelines to transform and load data from data lake into Datawarehouse modelsImplement...

  • Data Engineer

    4 weeks ago


    Chennai, India Encora Inc. Full time

    Description here Lead Data Engineer  JD :  Qualifications 5 to 10 years of hands-on Big Data Engineering experience Excellent communication and collaboration skills Demonstrated strong leadership skills in leading a team Key responsibilities include: ·  Create and maintain data pipelines to transform and load data from data lake into...

  • Data Engineer

    4 weeks ago


    chennai, India Encora Inc. Full time

    Description here Lead Data Engineer  JD :  Qualifications 5 to 10 years of hands-on Big Data Engineering experience Excellent communication and collaboration skills Demonstrated strong leadership skills in leading a team Key responsibilities include: ·  Create and maintain data pipelines to transform and load data from...

  • Data Engineer

    6 days ago


    Chennai, India Ford Motor Company Full time

    This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams.Data engineers will work in small, cross-functional teams. They...

  • Data Engineer

    2 weeks ago


    Chennai, India HTC Global Services Full time

    Position Description:• This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. • Data engineers will work in small,...

  • Data Engineer

    1 week ago


    Chennai, India Ford Motor Company Full time

    This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. Data engineers will work in small, cross-functional teams....

  • Data Engineer

    7 days ago


    chennai, India Ford Motor Company Full time

    This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. Data engineers will work in small, cross-functional teams....

  • Data Engineer

    3 weeks ago


    Chennai, India HTC Global Services Full time

    Position Description:• This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. • Data engineers will work in small,...

  • Data Engineer

    3 weeks ago


    Chennai, India HTC Global Services Full time

    Position Description:• This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. • Data engineers will work in small,...

  • Data Engineer

    2 days ago


    Chennai, India BU Soft Tech Full time

    Experience - 3 to 4 yrs as Data EngineerTech Stack - Python, Pyspark, SQL, AWS &Bachelor's degree in Computer Science, Engineering, or related field.Excellent written and verbal communication skills.Location - ChennaiRole DescriptionThis is a full-time on-site role for a Data Engineer at BU Soft Tech in Chennai. As a Data Engineer, you will be responsible...

  • Data Engineer

    13 hours ago


    Chennai, India BU Soft Tech Full time

    Experience - 3 to 4 yrs as Data EngineerTech Stack - Python, Pyspark, SQL, AWS &Bachelor's degree in Computer Science, Engineering, or related field.Excellent written and verbal communication skills.Location - ChennaiRole DescriptionThis is a full-time on-site role for a Data Engineer at BU Soft Tech in Chennai. As a Data Engineer, you will be responsible...

  • Data Engineer

    2 days ago


    chennai, India BU Soft Tech Full time

    Experience - 3 to 4 yrs as Data Engineer Tech Stack - Python, Pyspark, SQL, AWS & Bachelor's degree in Computer Science, Engineering, or related field. Excellent written and verbal communication skills. Location - Chennai Role Description This is a full-time on-site role for a Data Engineer at BU Soft Tech in Chennai. As a Data Engineer, you will be...

  • Data Engineer

    17 hours ago


    Chennai, India Virtusa Full time

    Data Engineer - CREQ174726 Description Skill: Data Engineer Role/Tier- Lead Software Engineer/T2 Location :Chennai /Hyderabad/Pune/Bangalore Shift Timings : 1-10 PM IST Job Description: Design, implement, and maintain the data architecture for all AWS data services Work with stakeholders to identify business needs and requirements for...

  • Data Engineer

    16 hours ago


    Chennai, India Aspire Systems Full time

    Data Engineer (Google Cloud Platform)Exp: 5 - 9 YearsLocation: Chennai / BengaluruNotice Period: Immediate - 30 DaysRequirementsFluency in SQL, Shell and PythonKnowledge of building and maintaining data pipelines (e.g. Airflow, Control-M, Autosys)Experience in big data technologies (Hadoop, Google BigQuery or similar) Experience in Cloud technologies...

  • Data Engineer

    4 weeks ago


    Chennai, India Movate Full time

    Role: Azure Data Engineer/ScientistLocation: India (Chennai, Bangalore, Hyderabad)Years of Experience : 5 – 7 YearsWork Mode : Work From OfficeResponsibilities:and analyze data on Azure using services like Azure Data Lake and Azure Synapse Analytics.insights and provide data-driven recommendations.predictive and prescriptive models using tools fromdata...

  • Data Engineer

    3 weeks ago


    Chennai, India Nityo Infotech Full time

    Data Engineering- A/SA Relevant Experience in DE:- 5+ years -More than 6 years IT experience-Azure cloud experience is mandatory-ADF, Databricks, Azure DE/ML cloud work experience is mandatory-Good experience on Pyspark and Python-atleast worked 4-5 Data engineering use cases-should good understanding of DE concepts-Candidate should be excellent in...

  • Data Engineer

    4 weeks ago


    Chennai, India HTC Global Services Full time

    Data Engineer with GCP3+ yrs ExperienceJob location : ChennaiTechnical Skills : GCP -Big Query, Python, Data Flow or Pub-subplease share resume to Kindly share below detailsCCTCECTCExperienceCurrent LocationSkills