Data Engineer
2 weeks ago
We’re looking for a dynamic data engineer with Apache Spark and AWS experience to join the data analytics team at Gainwell Technologies. You will have the opportunity to work as part of a cross-functional team to define, design and deploy frameworks for data collection, normalization, transformation, storage and reporting on AWS to support the analytic missions of Gainwell and its clients.
Your role in our mission
Essential Job Functions
• Design, develop and deploy data pipelines including ETL-processes for getting, processing and delivering data using Apache Spark Framework.
• Monitor, manage, validate and test data extraction, movement, transformation, loading, normalization, cleansing and updating processes. Build complex databases that are useful, accessible, safe and secure.
• Coordinates with users to understand data needs and delivery of data with a focus on data quality, data reuse, consistency, security, and regulatory compliance.
• Collaborate with team-members on data models and schemas in our data warehouse.
• Collaborate with team-members on documenting source-to-target mapping.
• Conceptualize and visualize data frameworks
• Communicate effectively with various internal and external stakeholders.
• Bachelor's degree in computer sciences or related field
• Total experience needed is 14+ years and 7+ years experince in ETL Processing/data architecture or equivalent.
• 5+ years of experience working with big data technologies on AWS/Azure/GCP
• 7+ years of experience in the Apache Spark/DataBricks framework (Python/Scala)
• Experience working with different between database structures (e.g., transaction based vs. data warehouse)
• Databricks and AWS developer/architect certifications a big plus
Fast-paced,challenging and rewarding work environment.
Hybrid Office environment.
Will require late evening work to overlap US work hours.
-
Wavicle Data Solutions
2 weeks ago
Chennai/Coimbatore, India Wavicle data solutions Full timeJob Description :- We are seeking a highly experienced Senior and Lead Data Engineer with over 6 years of expertise in data engineering.- As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.- Your proficiency in Python, PySpark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for...
-
Autocad Draughtsman/woman
5 days ago
Chennai, India Planners and Engineer Full timeRequirement for Auto cad those have knownledge in Pre DCR ONLINE DRAWING WORKING DRAWING & CMDA APPROVAL DRAWING & LAYOUT BASED COMBINED DRAWING. - Should have excellent communication skills - Ability to work independently with little supervision as well as the ability to work within a team. - Excellent multi-tasking skills - Self-motivated with strong team...
-
Autocad Draughtsman/woman
5 days ago
Chennai, India Planners and Engineer Full timeRequirement for Auto cad those have knownledge in Pre DCR ONLINE DRAWING WORKING DRAWING & CMDA APPROVAL DRAWING & LAYOUT BASED COMBINED DRAWING. - Should have excellent communication skills - Ability to work independently with little supervision as well as the ability to work within a team. - Excellent multi-tasking skills - Self-motivated with strong team...
-
Data Engineer
3 weeks ago
Chennai, India Encora Inc. Full timeDescription hereLead Data EngineerJD :Qualifications5 to 10 years of hands-on Big Data Engineering experienceExcellent communication and collaboration skillsDemonstrated strong leadership skills in leading a teamKey responsibilities include: ·Create and maintain data pipelines to transform and load data from data lake into Datawarehouse modelsImplement...
-
Data Engineer
4 weeks ago
Chennai, India Encora Inc. Full timeDescription here Lead Data Engineer JD : Qualifications 5 to 10 years of hands-on Big Data Engineering experience Excellent communication and collaboration skills Demonstrated strong leadership skills in leading a team Key responsibilities include: · Create and maintain data pipelines to transform and load data from data lake into...
-
Data Engineer
4 weeks ago
chennai, India Encora Inc. Full timeDescription here Lead Data Engineer JD : Qualifications 5 to 10 years of hands-on Big Data Engineering experience Excellent communication and collaboration skills Demonstrated strong leadership skills in leading a team Key responsibilities include: · Create and maintain data pipelines to transform and load data from...
-
Data Engineer
6 days ago
Chennai, India Ford Motor Company Full timeThis role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams.Data engineers will work in small, cross-functional teams. They...
-
Data Engineer
2 weeks ago
Chennai, India HTC Global Services Full timePosition Description:• This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. • Data engineers will work in small,...
-
Data Engineer
1 week ago
Chennai, India Ford Motor Company Full timeThis role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. Data engineers will work in small, cross-functional teams....
-
Data Engineer
7 days ago
chennai, India Ford Motor Company Full timeThis role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. Data engineers will work in small, cross-functional teams....
-
Data Engineer
3 weeks ago
Chennai, India HTC Global Services Full timePosition Description:• This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. • Data engineers will work in small,...
-
Data Engineer
3 weeks ago
Chennai, India HTC Global Services Full timePosition Description:• This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. • Data engineers will work in small,...
-
Data Engineer
2 days ago
Chennai, India BU Soft Tech Full timeExperience - 3 to 4 yrs as Data EngineerTech Stack - Python, Pyspark, SQL, AWS &Bachelor's degree in Computer Science, Engineering, or related field.Excellent written and verbal communication skills.Location - ChennaiRole DescriptionThis is a full-time on-site role for a Data Engineer at BU Soft Tech in Chennai. As a Data Engineer, you will be responsible...
-
Data Engineer
13 hours ago
Chennai, India BU Soft Tech Full timeExperience - 3 to 4 yrs as Data EngineerTech Stack - Python, Pyspark, SQL, AWS &Bachelor's degree in Computer Science, Engineering, or related field.Excellent written and verbal communication skills.Location - ChennaiRole DescriptionThis is a full-time on-site role for a Data Engineer at BU Soft Tech in Chennai. As a Data Engineer, you will be responsible...
-
Data Engineer
2 days ago
chennai, India BU Soft Tech Full timeExperience - 3 to 4 yrs as Data Engineer Tech Stack - Python, Pyspark, SQL, AWS & Bachelor's degree in Computer Science, Engineering, or related field. Excellent written and verbal communication skills. Location - Chennai Role Description This is a full-time on-site role for a Data Engineer at BU Soft Tech in Chennai. As a Data Engineer, you will be...
-
Data Engineer
17 hours ago
Chennai, India Virtusa Full timeData Engineer - CREQ174726 Description Skill: Data Engineer Role/Tier- Lead Software Engineer/T2 Location :Chennai /Hyderabad/Pune/Bangalore Shift Timings : 1-10 PM IST Job Description: Design, implement, and maintain the data architecture for all AWS data services Work with stakeholders to identify business needs and requirements for...
-
Data Engineer
16 hours ago
Chennai, India Aspire Systems Full timeData Engineer (Google Cloud Platform)Exp: 5 - 9 YearsLocation: Chennai / BengaluruNotice Period: Immediate - 30 DaysRequirementsFluency in SQL, Shell and PythonKnowledge of building and maintaining data pipelines (e.g. Airflow, Control-M, Autosys)Experience in big data technologies (Hadoop, Google BigQuery or similar) Experience in Cloud technologies...
-
Data Engineer
4 weeks ago
Chennai, India Movate Full timeRole: Azure Data Engineer/ScientistLocation: India (Chennai, Bangalore, Hyderabad)Years of Experience : 5 – 7 YearsWork Mode : Work From OfficeResponsibilities:and analyze data on Azure using services like Azure Data Lake and Azure Synapse Analytics.insights and provide data-driven recommendations.predictive and prescriptive models using tools fromdata...
-
Data Engineer
3 weeks ago
Chennai, India Nityo Infotech Full timeData Engineering- A/SA Relevant Experience in DE:- 5+ years -More than 6 years IT experience-Azure cloud experience is mandatory-ADF, Databricks, Azure DE/ML cloud work experience is mandatory-Good experience on Pyspark and Python-atleast worked 4-5 Data engineering use cases-should good understanding of DE concepts-Candidate should be excellent in...
-
Data Engineer
4 weeks ago
Chennai, India HTC Global Services Full timeData Engineer with GCP3+ yrs ExperienceJob location : ChennaiTechnical Skills : GCP -Big Query, Python, Data Flow or Pub-subplease share resume to Kindly share below detailsCCTCECTCExperienceCurrent LocationSkills