Data Engineer

1 month ago

Chennai, India Wenger & Watson Inc Full time

Exp-3+ yrs

Location-Chennai(WFO)

compulsory work from office (1st and last saturday working)

notice period-30-immediate joiner

Job Description

Should have a minimum 6+ years in Data Engineering, Data Analytics platform.

 Should have strong hands-on design and engineering background in AWS, across a wide range of AWS services with the ability to demonstrate working on large engagements.

 Should be involved in Requirements Gathering and transforming them to into Functionally and technical design.  Maintain and optimize the data infrastructure required for accurate extraction, transformation, and loading of data from a wide variety of data sources.

 Design, build and maintain batch or real-time data pipelines in production.  Develop ETL/ELT Data pipeline (extract, transform, load) processes to help extract and manipulate data from multiple sources.  Automate data workflows such as data ingestion, aggregation, and ETL processing and should have good experience with different types of data ingestion techniques: File-based, API-based, streaming data sources (OLTP, OLAP, ODS etc) and heterogeneous databases.  Prepare raw data in Data Warehouses into a consumable dataset for both technical and non-technical stakeholders.  Strong experience and implementation of Data lakes, Data warehousing, Data Lakehousing architectures.  Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.  Monitor data systems performance and implement optimization strategies.  Leverage data controls to maintain data privacy, security, compliance, and quality for allocated areas of ownership.  Experience of AWS tools (AWS S3, EC2, Athena, Redshift, Glue, EMR, Lambda, RDS, Kinesis, DynamoDB, QuickSight etc.).

 Strong experience with Python, SQL, pySpark, Scala, Shell Scripting etc.

 Strong experience with workflow management & Orchestration tools (Airflow,

 Should hold decent experience and understanding of data manipulation/wrangling techniques.

 Demonstrable knowledge of applying Data Engineering best practices (coding practices to DS, unit testing, version control, code review).

 Big Data Eco-Systems, Cloudera/Hortonworks, AWS EMR etc.

 Snowflake Data Warehouse/Platform.

 Streaming technologies and processing engines, Kinesis, Kafka, Pub/Sub and Spark Streaming.

 Experience of working with CI/CD technologies, Git, Jenkins, Spinnaker, Ansible etc

 Experience building and deploying solutions to AWS Cloud.  Good experience on NoSQL databases like Dynamo DB, Redis, Cassandra, MongoDB, or Neo4j etc.  Experience with working on large data sets and distributed computing (e.g., Hive/Hadoop/Spark/Presto/MapReduce).  Good to have working knowledge on Data Visualization tools like Tableau, Amazon QuickSight, Power BI, QlikView etc.

 Experience in Insurance domain preferred.

  • Autocad Draughtsman/woman

    7 days ago

    Chennai, India Planners and Engineer Full time

    Requirement for Auto cad those have knownledge in Pre DCR ONLINE DRAWING WORKING DRAWING & CMDA APPROVAL DRAWING & LAYOUT BASED COMBINED DRAWING. - Should have excellent communication skills - Ability to work independently with little supervision as well as the ability to work within a team. - Excellent multi-tasking skills - Self-motivated with strong team...

  • Autocad Draughtsman/woman

    6 days ago

    Chennai, India Planners and Engineer Full time

    Requirement for Auto cad those have knownledge in Pre DCR ONLINE DRAWING WORKING DRAWING & CMDA APPROVAL DRAWING & LAYOUT BASED COMBINED DRAWING. - Should have excellent communication skills - Ability to work independently with little supervision as well as the ability to work within a team. - Excellent multi-tasking skills - Self-motivated with strong team...

  • Data Engineer

    4 weeks ago

    Chennai, India Encora Inc. Full time

    Description hereLead Data EngineerJD :Qualifications5 to 10 years of hands-on Big Data Engineering experienceExcellent communication and collaboration skillsDemonstrated strong leadership skills in leading a teamKey responsibilities include: ·Create and maintain data pipelines to transform and load data from data lake into Datawarehouse modelsImplement...

  • Data Engineer

    1 month ago

    Chennai, India Encora Inc. Full time

    Description here Lead Data Engineer  JD :  Qualifications 5 to 10 years of hands-on Big Data Engineering experience Excellent communication and collaboration skills Demonstrated strong leadership skills in leading a team Key responsibilities include: ·  Create and maintain data pipelines to transform and load data from data lake into...

  • Data Engineer

    1 month ago

    chennai, India Encora Inc. Full time

    Description here Lead Data Engineer  JD :  Qualifications 5 to 10 years of hands-on Big Data Engineering experience Excellent communication and collaboration skills Demonstrated strong leadership skills in leading a team Key responsibilities include: ·  Create and maintain data pipelines to transform and load data from...

  • Data Engineer

    7 days ago

    Chennai, India Ford Motor Company Full time

    This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams.Data engineers will work in small, cross-functional teams. They...

  • Data Engineer

    2 weeks ago

    Chennai, India HTC Global Services Full time

    Position Description:• This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. • Data engineers will work in small,...

  • Data Engineer

    1 week ago

    Chennai, India Ford Motor Company Full time

    This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. Data engineers will work in small, cross-functional teams....

  • Data Engineer

    1 week ago

    chennai, India Ford Motor Company Full time

    This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. Data engineers will work in small, cross-functional teams....

  • Data Engineer

    3 weeks ago

    Chennai, India HTC Global Services Full time

    Position Description:• This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. • Data engineers will work in small,...

  • Data Engineer

    3 weeks ago

    Chennai, India HTC Global Services Full time

    Position Description:• This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. • Data engineers will work in small,...

  • Data Engineer

    2 days ago

    Chennai, India BU Soft Tech Full time

    Experience - 3 to 4 yrs as Data EngineerTech Stack - Python, Pyspark, SQL, AWS &Bachelor's degree in Computer Science, Engineering, or related field.Excellent written and verbal communication skills.Location - ChennaiRole DescriptionThis is a full-time on-site role for a Data Engineer at BU Soft Tech in Chennai. As a Data Engineer, you will be responsible...

  • Data Engineer

    3 days ago

    Chennai, India BU Soft Tech Full time

    Experience - 3 to 4 yrs as Data EngineerTech Stack - Python, Pyspark, SQL, AWS &Bachelor's degree in Computer Science, Engineering, or related field.Excellent written and verbal communication skills.Location - ChennaiRole DescriptionThis is a full-time on-site role for a Data Engineer at BU Soft Tech in Chennai. As a Data Engineer, you will be responsible...

  • Data Engineer

    3 days ago

    chennai, India BU Soft Tech Full time

    Experience - 3 to 4 yrs as Data Engineer Tech Stack - Python, Pyspark, SQL, AWS & Bachelor's degree in Computer Science, Engineering, or related field. Excellent written and verbal communication skills. Location - Chennai Role Description This is a full-time on-site role for a Data Engineer at BU Soft Tech in Chennai. As a Data Engineer, you will be...

  • Data Engineer

    2 days ago

    Chennai, India Virtusa Full time

    Data Engineer - CREQ174726 Description Skill: Data Engineer Role/Tier- Lead Software Engineer/T2 Location :Chennai /Hyderabad/Pune/Bangalore Shift Timings : 1-10 PM IST Job Description: Design, implement, and maintain the data architecture for all AWS data services Work with stakeholders to identify business needs and requirements for...

  • Data Engineer

    2 hours ago

    chennai, India Virtusa Full time

    Data Engineer - CREQ174726 Description Skill: Data Engineer Role/Tier- Lead Software Engineer/T2 Location :Chennai /Hyderabad/Pune/Bangalore Shift Timings : 1-10 PM IST Job Description: Design, implement, and maintain the data architecture for all AWS data services Work with stakeholders to identify business needs and requirements for...

  • Data Engineer

    17 hours ago

    Chennai, India Virtusa Full time

    Data Engineer - CREQ174726 DescriptionSkill: Data EngineerRole/Tier- Lead Software Engineer/T2Location :Chennai /Hyderabad/Pune/BangaloreShift Timings : 1-10 PM ISTJob Description:Design, implement, and maintain the data architecture for all AWS data servicesWork with stakeholders to identify business needs and requirements for data-related projectsDesign...

  • Data Engineer

    2 days ago

    Chennai, India Aspire Systems Full time

    Data Engineer (Google Cloud Platform)Exp: 5 - 9 YearsLocation: Chennai / BengaluruNotice Period: Immediate - 30 DaysRequirementsFluency in SQL, Shell and PythonKnowledge of building and maintaining data pipelines (e.g. Airflow, Control-M, Autosys)Experience in big data technologies (Hadoop, Google BigQuery or similar) Experience in Cloud technologies...

  • Data Engineer

    10 hours ago

    Chennai, India Aspire Systems Full time

    Data Engineer (Google Cloud Platform)Exp: 5 - 9 YearsLocation: Chennai / BengaluruNotice Period: Immediate - 30 DaysRequirementsFluency in SQL, Shell and PythonKnowledge of building and maintaining data pipelines (e.g. Airflow, Control-M, Autosys)Experience in big data technologies (Hadoop, Google BigQuery or similar) Experience in Cloud technologies...

  • Data Engineer

    4 weeks ago

    Chennai, India Movate Full time

    Role: Azure Data Engineer/ScientistLocation: India (Chennai, Bangalore, Hyderabad)Years of Experience : 5 – 7 YearsWork Mode : Work From OfficeResponsibilities:and analyze data on Azure using services like Azure Data Lake and Azure Synapse Analytics.insights and provide data-driven recommendations.predictive and prescriptive models using tools fromdata...