Data Engineer
1 month ago
Exp-3+ yrs
Location-Chennai(WFO)
compulsory work from office (1st and last saturday working)
notice period-30-immediate joiner
Job Description
Should have a minimum 6+ years in Data Engineering, Data Analytics platform.
Should have strong hands-on design and engineering background in AWS, across a wide range of AWS services with the ability to demonstrate working on large engagements.
Should be involved in Requirements Gathering and transforming them to into Functionally and technical design. Maintain and optimize the data infrastructure required for accurate extraction, transformation, and loading of data from a wide variety of data sources.
Design, build and maintain batch or real-time data pipelines in production. Develop ETL/ELT Data pipeline (extract, transform, load) processes to help extract and manipulate data from multiple sources. Automate data workflows such as data ingestion, aggregation, and ETL processing and should have good experience with different types of data ingestion techniques: File-based, API-based, streaming data sources (OLTP, OLAP, ODS etc) and heterogeneous databases. Prepare raw data in Data Warehouses into a consumable dataset for both technical and non-technical stakeholders. Strong experience and implementation of Data lakes, Data warehousing, Data Lakehousing architectures. Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures. Monitor data systems performance and implement optimization strategies. Leverage data controls to maintain data privacy, security, compliance, and quality for allocated areas of ownership. Experience of AWS tools (AWS S3, EC2, Athena, Redshift, Glue, EMR, Lambda, RDS, Kinesis, DynamoDB, QuickSight etc.).
Strong experience with Python, SQL, pySpark, Scala, Shell Scripting etc.
Strong experience with workflow management & Orchestration tools (Airflow,
Should hold decent experience and understanding of data manipulation/wrangling techniques.
Demonstrable knowledge of applying Data Engineering best practices (coding practices to DS, unit testing, version control, code review).
Big Data Eco-Systems, Cloudera/Hortonworks, AWS EMR etc.
Snowflake Data Warehouse/Platform.
Streaming technologies and processing engines, Kinesis, Kafka, Pub/Sub and Spark Streaming.
Experience of working with CI/CD technologies, Git, Jenkins, Spinnaker, Ansible etc
Experience building and deploying solutions to AWS Cloud. Good experience on NoSQL databases like Dynamo DB, Redis, Cassandra, MongoDB, or Neo4j etc. Experience with working on large data sets and distributed computing (e.g., Hive/Hadoop/Spark/Presto/MapReduce). Good to have working knowledge on Data Visualization tools like Tableau, Amazon QuickSight, Power BI, QlikView etc.
Experience in Insurance domain preferred.
-
Data Engineer
4 weeks ago
Chennai, India Encora Inc. Full timeDescription hereLead Data EngineerJD :Qualifications5 to 10 years of hands-on Big Data Engineering experienceExcellent communication and collaboration skillsDemonstrated strong leadership skills in leading a teamKey responsibilities include: ·Create and maintain data pipelines to transform and load data from data lake into Datawarehouse modelsImplement...
-
Data Engineer
7 days ago
Chennai, India Ford Motor Company Full timeThis role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams.Data engineers will work in small, cross-functional teams. They...
-
Data Engineer
1 month ago
Chennai, India Encora Inc. Full timeDescription here Lead Data Engineer JD : Qualifications 5 to 10 years of hands-on Big Data Engineering experience Excellent communication and collaboration skills Demonstrated strong leadership skills in leading a team Key responsibilities include: · Create and maintain data pipelines to transform and load data from data lake into...
-
Data Engineer
1 month ago
chennai, India Encora Inc. Full timeDescription here Lead Data Engineer JD : Qualifications 5 to 10 years of hands-on Big Data Engineering experience Excellent communication and collaboration skills Demonstrated strong leadership skills in leading a team Key responsibilities include: · Create and maintain data pipelines to transform and load data from...
-
Data Engineer
2 weeks ago
Chennai, India HTC Global Services Full timePosition Description:• This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. • Data engineers will work in small,...
-
Data Engineer
1 week ago
chennai, India Ford Motor Company Full timeThis role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. Data engineers will work in small, cross-functional teams....
-
Data Engineer
1 week ago
Chennai, India Ford Motor Company Full timeThis role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. Data engineers will work in small, cross-functional teams....
-
Autocad Draughtsman/woman
7 days ago
Chennai, India Planners and Engineer Full timeRequirement for Auto cad those have knownledge in Pre DCR ONLINE DRAWING WORKING DRAWING & CMDA APPROVAL DRAWING & LAYOUT BASED COMBINED DRAWING. - Should have excellent communication skills - Ability to work independently with little supervision as well as the ability to work within a team. - Excellent multi-tasking skills - Self-motivated with strong team...
-
Data Engineer
3 weeks ago
Chennai, India HTC Global Services Full timePosition Description:• This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. • Data engineers will work in small,...
-
Data Engineer
3 weeks ago
Chennai, India HTC Global Services Full timePosition Description:• This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. • Data engineers will work in small,...
-
Autocad Draughtsman/woman
6 days ago
Chennai, India Planners and Engineer Full timeRequirement for Auto cad those have knownledge in Pre DCR ONLINE DRAWING WORKING DRAWING & CMDA APPROVAL DRAWING & LAYOUT BASED COMBINED DRAWING. - Should have excellent communication skills - Ability to work independently with little supervision as well as the ability to work within a team. - Excellent multi-tasking skills - Self-motivated with strong team...
-
Data Engineer
2 days ago
Chennai, India BU Soft Tech Full timeExperience - 3 to 4 yrs as Data EngineerTech Stack - Python, Pyspark, SQL, AWS &Bachelor's degree in Computer Science, Engineering, or related field.Excellent written and verbal communication skills.Location - ChennaiRole DescriptionThis is a full-time on-site role for a Data Engineer at BU Soft Tech in Chennai. As a Data Engineer, you will be responsible...
-
Data Engineer
3 days ago
chennai, India BU Soft Tech Full timeExperience - 3 to 4 yrs as Data Engineer Tech Stack - Python, Pyspark, SQL, AWS & Bachelor's degree in Computer Science, Engineering, or related field. Excellent written and verbal communication skills. Location - Chennai Role Description This is a full-time on-site role for a Data Engineer at BU Soft Tech in Chennai. As a Data Engineer, you will be...
-
Data Engineer
3 days ago
Chennai, India BU Soft Tech Full timeExperience - 3 to 4 yrs as Data EngineerTech Stack - Python, Pyspark, SQL, AWS &Bachelor's degree in Computer Science, Engineering, or related field.Excellent written and verbal communication skills.Location - ChennaiRole DescriptionThis is a full-time on-site role for a Data Engineer at BU Soft Tech in Chennai. As a Data Engineer, you will be responsible...
-
Data Engineer
2 days ago
Chennai, India Virtusa Full timeData Engineer - CREQ174726 Description Skill: Data Engineer Role/Tier- Lead Software Engineer/T2 Location :Chennai /Hyderabad/Pune/Bangalore Shift Timings : 1-10 PM IST Job Description: Design, implement, and maintain the data architecture for all AWS data services Work with stakeholders to identify business needs and requirements for...
-
Data Engineer
5 minutes ago
chennai, India Virtusa Full timeData Engineer - CREQ174726 Description Skill: Data Engineer Role/Tier- Lead Software Engineer/T2 Location :Chennai /Hyderabad/Pune/Bangalore Shift Timings : 1-10 PM IST Job Description: Design, implement, and maintain the data architecture for all AWS data services Work with stakeholders to identify business needs and requirements for...
-
Data Engineer
15 hours ago
Chennai, India Virtusa Full timeData Engineer - CREQ174726 DescriptionSkill: Data EngineerRole/Tier- Lead Software Engineer/T2Location :Chennai /Hyderabad/Pune/BangaloreShift Timings : 1-10 PM ISTJob Description:Design, implement, and maintain the data architecture for all AWS data servicesWork with stakeholders to identify business needs and requirements for data-related projectsDesign...
-
Data Engineer
2 days ago
Chennai, India Aspire Systems Full timeData Engineer (Google Cloud Platform)Exp: 5 - 9 YearsLocation: Chennai / BengaluruNotice Period: Immediate - 30 DaysRequirementsFluency in SQL, Shell and PythonKnowledge of building and maintaining data pipelines (e.g. Airflow, Control-M, Autosys)Experience in big data technologies (Hadoop, Google BigQuery or similar) Experience in Cloud technologies...
-
Data Engineer
8 hours ago
Chennai, India Aspire Systems Full timeData Engineer (Google Cloud Platform)Exp: 5 - 9 YearsLocation: Chennai / BengaluruNotice Period: Immediate - 30 DaysRequirementsFluency in SQL, Shell and PythonKnowledge of building and maintaining data pipelines (e.g. Airflow, Control-M, Autosys)Experience in big data technologies (Hadoop, Google BigQuery or similar) Experience in Cloud technologies...
-
Data Engineer
4 weeks ago
Chennai, India Movate Full timeRole: Azure Data Engineer/ScientistLocation: India (Chennai, Bangalore, Hyderabad)Years of Experience : 5 – 7 YearsWork Mode : Work From OfficeResponsibilities:and analyze data on Azure using services like Azure Data Lake and Azure Synapse Analytics.insights and provide data-driven recommendations.predictive and prescriptive models using tools fromdata...